Most likely dried out ink then.

TBH I usually just lick my finger, rub it on the heads, and then rub them on my jeans. Denim is quite good as a lint free soft-scourer.
Of course you then have to wash your finger and jeans, but when you're sat at the computer/printer who can be bothered getting up and looking for some cleaning kit?