I have pale peach fuzz, but lots of it and it's starting to get longer as I age. I use one of those cheap facial hair trimmers (like this:
http://www.soap.com/p/conair-ladies-2-in-1-fine-line-personal-trimmer-64889). I use it every one to two weeks on my upper lip and chin, and a few times a year on my jaw near my earlobes. The trimmer doesn't / shouldn't take the hair so short that you get a hard stubbly feeling, just short enough that it doesn't protrude off the face and catch the light.
(I do not use it on my eyebrows, despite the package recommendation.)