Lands End sweater fleece jackets are cute and a slight step above your standard outdoor/hiking fleece.
http://www.landsend.com/products/womens-sweater-fleece-jacket/id_258756
I have the carraway heather from last year and it's worn very nicely so far, no pilling.