The Frederick County historical society has a nice museum, and there is the Nat'l Musueum of Civil War Medicine (also downtown) and Rose Hill Manor (not far from downtown). There are plenty of little shops downtown, art galleries, and good restaurants. Check out the schedule for the Weinberg Center, as there are a number of fun events held there. Definitely try Hooch & Banter for lunch or dinner. I love that place!