The religious (Christian) aspect of Grove City is significant and conservative. The costs and available financial aid used to be quite different from other schools that might be considered comparisons. If I remember correctly, they had a generally lower cost and very generous aid, but were restrictive in the types of federal financial aid that they accepted.
The academics are generally consistent with secular or lightly-religious liberal arts colleges, which cannot be said for many of the highly religious schools. It's not known for rigorous academics, but it's not a slouch school and I've known people to go on to med school or PhD programs in the sciences.
Bouncing off the PP with a few other suggestions, you might find some interesting options among the 'Colleges That Change Lives' set:
http://www.ctcl.org/