We are huge fans of The Barenaked Ladies' kiddie album, Snacktime! I think we know all the songs' lyrics by heart at this point. Fun songs that don't make the adults cringe.
For something a little quieter, Lisa Loeb and Natalie Merchant both have great kids' albums.
My tot loves the Beatles too. Also The Jackson Five.