What about Harper's Ferry, WV? Beautiful natural surroundings, wonderful history, cute town. Shouldn't be too crowded in early May.
Laurel Lodge gets great reviews:
http://www.laurellodge.com/
And Canal House for dining:
http://www.canalhousecafe.com/