You are not overreacting. Not your fault. Yes, he put his hands on you in a very unsafe, unacceptable, and inappropriate way.
Do not sweep this under the rug.
http://www.thehotline.org/get-help/help-in-your-area/
Please look at this website to find information and help in your area. If nothing else, just call to talk to someone about this.