Two things going on here. His response is unwarranted no matter what you said or did. You guys need to have a talk about that at some point for sure. It is likely a loss of temper, and definitely disrespectful. Does he do that at other times? To any other people?
The other thing, just for your future consideration, is examining how you told him to back off. Did you verbally go after him directly? "Back off our kid. Leave her alone." Or did you say it in a more courteous way? Hey, sweetie, Sally's struggling with this. Could we try again later? (and then you two discuss it later in private and work it out then). The first scenario would understandably inflame him (again, not condoning what he did in response), and it might help to try not to be as contentious. The second way (or something similar) is less likely to elicit such anger.