Most likely, your mailbox does not close easily; fix it. This has never been an issue for us, and I am 54 years old, not a problem for any other person I know.
Or you pissed him off by blocking the easy access to your mail box and he slams it out of frustration of having to get out to put your mail in.