What if you get married and have kids? Maybe he won't yell at you in front of the kids, but maybe he might. Maybe he will yell at the kids. Maybe he will raise sons who yell at the waiters too. Or at their own mother.
Relationships are hard in general. Don't add to that by staying involved with an ass.