I feel like this was such a mean thing to say
Omg Op, cut your husband some slack. Fine that he said it. People say things.
First of all you shouldn't even consider it a serious comment until things settle down.
Maybe in 6-8 months, you two could have a calm, thoughtful discussion about options.
I have suggestions for one: no one "needs' to be picked-up at the airport.
You are probably expecting 50% more effort on everyone's part than is reasonable.
Therefore, the stuff that should roll off your back, isn't.