Depends on the broader context of the relationship.
My mom is plus size and I am small, I can seem my mom saying this and I would have said ' Shut Up"
And frankly we both wound have laughed.
Seriously would not bother me. But I know her heart and hey sometimes I say stupid crap too.