Stand up for yourself.

So what if she gets angry?

So what if she doesn't see the kids? They'll get over it, and definitely don't need such a selfish person in their lives.