I most definitely would. I would be very angry and disappointed, but honestly what can you do at this point? I mean, you can be as mad as you want, but that is probably the only recourse you have.
If I were them, I would try to make it up to you.
This is a red flag that they do not value you as a person, employee, nanny, etc.
Just keep this in mind.