Absolutely would have done this with the one nanny we hired who behaved this way...but she basically left the nannying field and was quitting to do something else. In the end, there was nothing I could do as I knew she'd never list us as a reference for another job.
The lesson I learned was to hire someone who had worked as a NANNY--day in, day out, month after month--rather than someone who had great babysitting references, which the case with the person I had hired.
I wouldn't leave a bad review to be vindictive, but just like PPs said, to let the next family know what honestly happened.