I agree, please do tell your agency, because you're right, it's likely to be the same if not worse. And please do try to tell the au pair again. Having seen this happen multiple times before (I'm a host parent), au pairs, particularly new au pairs with poor English are going to be really really hesitant to complain to the agency.