I wouldn't care if you do this, but I can't imagine why you need to? I could see one of my kids causing a problem, wanting to come home with me, or wanting me to buy him something (that the other kids in his group aren't getting), or somehow just being disruptive in a way that wouldn't be the case if I weren't there. Seems like there's no benefit and a small chance of causing a problem, so why?