I've used hotel sitters in several European countries and the US. I have no issue with it and obviously if I were concerned or had a bad feeling about the sitter or situation I wouldn't go. It's been totally fine. I felt more comfortable about using a sitter through a hotel or agency (have done both) because there is some accountability through them, and generally some background vetting that I cannot do as a foreigner in a different country. Each time the sitter has remained at the hotel with the kids, usually in the room and simply fed them and put them to bed.