Generally:

Cats bond more with their "turf" than their humans. So cats are best left home and a pet sitter comes to visit the cat.

Dogs bond more with their humans than their "turf". So the best thing for dogs is to go to the home of the beloved and familiar pet sitter.

I'm over the top with my pets and have a pet sitter stay inside my home.