The truth is that little kids will barely remember where you take them, and definitely won't remember the details (like exactly where they went, which place was which, the names of places visited). Once they get older (ie teen, pre-teen), they may start to remember more specifics but eventually it will still be a bit of a blur.
While they will likely enjoy themselves on these trips and have a good time, taking them to say Europe or Africa, will very likely not be any more meaningful to them as kids then a week at the beach or Disney or sleepaway camp. Kids just have a completely different reference point than adults when it comes to travel, and IMO kids don't "value" travel in the same way that many adults do.
Personally speaking, my family didn't travel alot while I was growing up. We just visited the same beach every summer (huge family trip), and trips to see family. I never even left the South. I adored those trips and look back on them very fondly. I was able to study and travel abroad extensively during college and grad school, and immensely enjoyed it. I think I got far more out of traveling on my own terms as an adult than I would have as a child or young teen.
For my own child (now a teen), I take him afar with me to the places I'd like to explore, and he appreciates it. It has broadened his perspective of the world, and I like that. We haven't been to a huge ton of places and we're fine with that. I look forward to him deciding his own travel priorities as he gets older. He's enjoyed some really fun and fancy trips with me but when asked, he'll tell you that by far his favorite travel memories are his sleepaway camps with friends, his school overnight trips (again, friends), and annual family trips to the (same) beach each summer. The wonder and awe of historical, fascinating, far-flung and exotic places that woo me as an adult, get a bit lost on him, lol. And that's okay.