It's very easy to do. If you're traveling in the summer, try to not walk in the middle of the day.
If you're not a person who walks much, then sure it may be a challenge. But for a moderately fit person, walking to all the sites is the best and easiest way to get around Rome.