Yes. If I don't exercise regularly I will be sore 1) when I start exercising again and 2) when I do nothing at all.
Do some new exercises (I'm a fan of body weight exercise ... pushups, squats, tricept dips, lunges, planks, etc), yoga, or biking or running just to change it up.