How old is your toddler. Would they put up with ski school?
Stowe is a cute town. But toddlers may not be old enough to do much of the outdoor fun.
https://gostowe.com/travel-tips/blog/blog-unforgettable-family-fun
https://vermontvacation.com/family-ski-trip-stowe/
The VonTrapp Lodge is often recommended. They don't have a kids program but they do offer a winter carriage ride. I can't find the situation with their pool but they have massages and yoga.
When we took our kids on winter ski trips, they read books, did board games, and also found shopping in a new grocery store to be somewhat fun.
My husband took our 4 year old to the Burlington Science Center.
We have seen fireworks and ski torch parades at ski resorts on New Years'. Those are usually a little crowded but not impossible.
Vermont old-timey general stores can be fun for little kids.
A lot depends on your kid. I'm always amazed by the athletic families that start their kids early. If you project enthusiasm, the kid will likely do that too. If you don't think it's fun to be out in the cold for long, the kid will pick that up from your face.
https://m.youtube.com/watch?v=POKAP30TMMk