Banff is gorgeous! Lucky you. Yes, easy drive from Calgary. The Fairmont was too big of a pinch for us ten years ago, but we "visited." Beautiful grounds, beautiful building, wonderful amenities.
Have a great time- don't miss Lake Louis- it's remarkable.

Definitely do dinner at waldhaus if you stay at the Fairmont Banff springs