Yes, they collect it for awhile then send you a check (if you are lucky).
when it's time to start paying taxes again, make sure you have the money. They don't usually wake up on time and start collecting it. They'll pay it and then charge you for that and for the upcoming one all at once.
They also keep a lot of extra money in escrow just in case.