It depends on your agency's policy, which should be clearly spelled out.
In our first year hosting we let the ap take all her vacation during the first 6 months. She then initiated rematch right after. We kicked ourselves for that one and considered it a learning experience. We did pay for her class but it hadn't begun yet, so were able to get a refund.