Thanks everybody. I think it is an opportunity I cannot pass up. To answer a couple a questions, I am (sadly) not even close to retirement. I already have a clearance and I honestly do not know if I would keep it there, but assume I would.
The only thing that is holding me back is letting go of the relationships I have made and the reputation I have made for myself. At my current agency, people know to call me for certain things and I know who to call in other parts of the agency whenever I need something. I hate the idea of having to build that all up again. On the other hand, it is totally worth it in the long run.
Thanks for the advice so far and any additional insights appreciated!