You are not being overly sensitive. It is just a question of how easy it would be to find another job, and gently explain this was not the right "fit" for you.