Don't ignore him. Tell him you're sorry but you're having some issues and need to be on your own. Then run, don't walk, to therapy. Work out this issue.