What does your son want to do? Does he want to play basketball with you or does he want to go run off with the neighbor? And if he'd rather go play with the neighbor, is that okay with you?
He likes playing with the neighbor, and they do play together sometimes, which is totally fine by me. But it doesn't seem fair that we can never play basketball, which is why I want to tell this kid that he can't insist that DS do something else every time we are doing so. DS is happy to either play basketball or hang out with the kid in the moment, but he wants to get better at basketball, and if we never play, that's unlikely to happen. I'll start suggesting that the kid come back in 20 minutes if he doesn't want to play, or sit quietly and watch for 20 minutes.