We've never felt guilty...even though we're in a really good DCPS area, we wouldn't send our children to public school. It's just what it is.
You're doing this for your child...no one's business but your own.
Many low keyed folks in private...don't worry or apologize for your situation.