OP, how old are you and DH? My friend lived in Clifton about 20 years ago. Residents were particularly touchy about calling Clifton only the tiny downtown area with the general store and railroad track, not much more. That area had old rickety houses with land (likely densely developed by now), and some newer houses that were worth about the same amount as the former, but they refused to say it was Clifton - even though the post office called and still calls it Clifton. I imagine now that their elementary is closed, their children are all together -egads! Except that most of the people who had a problem calling the latter Clifton were old hags who had lived there forever and were slightly backwoods, to be nice. I don't know what it was called before that.
Some people will try to downgrade where you live if they do not (can not afford to) live there, I suppose. My friends house was a very nice, large, traditional colonial (not a tract home) FWIW. Maybe some of the locals are touchy about change, but if you have lived elsewhere in the U.S., you likely will not care less and they will actually come across as the crazy ones
I have heard good things about Burke and Fairfax Station, but do not know if they have the same hang ups.
Where do you commute? If you are far away, it may really be an issue.
How did you decide on these areas?