There are several dozens of military folks working at the Pentagon whose families live in SE Virginia. The usual routine is to head north Sunday late AM, work a compressed schedule (still 40+ hours) and had south Friday afternoon. Some do this for their entire 3/4 year tour at the Pentagon. This is decades old, btw.
I also have heard of Army folks whose families live in Aberdeen MD and do roughly the same thing while working at the Pentagon.
In all of these cases, the spouse is a single parent with kids during the week. Military are not paid very well, so a nanny or an au pair is just not possible financially. They make it work.