Five years ago we went with our elementary age children; I get the sense that things haven't changed much for better or worse, but welcome correction. We walked all around downtown and never felt unsafe.
However, the level of homelessness and disorder on the streets was truly shocking - and we live in close to downtown DC so are familiar with the issues here and have traveled to many large cities in the US and around the world. There were large, filthy encampments with open drug use to a degree that I've never seen in the US. We learned to avoid the worst blocks, but it definitely made visiting the city less pleasant.
If you're interested, this article is eye opening. What's amazing is how much the city is doing to help, but how hard it is to address:
https://www.newyorker.com/magazine/2020/06/01/a-window-onto-an-american-nightmare