I'm similar to you in size. I do like Theory dresses and suits, although the suits are sometimes they're a bit big and need tailoring.
I have these and wear them often to conferences with blazers, sweaters, etc.:
https://www.theory.com/sleeveless-fitted-dress-in-good-wool/J0701615_001.html
https://www.theory.com/sheath-dress-in-good-wool/H0101632_WNF.html
I also have some basic J. Crew wool work dresses that are cute and have held up nicely over the years.