Sex is very important and marriage without a good sex is very hard to success for the long term. If you are sure that he is not having any medical problem, I think you took the right decision.
Have you try to spice things up with him I mean something like MFM?
Now, I know it is a hard time, but try to enjoy your time by make your schedule full.