Why does you H need to go to church?
My H does not.
I got my kids through confirmation. It seems reasonable to finish communion and then stop, or to finish through confirmation. My brother just baptized his kids but they eventually asked for the sacraments (mostly because of cousins) and then did the sacraments in HS. I also have brothers that are either nothing or other forms of Christian.
I have tons of issues with the mass and our local churches. I discuss those issues with my children. You should discuss them with your children so they are educated on all sides of the issue. Your H should explain his issues with the Catholic religion to your kids.
Why not take them to both churches and let them decide themselves.
My kids go to Catholic school and they have learned about all religions. Most of their friends either are not Catholic or have 1 parent that is not Catholic.
We are still culturally Catholic and try to live a good, kind, empathetic, compassionate life.
I like to read this...
http://www.americamagazine.org/