Absolutely, yes. I don't even have kids. I would take a 15% cut to go from fully in office to fully remote.
There was recently another post about a DH who lost has job and was concerned about taking a "pay cut." Most responses were that it's not a pay cut when you make zero. That's not to shame you at all. I would just try to frame this not as being paid "less" because you are currently not making anything. It is, as you said, a great opportunity to return to work doing something low stress in a really supportive work environment. As you can see from other posts here, many SAHP struggle to break back in. You've found a job that's a really good fit, plus it has the huge perk of being remote.
That's awesome, honestly. With the proportion of HHI you're making, it doesn't make sense to give up the huge flexibility of being remote for a little more money. If your DH out earns you that much, realistically, you will still be expected to be the primary parent and take time for appointments, sick kids, etc.