Dog foster here.
A. You rehome NOW, as in, today or tomorrow, before the kids get too attached.
Either you bring it back to the breeder, or you contact a rescue such as this one:
LDCRF Lost Dog and Cat Rescue Foundation, VA. They might have a spot. I foster for them
https://www.lostdogrescue.org/rehoming/
OR
B. You all commit, with your husband being the main person.
How old is the puppy and are you starting from scratch with potty-training?
Potty-training:
Starting NOW, he has to leash the puppy to him, observe his body signals (circling, sniffing the ground, etc) to suss out when he needs to pee, and scoop him up and take him outside. Take him outside anyway every hour. Reward with treat every time business is done successfully outside the house. Admonish every time business is done in the house. No hitting, but displeased tone of voice. They have short memories, so it serves no purpose to scold if not caught in the act. Hence the leash and attention on the dog ALL DAY. He's staying home with the puppy for the duration of potty-training, RIGHT?
Crate-training: crate must be small enough, or partitioned, so that the puppy will not want to go where they sleep. Do not leave a puppy in there for more than 4 hour increments during the day, or without first voiding bladder, otherwise they will learn to pee in there. Husband needs to GET UP IN THE MIDDLE OF THE NIGHT to get the puppy to pee outdoors if the puppy is less than 4 months old. A 4 months old puppy can generally hold it in for the night, if he's voided right at bedtime.
But honestly? I wouldn't indulge an grown man's impulsivity in this way. Even if I wanted a dog myself. The dog goes back, because such decisions should only be taken after serious discussion, and you're going down a slippery slope if you allow this transgression. Your husband is a giant baby, and I assume this is the least of his issues.
It's a cute lab puppy, it will be snapped up by another family very quickly, OP.