You both need to find balance and compromise that's what relationships are about finding a way to make it work I Don have easy answers I understand his frustration I am not into the sissy mommying part its more wanting my spouse to embrace the diaper lifestyle more and we don't have children.
Perhaps finding a way to send the kids to a grandparents for a weekend once a month or something for your personal down time, I know that doesn't always work.
He has to be careful not to allow this not to control you both have to work at it plan it so that you know when to look forward to those special times.
You're more understanding and accommodating that 98% of most spouses out there.
Wetly yours
Babyalan