While there you also ate food (maybe, mostly canned food, since other food was unavailable).
Do you regret going to Miami (under these conditions)? Absolutely, yes!
Do you regret the food you ate whilst there? Absolutely, no!
The children can be likened to food.
On the other hand, a Midrash was quoted here recently about Yaakov not divorcing Leah, even though he good reason to, since hashem blessed him with children through her