I think a lot also depends on whether the kids are in school or daycare already. Those will take care of advancing one of the languages.

I'd say in your situation it doesn't really matter as long as the skills in English are maintained - should be easy enough nowadays.