This is of course completely valid, but to provide a countering anecdote, looking for companies that do this kind of recurring retreat is a strong positive signal in my current search for a remote dev job.
Why are you acting like you're going to be told on Thursday that you have to get on a flight across the country Sunday night?
I've known several people who work for companies like this. It's always been scheduled months in advance such that by the time you go on one the next one is typically already locked in. And even the long ones have been 4-5 days, not "weeks." It just seems like you're intentionally making this into a strawman when "travel for work 4-5 days at a time, 1-3 times a year" is a perfectly reasonable job requirement. And even with all that being said, there's nothing wrong with just not wanting to do that.
> The idea of taking the team out to an airbnb (or some other communal living arrangement) in the woods or by the beach for a week or two to launch a new major initiative 1-4 times a year
Note that "week or two" and "1-4 times a year". It isn't a strawman, it is literally the topic.
As for
> Why are you acting like you're going to be told on Thursday that you have to get on a flight across the country Sunday night?
I don't believe I ever expressed that the trips are surprises. It isn't a matter of planning, it is a matter of the duration being a burden.