It comes with downsides as well in the sense that it's a very rare privilege. If your company decides one day to let you go , cancel work-at-home privileges or simply goes under, your life is going to suddenly become much, much harder, especially in the case of people who, like you, took this opportunity to move to a very isolated area.
I live in an area with pretty much 0 worthwhile tech jobs. I've been working remote for a while now and done so with 3 very different organizations doing very different types of work (plain old software dev to machine learning research), and I've personally found this not to be a "very rare privilege" at all. Currently about 9% of the jobs on Stack overflow careers are remote, and if you look carefully you can find a very wide range of work.
I find the remote space is rapidly advancing and expanding. The tools are getting much better, and the diversity of companies offering remote work is as well. It's definitely sustainable to choose to work only remotely, and even if I were to move to a city with better tech jobs I would have a hard time going back to full-time working in an office.