That sounds awful. I go to the office to chat with everyone, it's incredible how much work gets done when you can just walk over to someone and debug or rubbery ducky in real time.
Yes. I got fired from that place for being too negative and now work somewhere much more sane.
The CEO to his credit went on a campaign to improve the culture, but middle management obstinately refused to change a single thing. I recently heard he got fired by the board too, go figure.
Remote work did a number on middle management. When many of them realized that if they aren't the strategic brain at the top, and they aren't individual contributers, and they can supervise butts in chais, then they aren't actually providing that much value.
So adapt. Learn to curate your team and their work. Lead by helping people organize, getting obstacles out of their way, shielding them from alarmist BS from higher management, and stop worrying about butts in seats. Focus on agreements, goals, commitments, accountability, growth, and coaching.
Everybody is different. When I visit the office sometimes, I do it to socialize and talk about things not related to work mainly. And then I get back to do the actual work. If I need to communicate with someone, I simply ask them for their time - they can get back to me whenever they are free. This system serves me and my coworkers well but it's obvious there are many people who prefer synchronous in-person communication for most tasks.
I don't prefer the in-person communication personally, but I know it's more productive for me, so I do it and end up preferring it. The same way I prefer clean code; it makes my and the companies life easier. Makes more money. I'm German, and it's painfully obvious.