This simply hasn’t been my experience with a 43” OLED TV, which I use as both a TV and my main monitor when working. It’s facing away from the window, which I’m sure helps, but I’ve never had to draw the curtains to see what I’m doing.
Maybe if your TV is facing a window that’s more of a problem, but if so I’d suggest not doing that. You’re never going to get a good experience from a TV facing a light source because of nothing else it will reflect off the screen.
A brighter tv is less expensive than rearchitecting your livingroom.
I don't have walls that don't face huge windows in my livingroom, so I had to splurge for a Samsung Q90. It does well for the most part. On sunny days I still miss even more brightness.
Maybe if your TV is facing a window that’s more of a problem, but if so I’d suggest not doing that. You’re never going to get a good experience from a TV facing a light source because of nothing else it will reflect off the screen.