If you only have ZigBee stuff (which Hue mostly is), you can use Home Assistant with ZHA and get full local-only control. There are other systems, but I use that. Flawless control, never even installed the Hue app.

I deliberately avoid WiFi devices as these often demand WAN access for registration, control. Matter often seems like the worst of both worlds but we'll see.