I haven’t used any but I’ve been intrigued lately to try them. I agree that performance impact could be a major concern. It’s the main reason I haven’t tried yet.Especially using and processing video instead of screenshots. I have a desktop and a laptop - it’d be nice if it was possible to offload processing from the laptop to a remote host. Maybe even just use public APIs for those willing to take the privacy risk. Rewind and commercial offerings wouldn’t be so bad if you knew the only dependency was an inference API instead of remote databases and storage.
How about dedicated external system for this, running on rPi or proxmox instance. On the local macgine app should only record screenshots on major scene change and save them on remote fs where it would go tgrough ocr, indexing, embeddings, whatnot.
A lot of us have been experimenting with these kinds of systems but not publishing them for various reasons; many aren't copycatting M$ so much as inspired to get their projects out.
Oldest similar idea I can think of is from 1945, called the Memex:
> Bush envisioned the memex as a device in which individuals would compress and store all of their books, records, and communications, "mechanized so that it may be consulted with exceeding speed and flexibility".
another open source one of these I found intriguing: https://github.com/jasonjmcghee/rem
i personally worry about these slowing down my machine but I'm torn because for privacy reasons I'd only ever use the local versions.