I quit my last job over less than this, and I felt really uncertain about it at the time, but my career growth, compensation growth, and intangible feeling of management support have all been massively better at my new place - and I found it by being randomly contacted by a headhunter. My old job wasn't bad nor was my old manager, there just wasn't a fit between what I wanted to do with my career and what my employer wanted to do with that role. The immediate trigger was that I had a conversation much like this one where I thought I was being treated unfairly, and in retrospect I wasn't really, but in fact it was a good sign of that mismatch.

So I do want to encourage you to keep your eyes open for other opportunities. If you're a Rust coder working on computer vision stuff, and you're early-career enough that you're not particularly tied down as a person, you have a lot of options.