I agree, it seems like this might have something to do with it. I recently heard some speculative but reasonable (I thought) theory about early Levant humans.^ Basically, elephants were these people's primary prey until populations dwindled and the lifestyle died out.
We often note that our bodies are so weak relative to animals' but that really understates how game changing the human species must have been. First, bodies have all sort of potential that most people never experience because we don't grow up outside and chase elephants. More importantly, people are is good at figuring things out. We're impressed by inquisitive animals, bears or honey badgers, relentlessly try to get what they want by trying everything. That's nothing compared to humans.
A hippo-or-walrus-like thing might avoid getting eaten by a cat-or-bear-like thing by having really thick skin. Humans can't be deterred that way. We don't need to wait until we evolve longer teeth.
Real people must have been a holy terror.
^Fascinating old human stomping grounds... Early Sapiens predate neanderthals in the region. A rare situation where they displace "us," or at least people with skeletons similar to ours.