It's still unknown what causes long covid. Lingering virus is one hypothesis that's still plausible. Indeed some people believe it precisely because the vaccines seem to be helping significant numbers of people (but not everyone, they can also make it worse for some people).