I recently switched away from Firefox. I've been using it from the very start, and tried hard to stick with it over the past few years -- but it keeps getting more and more unpleasant to use. I finally gave up.
Speed isn't a concern for me at all. Usability is.
I very much appreciate the anti-tracking and other initiatives Mozilla has been making, but -- especially with the compromises they make to them -- they aren't good enough to make putting up with the browser a decent tradeoff for me. I'll stick with what I've been doing all along: don't allow cookies, don't allow Javascript, and don't go to websites that fail to work without those things.
The anti tracking stuff breaks tons of sites (because of bad coding) and devs don't seem to care since FF marketshare is so small.
So maybe FF is 3% slower than chrome or whatever. Isn't that a fair price for not going back to the IE6 days?