So to defeat this it appears that browsers simply need to always request a favicon in private browsing mode?

It will be interesting to see how Google will reconcile the contention between Google Search's reliance on tracking and Google Chrome's need to protect users.