This does happen in droves, but it's more when kids reach elementary school age. SF is a pretty difficult city when it comes to ensuring your kid gets into a decent elementary school, so that's one point at which many people leave. Not to mention that you don't have to go far in any direction (north to Marin, east to Berkeley, south to Palo Alto) and you have fantastic public schools.