It's about as expensive to live here as it is in many skyscrapers in Manhattan. NYC seems to have those other problems pretty well figured out. I've never heard a very convincing reason that SF can't be more like Manhattan in terms of density, except that the existing residents who've "got theirs" don't like the idea.