I agree with you on SF. There are certainly a bunch of great companies to work for there. However, at the risk of angering a lot of people, the majority of promising startups are in the South Bay.
NYC is expensive, but not unbelievably so, especially when put next to SF. To live within a 5-10m walk of Palantir's office in the West Village is roughly $4k for a 2BR(so I'll be paying $2k/month). Certainly not low rent by any stretch of the imagination, but it is definitely affordable with an engineer's salary. Also, the difference in salary compensates for this cost.
I'm not sure where you're getting your information that the majority of promising startups are in the South Bay.
The energy in Silicon Valley has been shifting northwards for the last 10 years. The majority of large companies are in the South Bay, but among companies less than 5 years old, there are as many great ones in SF as in PA/MV.
And you're right about one thing - if I ever found myself suddenly single, I would move back to NYC in a hot second. As a (somewhat) sane straight guy with a bit of money, that dating scene can't be beat. Hands down.
NYC is expensive, but not unbelievably so, especially when put next to SF. To live within a 5-10m walk of Palantir's office in the West Village is roughly $4k for a 2BR(so I'll be paying $2k/month). Certainly not low rent by any stretch of the imagination, but it is definitely affordable with an engineer's salary. Also, the difference in salary compensates for this cost.