If you're speaking with investors, and are good about networking with funded startups chances are you can get office space for free for several months.

Regarding rent, you'll be paying a lot, and finding an apartment in NYC is a grueling process. But, there's a reason rent is high -- people love NYC!