Agreed, definitely, you should start interviewing immediately.

I appreciate that you want to stay friends with these people, and maybe you can, but then again maybe not. It is totally unprofessional and utterly silly for someone to get angry when one of their people quits, but nonetheless I have seen it happen. I would suggest that if they react that way, maybe they aren't such good people to have as friends after all.