He replied in the same way one might at a party -- you say something, then he tries to relate to it. In this case, he was explaining why he can't relate.

Seemed like a natural exchange to me.

Well, I don't get out much, so I don't have those party chit chat experiences. Maybe that's the problem.

Chit chat isn't just for parties. Meeting new people is often enjoyable, though more fun if they're agreeable instead of complaining.