He's not being pompous, people appreciate the informality and straightforwardness and self-deprecation, which are the opposite of pompus.
You are reading some of the more ambiguous self-deprecation as genuine claims.
TL;DR on why this is important and he's sharing: it's a sort of niche thing that really only matters if you're trying to run pale imitations of ChatGPT on constrained hardware. That's why it's entirely possible the big guns didn't see it as important, they're not trying to run LLMs on a 3090
You are reading some of the more ambiguous self-deprecation as genuine claims.
TL;DR on why this is important and he's sharing: it's a sort of niche thing that really only matters if you're trying to run pale imitations of ChatGPT on constrained hardware. That's why it's entirely possible the big guns didn't see it as important, they're not trying to run LLMs on a 3090