> So pointing out that an LLM has trouble with some concept doesn’t mean anything.

Why? We do the same with children, animals, and people (with severe head trauma for example). Why should AI get special treatment?

We're happy to test if crows and dolphins can do arithmetic and just all sorts of cognitive hoops.