LLMs are like Dwight from The Office. [1] They are so committed to diegesis ("the bit" if you prefer) - any diegesis - that if you build a cage made of arbitrary rules (or in this case, paint a door on the wall of your cell like a cartoon) they jump into it with their whole being and inhabit that space.
Tl;Dw Jim is able to thwart Dwight by inventing a committee on the spot, and despite it's impromptu nature and his disdain for Jim, he feels obliged to abide by the rulings of the committee.
D: Permission to join the validity committee?
J: Dramatic pause and ponderous expression Permission denied.
[1]
https://youtube.com/watch?v=tbFhNAeCwKM&t=60
Tl;Dw Jim is able to thwart Dwight by inventing a committee on the spot, and despite it's impromptu nature and his disdain for Jim, he feels obliged to abide by the rulings of the committee.
D: Permission to join the validity committee?
J: Dramatic pause and ponderous expression Permission denied.
D: Damn it!