No, he's talking about memory getting passed into the prompts and maintaining control. When you turn on memory, you have no idea what's getting stuffed into the system prompt. This applies to chats and agents. He's talking about chat.
The first sentence is mine. The second I adapted from Claude after it helped me understand why someone called my original reply insane. Turns out we're talking about different approaches to using LLMs.