If a user says "thank you" as a separate message, then that will require all the tokens from the system message + previous state of the chat. It's not about the single word "please".

That said, no one was "annoyed" at customers for saying please.