When you cross the state border, the customs officer will ask you to unlock your laptop. In addition, you are reliably informed that this requirement is legal for the country whose border you are crossing. What do you do?
Another example: when threatening to kill your relative, you are asked for your password. What do you do?
Of course, you'll give me the password. It may cause some damage to you or the company, but you won't be the malicious party.
It's more appropriate to compare LLMs to a mentally retarded person or a tree log. Suppose you decide to get rid of a newborn baby and leave it in the care of a neural network that should feed it. Or in the care of a mentally ill person. Or in the care of a log. Eventually the child starves to death and who's to blame? AI? Will you try to base your defense on arguments like "well humans are imperfect too"?
Another example: when threatening to kill your relative, you are asked for your password. What do you do?
Of course, you'll give me the password. It may cause some damage to you or the company, but you won't be the malicious party.
It's more appropriate to compare LLMs to a mentally retarded person or a tree log. Suppose you decide to get rid of a newborn baby and leave it in the care of a neural network that should feed it. Or in the care of a mentally ill person. Or in the care of a log. Eventually the child starves to death and who's to blame? AI? Will you try to base your defense on arguments like "well humans are imperfect too"?