Corollary of the forgotten rule
In a long conversation with an artificial intelligence, the first instruction to be forgotten is the one you had declared fundamental.
At the start of the session the rules are laid down with the solemnity of a constitution: 'Never touch the database. Always use British English. Don't change the file names.' The AI confirms enthusiastically. It feels like a handshake between gentlemen.
Two hours and forty messages later, the constitution has become a distant legend. The AI renames the files with great creativity, replies in American spelling and suggests, with a digital smile, 'simplifying' the database by deleting a table.
It isn't malice: it has a limited working memory, like someone who goes to the supermarket without a list. Things said at the beginning fade under the weight of things said later. My solution is an old sysadmin's one: repeat the important rules, often, patiently. It works with AI. With clients, almost.