it already exists. in europe too when you call a customer service you will almost never end up with a human. obviously beside the cost aspect the main idea is to remove your right to appeal. even the governments are doing it!
Hence regulation so you can appeal, so you can get a human to review an AI decision that impacts your life, and so that AI systems with high impact have a baseline level of documentation and ongoing evaluation.
