Another friend of mine was reviewing software intended for emergency services, and the salespeople were not expecting someone handling purchasing in emergency services to be a hardcore programmer. It was this false sense of security that led them to accidentally reveal that the service was ultimately just some dude in India. Listen, I would just be some random dude in India if I swapped places with some of my cousins, so I'm going to choose to take that personally and point out that using the word AI as some roundabout way to sell the labor of people that look like me to foreign governments is fucked up, you're an unethical monster, and that if you continue to try { thisBullshit(); } you are going to catch (theseHands)

This aspect of it isn't getting talked about enough. These companies are presenting these things as fully-formed AI, while completely neglecting the people behind the scenes constantly cleaning it up so it doesn't devolve into chaos. All of the shortcomings and failures of this technology are being masked by the fact that there's actual people working round the clock pruning and curating it.

You know, humans, with actual human intelligence, without which these miraculous "artificial intelligence" tools would not work as they seem to.

If the "AI' needs a human support team to keep it "intelligent", it's less AI and more a really fancy kind of puppet.