I have to agree. There are already at least two notable and high-profile failure stories with consequences that are going to stick around for years.
- The Israeli military's use of "AI" targeting systems as an accountability sink in service of a predetermined policy of ethnic cleansing.
- The DOGE creeps wanting to rewrite bedrock federal payment systems with AI assistance.
And sadly more to come. The first story is likely to continue to get a hands-off treatment in most US media for a few more years yet, but the second one is almost certainly going to generate Tacoma Narrows Bridge-level legends of failure and necessary restructuring once professionals are back in command. The kind of thing that is put into college engineering textbooks as a dire warning of what not to do.
Of course, it's up to us to keep these failures in the public spotlight and framed appropriately. The appropriate question is not, "how did the AI fail?" The appropriate question is, "how did someone abusively misapply stochastic algorithms?"
As I noted on the YouTube video, this is doubly heinous as a lot of CA community college instructors are "freeway flyers" - working at multiple campuses, sometimes almost 100 miles apart, just to cobble together a full-time work schedule for themselves. Online, self-paced, forum-based class formats were already becoming popular even before the pandemic, and I've been in such classes where the professor indicated that I was one of maybe 3 or 4 students who bothered to show up to in-person office hours. I have to wonder if that will end up being a hard requirement at some point. The bottom rung on the higher-education ladder is already the most vulnerable, and this just makes it worse.