The Incompetent Expert Machine

I posted this paper my friend Michael Bolton sent me a while ago about the LLM Mentalist Effect in the AI Testing and Assurance group as a risk we need to test for in AI systems. It got me thinking about how middle and upper management are probably the largest group under threat of AI in the near term, which is why they’re fighting with such fervor for room with people who actually know what they’re doing.

I guess it’s not just me seeing this, as “ Is AI Creating Incompetent Experts?” ponders if the explosion of GenAI has the high probability of creating “professionals who appear competent but lack the judgment to back it up”.

It does and is.

Quick and easy answers from your AI BFF which soothes all your impostor syndrome developed over decades of not having to really think about things too deeply is a powerful drug. AI is Dunning Kruger on steroids and as Futurism found, there ain’t much hope for a cure as a study they referenced found that “having a conversation with the sycophantic AI chatbots led to the participants having more extreme beliefs, and raised their certainty that they were correct.”

Sigh

Hopefully all this transformational job displacement will start top down, but we all know it’s the hope that kills you…

Anyway, back in your box 😊 


Discover more from Quality Remarks

Subscribe to get the latest posts sent to your email.

Leave a Reply