It’s been a long time coming, but on August 2nd, the EU AI Act stopped being a theoretical regulatory discussion and started the long road into enforcement.
Continue readingCategory Archives: AI
Some AI career advice…
I’m getting a lot of contact from mid-level test managers as well as a fair number of senior ones either looking for work post redundancy or trying to get ahead of an impending one. I also recently gave a short internal talk on the impact AI is having on the testing business, and aside from potential scaring some folks, I got asked the same inevitable question: what should we do?
Continue readingThe Coming AI Jobocalypse
I’m taking a break for a bit from AI social commentary and the increasingly tedious (and boring) work of watching the AI Confidence Bros and test tool vendors discover testing for the first time. I’m going to (try) to focus on some podcasts and AI integration e.g. what happens when these systems run into organizations, people, controls, incentives, legacy technology and reality.
Continue readingThe Incompetent Expert Machine
I posted this paper my friend Michael Bolton sent me a while ago about the LLM Mentalist Effect in the AI Testing and Assurance group as a risk we need to test for in AI systems. It got me thinking about how middle and upper management are probably the largest group under threat of AI in the near term, which is why they’re fighting with such fervor for room with people who actually know what they’re doing.
Continue readingTesting at the Speed of Stupid
I have now sat through multiple vendor demonstrations built around the same supposedly inevitable future that AI will generate so much code, so quickly, that human beings will no longer be able to test it.
Continue readingSummer of Sham
If the latest AI Safety Index isn’t the bucket of cold water you needed about the people shoehorning GenAI into every aspect our lives while blowing a multi-trillion dollar hole in the global economy, I don’t know how to help you.
Continue readingThe Great Capitulation
You know where this is heading, right?
We’re being told that AI systems are too complex, too sophisticated, and too difficult to test and that it’s easier to try to conjure up a confidence index than it is to properly test them. Respected people in the software testing world are saying things like “you need to let it go and just like, trust the AI” and describing AI native test tools as a “magic trick”.
Continue reading