
Happy to be included in the 272nd issue of Software Testing Weekly – thanks, Dawid Dylowicz!
Happy to be included in the 272nd issue of Software Testing Weekly – thanks, Dawid Dylowicz!
These days, your philosophy about testing is more important than ever and a differentiator in the software testing market. Santosh Tuppad has been leading from the front since I first met him as a rising star at Moolya and through his workshops on security testing with me in the Bronx or in Germany with the Afghan Girls Robotics team.
Come take a listen as we talk about the current state of testing skills training in our business, cyber security in the age of AI, and travel far off the beaten path into philosophy, true happiness as a tester, and how many cheese fries is enough…enjoy!
If someone you work with is making the following statement, “We don’t need to hire any more testers, we can do this all with AI!”, I may not know that person, but I can tell you a couple things about them…
– They are a deeply unserious – they clearly have not thought about or researched anything related to AI, software engineering, software quality, software testing or risk management.
– They don’t care about people – I have yet to see this “thinking out loud” BS not being used as a thin veneer to cover the age old question of “how do I get rid of all these people!”.
– They shouldn’t be responsible for anything to do with producing products that impact society – This is the kind of “blue sky” questions that to try to “challenge the status quo” with no regard whatsoever to the impact or harm caused to real people and end up “inventing” busses again.
As before, where the only “shifting left” was into vendors pockets from unsuspecting clients, you’re not dumb – you’re being misled.
And just to get in front of the “youreonlyprotectingyerjobs” AI fanboys – you’re goddamn right I am!
I care a LOT about the people testing software and systems every day, and I can tell immediately if you’ve never had to live with that responsibility.
Do better…
The following is a post I wrote for the EuroSTAR blog as KPMG UK are going to be at the expo this year up in Scotland…hope to see you there!
The pace that “artificial intelligence” (AI) is being incorporated into software testing products and services creates immense ethical and technological challenges for an IT industry that’s so far out in front of regulation, they don’t even seem to be playing the same sport.
It’s difficult to keep up with the shifting sands of AI in testing right now, as vendors search for a viable product to sell, and most testing clients I speak to these days haven’t begun incorporating an AI element to their test approach and frankly, the distorted signal coming from the testing business hasn’t helped. What I’m hearing from clients are big concerns around data privacy and security, transparency on models and good evidence, and the ethical issues of using AI in testing.
I’ve spent a good part of my public career in testing talking about risk, how to communicate it to leadership, and what good testing contributes to that process in helping identify threats to your business. So I’m not here to tell you “no” to AI in testing, but talk about how KPMG is trying to manage through the current mania and what we think are the big rocks we need to move to get there with care and at pace.
Continue readingI first got to know James in 2014 when the Context-Driven community was organising (including your truly) against the rent seeking of ISO 29119 test standard, and as co-chair of CAST for the Association for Software Testing, I invited him to give a talk on Standards – promoting quality or restricting competition?
His blog is a “must read” for any serious software tester, and his clear-eyed work on investigating the Post Office Horizon IT Scandal (including his submission) is the benchmark our community should be striving for when it comes to integrity, ethics, and professional standards.
Listen in as we discuss what went wrong at the Post Office, good evidence, the role of government in technology, the brewing collision between regulation and IT, and how after so long in this business you can keep your teeth sharp! Enjoy!
Links from discussion: What is Good Evidence – Griffin Jones EU fines Apple €500M and Meta €200M for breaking Europe’s digital rules DORA Act EU AI Act UK Murder Prediction US Autism Database
Just to be clear about something: if you are selling or advocating for some sort of AI in software testing tool, framework, agent, model, or defect-predict-O-nator and you are NOT focusing primarily on safety, security, or HARM – you are NOT doing your job.
The testing industry has practically abdicated its role in this regard, so it is up to individuals to be the vanguard and it is not panic, job insecurity, or resistance to change driving their valid concerns.
I am seeing some very senior people with lots of influence making IMO/E poor decisions on how to frame where we we are with AI in testing – what it is, what it isn’t, what it can do, and what it shouldn’t.
For even more clarity, if you are dismissing concerns about artificial intelligence in testing, quality engineering, or test automation as any of those things you are partially responsible for what happens when those tools are used to create software and systems that do harm.
Period.
Love seeing all these AI fanboys in software testing discovering for the first time that testing isn’t about technology – that’s the easy part!
“Wow – I just found out that testing is HUMAN centred activity and that inconvenient, squishy people part can’t be automated away…I’ll call it, TBH (Testing by Humans), or XTH (Experience Tested Humanity), or maybe…HUXTR (Human Uplifted Experience Testing Robot)!”
They sound like those techbro goofs who thought they discovered bus stops, but I guess that’s what happens when you use ChatGPT as a search engine – down the memory hole it goes!
The LLM market must be peaking as we seem to have hit a ceiling on what’s being sold in AI in testing…we live in hype – I mean hope!
Very happy to announce I’ll be participating in TestBash 2025 through their Leading with Quality day down in Brighton. Hope to see you there!
A one-day educational experience to help business lead with expanding quality engineering and testing practices.
The quality space is evolving. This presents difficult challenges, with it also comes immense opportunity. The world is changing. Technology is becoming more complex. We need to innovate our ways, by exploring together.
What’s more… Our identity as people who care about quality needs love. We are the believers. We understand that quality does not happen on its own. It’s not just about testing or bugs, it’s about the whole system.
We want to help you lead this change. Together, we can find a pathway forward.
To help us explore the challenges of quality engineering we have four good people leading the day.
Happy to announce I’ll be back at Agile Testing Days this year as a Team Coach!
There are lots on offer, and the first teams that register get a free 45-minute team coaching slot during the conference. So if you find yourself asking questions like:
…then come find me in Potsdam! Hope to see you there!
Continue reading