“We’re happy to acknowledge when we make errors, and we’ve made a few in this case for sure, but also that we are willing to address those. And we’ve taken immediate action in all of these cases,” he said. “And we certainly apologize for any effect or adverse effect that this has had on trust in the community, because we want people to be confident in what we’re doing.” David … Read more
Over the last couple of days, a LinkedIn conversation has reminded me to write about the Productivity Paradox, which appears in Taking Testing Seriously: The Rapid Software Testing Approach, by James Bach and me. (I haven’t written a blog post about the delivery and release of the book. I was on tour when it came out, and then a bunch of online classes, the holidays, some sad occasions in the … Read more
When my daughter was two years old, and when she saw something unusual, she would say, “Dis is weird!”, mispronouncing the word as “weeood”, as little kids are prone to do. Cute as a button. Unrelated to that, the other day I was thinking about what might happen if we had a body of text that we wanted to modify — say, in an article, or a requirements document, or … Read more
How might we use a GPT in testing? Some have suggested that we could use GPTs to generate test data. Randomized test data can help to reduce patterns of certain biases in our testing. We might assume that getting a bot to produce random data based on a straightforward prompt would be easy. So here’s a little one-off, first-hurdle experiment I performed July 24, 2025 using Google’s Gemini 2.5. Here, … Read more
Last week, while preparing material for some upcoming Rapid Software Testing (RST) classes focused on testing AI, I was re-reading Stephen Wolfram’s article What Is ChatGPT Doing… and Why Does It Work? If you want to understand what’s going on it with any form of generative AI that extrudes text, it’s a superb summary. In the article, there’s a section that explains how machine learning works, using a classic example: … Read more
In our forthcoming book, Taking Testing Seriously: The Rapid Software Testing Approach, James Bach and I have included a chapter on AI. AI is fraught with risk, but writing about it is too. All through its history (since the 1950s, NOT just since 2022 or 2012), “AI” has not been an engineering term, but a marketing term, without clear notions of what “artificial intellience” really means. And all along, the … Read more
The saga continues. As of this writing, OpenAI has noted the problem with David Mayer, putting it down to “a technical glitch“. As of this writing (around 2:00pm, Eastern Time, 2024-12-03), exactly the same issue persists with the name “Brian Hood”. (Here’s a link: https://chatgpt.com/share/674f5626-feb0-8009-8d82-c773b83416ae) But maybe there’s a hint as to why. A little more persuasion provides this: (and here’s a link: https://chatgpt.com/share/674f6095-f04c-8009-bdf3-daa747fec30c) ChatGPT’s guardrails are made of silly … Read more
Since June 2023, James Bach and I have been collecting a set of “syndromes” associated with certain forms of AI — chatbots based on Large Language Models (LLMs) and Generative Pre-trained Transformers (GPTs). The most prominent of these, at this writing is OpenAI’s ChatGPT. Today we added a new syndrome: Voldemort Syndrome. Today LinkedIn (and much of the rest of the internet) lit up over the “The Man Who Shall … Read more
Today I visited Facebook to post a notice of my upcoming trip to New Zealand. There will be three stops on the tour: Auckland (for Testers and Automation, Avoiding the Traps, February 17-19), Wellington (Testers and Automation, Avoiding the Traps, February 24-26), and Christchurch (Rapid Software Testing Explored, March 10-12). Facebook’s AI Layer (I’ll just call that FAIL) offered to turn it into an event. I accepted the offer, and … Read more
At the Pacific Northwest Software Quality Conference in October 2024, I gave a keynote presentation titled “What Are We Thinking in the Age of AI?“ There’s a lot to think about, and for testers, there’s a lot to do. For one, we need to understand the basis for the “AI” claim. Any kind of software can be marketed as “AI”, since it’s doing something that (presumably) a human could do, … Read more