In a recent blog post, Rahul Verma suggests that all testing is confirmatory. First, I applaud his writing of an exploratory essay. I also welcome and appreciate critique of the testing vs. checking idea. I don’t agree with his conclusions, but maybe in the long run we can work something out. In mythology, there was a fellow called Procrustes, an ironmonger. He had a iron bed which he claimed fit … Read more
This is a followup to an earlier post, Questions from Listeners (2): Is Unit Testing Automated? The original question was Unit testing is automated. When functional, integration, and system test cannot be automated, how to handle regression testing without exploding the manual test with each iteration? Now I’ll deal with the second part of the question. Part One: What Do We Really Mean By “Automation”? Some people believe that “automation” … Read more
In response to my previous blog post “Another Silly Quantitative Model”, Greg writes: In my current project, the product owner has assumed the risk of any financial losses stemming from bugs in our software. He wants to release the product to customers, but he is of course nervous. How do you propose he should best go about deciding when to release? How should he reason about the risks, short of … Read more
On April 19, 2010, I was interviewed by Gil Broza. In preparation for that interview, we solicited questions from the listeners, and I promised to answer them either in the interview or in my blog. Here’s the second one. Unit testing is automated. When functional, integration, and system test cannot be automated, how to handle regression testing without exploding the manual test with each iteration? This question provides a great … Read more
Part of the joy of producing this blog is in seeing what happens when other people pick up the ideas and run with them. That happened when I posted a scenario on management mistakes a few weeks ago, and Markus Gärtner responded with far more energy and thought than I would have expected. Thanks, Markus. Last week I posted a transcript of a transpection session between me and James Bach. … Read more
In response to my post, Testers: Get Out of the Quality Assurance Business, my colleague Adam White writes, I want ask for your experience when you’ve your first 3 points for managers: Provide them with the information they need to make informed decisions, and then let them make the decisions. Remain fully aware that they’re making business decisions, not just technical ones. Know that the product doesn’t necessarily have to … Read more
Here’s Part 2 of my notes on the CodingQA podcast, in which Matthew Osborn and Federico Silva Armas chat with James Bach about the exploratory testing and session-based test management. Skills of Exploratory Testing If you want to develop a list of testing skills, you might find it helpful to start with the Exploratory Skills and Dynamics sheet, by James Bach, Jon Bach, and Michael Bolton. One of the core … Read more
I was interviewed on April 19, 2010 by Gil Broza, an expert Agile coach who is a colleague and friend here in Toronto. Gil’s request for an interview reminded me of an experience I had a few beforehand. I received an email from a couple of researchers in Sweden who are studying exploratory testing. I was honoured to be asked for my point of view on the subject. However, I … Read more
In the interview with the Coding QA guys that was the subject of my last post, James Bach refers exploratory testing as parallel learning test design, test execution and learning, and said that exploratory approaches are epitomized by loops. Where do loops happen in exploratory testing? In fact, exploratory testing includes both looping and branching. When we’re testing in an exploratory way, we may branch away from the current path … Read more
Several months back, James Bach did an interview with the CodingQA guys, Matthew Osborn and Federico Silva Armas. In the interview, James talks about the skills of exploratory testing, sex education (now do I have your attention?) and how to use session-based test management with minimal overhead and maximum credibility. I’m surprised at how few people have heard about the podcast, so I’m drawing attention to it here. It runs … Read more