Testers: Focus on Problems

A tester writes: “I’m testing an API. It accepts various settings and parameters. I don’t know how to get access to these settings from the API itself, so I’m stuck with modifying them from the front end. Moreover, some responses to specific requests are long and complicated, so given that, I have no idea how to test it! Online examples of API testing tend to focus on checking the response’s … Read more

Unlimited Charges

I noticed something interesting while reviewing my credit card bills a couple of evenings ago: monthly charges for $9.99 from “Amazon Downloads”, going back several months. I buy a lot of e-books. I looked for receipts from Amazon in email. I found a bunch, but none from Amazon for $9.99. I never delete email receipts; I put all of them into a separate folder so that I can collate them … Read more

Evaluating Test Cases, Checks, and Tools

For testers who are being asked to focus on test cases and testing tools, remember this: a test case never finds a bug. The tester finds a bug, and the test case may play a role in finding the bug. (Credit to Pradeep Soundararajan for putting this so succinctly, all those years ago.) Similarly, an automated check never finds a bug. The tester finds a bug, and the check may … Read more

What Lies Beneath

What Lies Beneath – AMA ft. Michael Bolton
In this AMA you can ask Michael anything about testing.

Michael Bolton is a consulting software tester and testing teacher who helps people to solve testing problems that they didn’t realize they could solve. He is the co-author (with James Bach) of Rapid Software Testing (RST), a methodology and mindset for testing software expertly and credibly in uncertain conditions and under extreme time pressure. He has taught RST to testers in 35 countries. Michael has been testing, developing, managing, and writing about software since 1988. For over 20 years, he has led DevelopSense, a Toronto-based testing and development consultancy. Prior to that, he was with Quarterdeck Corporation for eight years, during which he managed the company’s flagship products and directed project and testing teams both in-house and around the world. Contact Michael at, on Twitter @michaelbolton, or through his Web site,

This video is supported by Moolya Software Testing ( and Testvox (

Flaky Testing

The expression “flaky tests” is evidence of flaky testing. No scientist refers to “flaky experimental results”. Scientists who observe inconsistency don’t dismiss it. They pay close attention to it, and probe it. They redesign their experiments or put better controls on them. When someone refers to an automated check (or a suite of them) as a “flaky test”, the suggestion is that it represents an unreliable experiment. That assumption is … Read more

Necessary Confusion and the Bootstrap Heuristic

I’m testing a test tool at the moment. I’m investigating it for a talk. The producers of the tool claim to have hundreds of thousands of users. A few positive remarks appear in a scrolling widget on the product’s web site from people purported to be users. Me, I can’t make head or tail of the product. It doesn’t seem to do what it’s supposed to do. It looks like … Read more

First Aid for the Mission Statement

A while back, a tester brought a patient in for treatment. It wasn’t a human patient; it was a sentence about building and testing in an organization. The tester asked me for help. “Could you provide me with a first aid kit for this statement that came from my management?” “We have to move on to DevOps to be able to release code more often but we also have to … Read more

Bug of the Day: What Time Are the Class Sessions?

One problem that we face in software development and testing is that data and information aren’t the same. Here’s an example, prompted by email from a correspondent. There’s a Rapid Software Testing Explored class running January 11-14, 2021. It’s set to run at times that work for people in Europe and the UK, mostly. The service I use for managing registrations, Eventbrite, offers the opportunity to list the starting and … Read more

Bug of The Day: Bad Data Means Search for Book Title Fails

This is your periodic reminder that data has problems, just like code does. A correspondent on LinkedIn pointed me towards a book by George Lakoff, an author I admire. For some reason, I had not been aware of the book. So I looked it up. I wanted to go straight to it, so I put the title in quotes: Hmmm. That’s a little strange. Nothing? Let’s try without the quotes. … Read more

A Naïve Request from Management

A tester recently asked “If you’re asked to write a ‘test plan’ for a new feature before development starts, what type of thing do you produce?” I answered that I would produce a reply: “I’d be happy to do that. What would you like to see in this test plan?” The manager’s reply was, apparently, “test cases covering all edge cases we’ll need to test”. That’s a pretty naïve request. … Read more