There’s a common belief that testing LLM-based apps is fundamentally different from testing traditional software — that because outputs are non-deterministic, the whole testing playbook needs to be thrown out. This is not entirely true, and believing it should not be an excuse to skip testing altogether. Yes, an LLM won’t return the exact same...

A few years ago I wrote about how a long pandemic shower helped me realize that software testing is really just collecting information. That clicked for me. But the more I’ve worked in QA since then, the more I’ve realized that definition only answers what testers do — not why it matters. Here’s where my...

Here’s the thing: a bug is just a piece of information telling you what’s wrong with an application. And if you think of it that way, then any tool you use to communicate with your team is technically a tool you can use to report bugs. Jira, Slack, Zoom, email, a tap on the shoulder...