STARWEST 2026 - Test Strategy

Every test is a claim. Would your test suite hold up in court or be laughed out of the room for lack of evidence? When we talk about oracles in software, a green test run may not indicate whether something works as designed, where consistency with other products may set the standard of evidence for the current system. Multiple things can be true in AI-powered products too, so how do you determine what should be? In this law-themed talk by a former attorney turned tester, explore what you once knew to be true and how to gain more confidence in your product when there are many arguments for...