STARWEST 2024 Tutorial: Test Smarter, Not Harder: How to Design Test Suites for Continuous Delivery


Monday, September 23, 2024 - 8:30am to 12:00pm

Test Smarter, Not Harder: How to Design Test Suites for Continuous Delivery

Imagine: as soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into the wild. Setting up the pipeline to do just that has become commonplace, but most organizations hit the same stumbling block: just what IS the appropriate battery of tests? Automated build pipelines don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa will introduce testers to the key principles of test case and test suite design that apply to organizations big and small to allow them to take full advantage of the pipeline's capabilities without introducing unnecessary bottlenecks. Testers will learn how to make highly reliable tests that run fast and preserve just enough information to let the team determine exactly what went wrong and how to reproduce the error locally. They will also explore how to reduce overlap while still maintaining adequate test coverage, about what test areas might be most beneficial to combine into a single suite, and what areas might benefit most from being completely broken out.

Melissa Benua

Melissa Benua has worked in nearly every software development role—dev, test, DevOps, and program management—at companies big and small and somewhere in-between. She's created and run high availability, high-quality services for PlayFab, Bing, Cortana, and Xbox One, and now for mParticle's enormous data platform. Melissa discovered her love of massively-scaled systems while growing the Bing backend, where she honed the art of keeping highly-available complex systems up while undergoing significant code churn. Now an engineering director with mParticle, she’s passionate not only about maximizing efficiency both in her product code and in her developer tools but also about sharing best practices among colleagues and the tech world at large.