STARWEST 2024 - Test Strategy, Planning, Metrics
Wednesday, September 25
Building and Testing Serverless API Applications with AWS SAM
The primary draw for implementation of AWS serverless applications is the supposed simplicity. Anyone that has attempted to implement testing on a serverless application, however, knows that it is anything but simple. Serverless technologies allow for the faster construction of more complex applications with more complex integrations while also providing new technologies and execution environments, all of which pose a challenge to those used to testing in a more traditional way. This presentation looks at an API-based serverless application as an example and introduces how the application...
Testing Retrospective: Lessons from the Past
We prepare for the future by learning from the lessons of the past. During this session, you will look back at some of the craziest bugs John Jenkins has run across during his career, and see what lessons can be gleaned from them to help tackle the problems of tomorrow. Bugs come in all shapes and sizes, and can exist in processes just as easily as they can exist in code. In this session, both types will be examined, including: the too much free space bug, the V1 bug, the too much test data bug, and more. The session will also explore some of the best practices John has developed in his...
Thursday, September 26
Testing for Synergy: Progressive Testing Strategies for Interdependent Product Suites
In today's dynamic business landscape, organizations grapple with the challenge of innovating across multiple product developments simultaneously. This session explores the intricacies of concurrent development involving seven products, highlighting the pivotal roles of scrum teams, engineering approach, and collaborative testing strategies. Traditional independent product testing approaches prove insufficient in the context of interdependence and a unified platform. The discussion centers on the need for an evolved testing strategy that shifts left, meticulously addressing integration...
“Low Code”—Coded Automation Using Free Tools
Using artificial intelligence to generate test code is a hybrid automation strategy that combines the best of both worlds. Tests can be created very quickly by almost anyone using AI, yet the tests are still planned by humans and maintainable by humans. With the right prompts, you can have AI construct traditional test code using open source testing tools that the world is already familiar with (Chai, Mocha, Cypress). As a result, you end up with structured code that is logical and easy to maintain without having to wonder what the AI is testing. In this session, Timothy will look at...
The Quality Assurance of Artificial Intelligence: How to Test the Tests!
Many companies are asking the question: "What can AI do to improve our QA practices?" But is this the right question? David believes that as QA practitioners the real question is "How should we be preparing to efficiently test emerging and complex ML an AI systems?" AI testing is different from traditional testing because AI systems are not static, but dynamic and adaptive. They learn from data and feedback, and change their behavior accordingly. This means that AI testing must account for the variability and unpredictability of AI systems, and ensure that they are not only functional, but...
The Art of Winning Leadership Support for Web Accessibility
Feeling unheard in your fight for web accessibility? What if you could turn this struggle into a success story? Join this candid conversation on navigating the nuanced journey of integrating accessibility, even when convincing leadership seems like an uphill battle. Together, we'll reflect on Renata's initial stumbles, identify common pitfalls, and strategize to avoid them. Anticipate leadership concerns by understanding deeper motivations behind their resistance. Master the art of speaking their language and tailor your message to resonate with decision-makers. Empower your champions,...
Leveraging and Measuring the Use of Formal Testing Methods in Product Development
Without training in software testing that includes formal methods such as equivalence class partitioning, boundary value analysis, decision tables, state diagrams, and others, an engineer, in good faith, will test the code intuitively until reaching “qualitative confidence” that testing is sufficient. The team at Trimble, Inc. provided training to engineers in a wide variety of formal testing methods so they could gain “quantitative confidence” that code has been tested sufficiently, by using methods known to achieve concrete coverage in requirements and code. Subsequently, Trimble...