STARWEST 2024 - Testing for Developers
Wednesday, September 25
The Rise of the Virtual QA Engineer: Harnessing GenAI
In this talk, Dmitriy will delve into the transformative journey of integrating GenAI, into the core of his team's testing and development processes. This integration has not only enhanced their productivity by 15% but also yielded a 20% time saving and a significant cost reduction per test case. Want to know how? The session will explore his team's strategic implementation of GenAI, overcoming security challenges, leveraging diverse (LLMs), and the meticulous design of prompts that culminated in a prompt library. See how tailored extensions for the code editors and corporate chats...
Building and Testing Serverless API Applications with AWS SAM
The primary draw for implementation of AWS serverless applications is the supposed simplicity. Anyone that has attempted to implement testing on a serverless application, however, knows that it is anything but simple. Serverless technologies allow for the faster construction of more complex applications with more complex integrations while also providing new technologies and execution environments, all of which pose a challenge to those used to testing in a more traditional way. This presentation looks at an API-based serverless application as an example and introduces how the application...
Flowstate, Automation, and LLMs: Don’t Let Tests Block Productivity
It is known that developers are most productive when they can stay in flow, but also that delaying or omitting tests can cause disruption, breakage, and security issues down the line. By properly leveraging background automation, team collaboration, and machine learning in your native DevOps workflow, you can get the best of both worlds: productive flowstate AND safe code. In this talk, Jon Peck will take a look at ways to take advantage of asynchronous test notifications, single-pane-of-glass reviews, and GPT-based tools for faster coding, test generation, and vulnerability remediation....
Cautionary Tales in Integration Testing
Integration tests are often rife with pitfalls that can result in confusing, flaky, or otherwise completely unmaintainable tests. Those pitfalls can often be mitigated by testing in containers, as this usually provides the most straightforward path to creating ephemeral test environments. Containerized tests typically provide isolation and reproducibility, but they can be costly to initially set up, especially if the system under test is not built for a containerized environment. Nonetheless, there are many benefits to containerized testing, even if the system under test won’t ultimately...
Thursday, September 26
Breaking the Chain of Blame: True End-to-End Testing with Distributed Tracing
Debugging problems in a distributed system can be hard. Finding the root of the problem and assigning the work to a specific team after a user failure can be challenging and time-consuming. Often front-end and API tests are not enough. Imagine if you could see exactly what happened step-by-step during an end-to-end test, combining Cypress with distributed traces, to write test specs against every section of the distributed services as well. Now you can. Embed trace-based tests directly in Cypress to get insight into your distributed system, including both the front end and back end....
AI-Assisted Exploratory Testing for Healthcare Software Based on STEEEP Domain of Healthcare Quality
In this presentation, the primary objective is to introduce an innovative AI-assisted self-generating exploratory test automation model designed specifically for healthcare software applications. The overarching goal of this platform is to elevate the quality assurance process within the realm of healthcare software by dynamically formulating, executing, and adapting test scenarios. These scenarios are meticulously crafted to align with the crucial STEEEP (Safe, Timely, Effective, Efficient, Equitable, and Patient-Centered) healthcare quality domain, thereby fostering an improvement in...
Cloud Testing of Cybersecurity Features in Mobile Apps
In CI/CD pipelines, automated testing services validate functionality of apps across hundreds of real-world mobile devices and OS versions. However, these same automated testing services can use methods and tools that violate security policies such as: emulators, virtualization, resigning, debugging, dual spaces, Magisk and more. Once security protections are added to a mobile app, the security features will trigger and may prevent automated testing. In this session, Karen will discuss how you can eliminate the need to test protected and unprotected builds separately. You will also...
Compile to Combat in 24 Hours—The Death of Regression Tests
As a Quality Engineering Director for a consulting firm delivering innovative data products to the US Department of Defense, Sufyan was faced with a new challenge. The US Government had directed all agencies delivering software solutions to the Department of Defense to provide the ultimate advantage to its warfighters. All software solutions must meet the Compile to Combat (C2C24) directive in that all requests for changes to software being used by the military must be delivered in 24 hours from the point of development to delivery. As a Quality Engineering team, this meant long and...