STARWEST 2024 - Software Tester

Many organizations invest a lot of effort in test automation at the system level but then have serious problems as their product matures and changes over time. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing added value? Chris Loder will explain the critical issues you need to know to get a good start, and he will share his extensive experience in building great automation. He covers the most important management issues you should address for test automation success,...

The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...

Imagine: as soon as any developed functionality is submitted into the code repository, it is automatically subjected to the appropriate battery of tests and then released straight into the wild. Setting up the pipeline to do just that has become commonplace, but most organizations hit the same stumbling block: just what IS the appropriate battery of tests? Automated build pipelines don't always lend themselves well to the traditional stages of testing. In this hands-on tutorial, Melissa will introduce testers to the key principles of test case and test suite design that apply to...

In many teams, the total number of possible combinations of inputs, outputs, browsers, and devices for the software we need to test has grown to an alarming number. As testers, we need to choose the most important tests first, but how do we do that without understanding the potential scope in the first place? In this tutorial, Julie Gardiner will share two powerful testing techniques that can help us be more efficient and effective with our testing. Classification trees are a structured, visual approach to identifying test objects and documenting test ideas and data in a way that allows...

Companies of all sizes face difficulties in achieving higher quality standards within their organization. As quality engineering includes various roles and activities, it is also challenging to find the right people to analyze the current state from a wide perspective and provide the recommendations that will allow these organizations to mature their teams, improving their DevOps culture in the process. Join Péter Földházi as he illustrates the knowledge and skills necessary to become your company's quality consultant. Péter's goal is to involve engineers from beginner to advanced levels...

Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security,...

To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Mike Sowers as he...

Agile teams are burdened with the challenge of delivering working product increments after short iterations of development. Getting software from an ambiguous terse, incomplete requirement–to a done, working, solid, valuable, high-quality code requires testers to continuously adapt to change in a turbulent context and deliver actionable results. Chris Blain will illustrate how charter-driven session-based exploratory testing techniques can empower agile teams and help them learn quickly and adapt based on what really matters. Testers can design and execute tests on the fly as they explore...

The advent of Generative AI (GenAI), including Large Language Models (LLMs) and tools like ChatGPT, is not just another technological shift—it's a paradigm change, particularly in the realm of software testing. Unlike the transitions to mobile or cloud computing, GenAI introduces both unparalleled utility and disruption in software quality assurance. This session is dedicated to demystifying GenAI in software testing, distinguishing hype from reality, and providing practical tools and techniques to enhance your team's software quality while also highlighting potential pitfalls and...

There is no question that Generative AI models can improve the productivity of almost every role within the software development process. However, while a lot of attention has focused on generating software using tools such as GitHub Copilot, Amazon CodeWhisperer, Tabnine, and more, these tools can assist software testers in their job too. Join Coveros CEO Jeffery Payne to explore how Generative AI solutions help software testers generate and supplement tests, create automated test scripts, and even suggest improvements to what you’ve already created. Learn how AI can increase test...

Avoiding siloed development is a tricky business. It’s so easy for agile teams to fall into the rut of testers only doing traditional testing activities and programmers strictly doing their time-worn coding activities. But there are actually many places testers can be influential and contribute value on cross-functional teams. Robert Sabourin will share several examples of how testing skills can be applied to a wide variety of activities in an agile project. For instance, testers are among the most skilled team members in story grooming, elicitation, and exploration. Risk analysis in self-...

Jun-young Kwak (Sr. Director, Engineering), and Priyanka Halder (Sr. Leadership, QA & Release) will delve into the fascinating journey of Tinder’s quality engineering over the past decade, highlighting the dynamic evolution and innovative strategies that have underpinned the platform’s success in connecting millions worldwide. The talk traces the early days of experimentation with various quality assurance models, both in-house and outsourced, reflecting on the lessons learned and the pivotal decisions that shaped the future of quality at Tinder. A significant milestone in this journey...

The primary draw for implementation of AWS serverless applications is the supposed simplicity. Anyone that has attempted to implement testing on a serverless application, however, knows that it is anything but simple. Serverless technologies allow for the faster construction of more complex applications with more complex integrations while also providing new technologies and execution environments, all of which pose a challenge to those used to testing in a more traditional way. This presentation looks at an API-based serverless application as an example and introduces how the application...

We prepare for the future by learning from the lessons of the past. During this session, you will look back at some of the craziest bugs John Jenkins has run across during his career, and see what lessons can be gleaned from them to help tackle the problems of tomorrow. Bugs come in all shapes and sizes, and can exist in processes just as easily as they can exist in code. In this session, both types will be examined, including: the too much free space bug, the V1 bug, the too much test data bug, and more. The session will also explore some of the best practices John has developed in his...

This session explores the innovative ways to approach and revolutionize the art software testing by harnessing the full power of Google Cloud AI Platform. Utilizing AI-powered regression testing and natural language processing (NLP) capabilities, developers can automate mundane and repetitive tests while also analyzing software functionality and usability. Predictive analytics and custom machine learning models can be used to anticipate and identify potential issues, improve testing efficiency, and provide actionable insights. Applying reinforcement learning algorithms for GUI testing,...

Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.

In today's dynamic business landscape, organizations grapple with the challenge of innovating across multiple product developments simultaneously. This session explores the intricacies of concurrent development involving seven products, highlighting the pivotal roles of scrum teams, engineering approach, and collaborative testing strategies. Traditional independent product testing approaches prove insufficient in the context of interdependence and a unified platform. The discussion centers on the need for an evolved testing strategy that shifts left, meticulously addressing integration...

Using artificial intelligence to generate test code is a hybrid automation strategy that combines the best of both worlds. Tests can be created very quickly by almost anyone using AI, yet the tests are still planned by humans and maintainable by humans. With the right prompts, you can have AI construct traditional test code using open source testing tools that the world is already familiar with (Chai, Mocha, Cypress). As a result, you end up with structured code that is logical and easy to maintain without having to wonder what the AI is testing. In this session, Timothy will look at...

It has been a commonly held belief that an ever growing list of manual test cases, kept and maintained by the QA team is the best way to provide training, metrics and a roadmap for future automation efforts. But what if this base assumption is wrong? What if instead of having just a number of passing or failing test cases, we could better speak to factors like risk and quality before our products go live and have a little extra time to be creative with our testing? Rebecca Peterson wants to teach you the steps she and her coworkers have made to move towards living documentation that can...

The barrier to entry for AI, specifically Large Language Models (LLM), is low and we can take advantage of them in our own tools, projects, and apps. In this session, we’ll build a simple app that uses an LLM which will help us cover: The steps to using AI in a program. LLM Basics. Pick the right LLM. Data Preparation. Evals and Testing. Insights and issues to consider. Tips that you can use as you build your own. Join us for a hands-on session that will help you build your first LLM app or level up your current project!

In CI/CD pipelines, automated testing services validate functionality of apps across hundreds of real-world mobile devices and OS versions. However, these same automated testing services can use methods and tools that violate security policies such as: emulators, virtualization, resigning, debugging, dual spaces, Magisk and more. Once security protections are added to a mobile app, the security features will trigger and may prevent automated testing. In this session, Karen will discuss how you can eliminate the need to test protected and unprotected builds separately. You will also...

Feeling unheard in your fight for web accessibility? What if you could turn this struggle into a success story? Join this candid conversation on navigating the nuanced journey of integrating accessibility, even when convincing leadership seems like an uphill battle. Together, we'll reflect on Renata's initial stumbles, identify common pitfalls, and strategize to avoid them. Anticipate leadership concerns by understanding deeper motivations behind their resistance. Master the art of speaking their language and tailor your message to resonate with decision-makers. Empower your champions,...