STARWEST 2024 - Test Automation Engineer

Many organizations invest a lot of effort in test automation at the system level but then have serious problems as their product matures and changes over time. As a leader, how can you ensure that your new automation efforts will get off to a good start? What can you do to ensure that your automation work provides continuing added value? Chris Loder will explain the critical issues you need to know to get a good start, and he will share his extensive experience in building great automation. He covers the most important management issues you should address for test automation success,...

The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...

Although there are several controversies and misunderstandings surrounding AI and machine learning, one thing is apparent — people have quality concerns about the safety, reliability, and trustworthiness of these types of systems. Not only are ML-based systems shrouded in mystery due to their largely black-box nature, they also tend to be unpredictable since they can adapt and learn new things at runtime. Validating ML systems is challenging and requires a cross-section of knowledge, skills, and experience from areas such as mathematics, data science, software engineering, cyber-security,...

Web applications are often security critical or serve as front-ends for security critical applications, making web testing for vulnerabilities an essential part of software testing. Unfortunately, most software testers have not been taught how to identify web security issues while testing applications. Join Tom Stiehm as he shares what you need to know to security test web-based applications as part of your overall testing process. Learn about the most common web security vulnerabilities and how they are introduced into web code and exploited by hackers. Explore test techniques for...

The advent of Generative AI (GenAI), including Large Language Models (LLMs) and tools like ChatGPT, is not just another technological shift—it's a paradigm change, particularly in the realm of software testing. Unlike the transitions to mobile or cloud computing, GenAI introduces both unparalleled utility and disruption in software quality assurance. This session is dedicated to demystifying GenAI in software testing, distinguishing hype from reality, and providing practical tools and techniques to enhance your team's software quality while also highlighting potential pitfalls and...

With the sudden rise of ChatGPT and large language models (LLMs), professionals have been attempting to use these types of tools to improve productivity. Building off prior momentum in AI for testing, software quality professionals are leveraging LLMs for creating tests, generating test scripts, automatically analyzing test results, and more. However, if LLM's are not fed good prompts describing the task that the AI is supposed to perform, their responses can be inaccurate and unreliable, thereby diminishing productivity gains. Join Tariq King as he teaches you how to craft high-quality AI...

In the realm of software development, the challenge of maintaining high-quality standards while meeting tight deadlines is ever-present. GenAI enabling developers to produce code and potentially even more defects in shorter time clearly calls for more rapid test automation development. One of the most complex and time consuming activities is designing and building an effective test automation framework. Péter will provide some theoretical background, then the attendees will implement a UI test automation framework in Java. One of the key aspects covered in this tutorial is proper...

Jun-young Kwak (Sr. Director, Engineering), and Priyanka Halder (Sr. Leadership, QA & Release) will delve into the fascinating journey of Tinder’s quality engineering over the past decade, highlighting the dynamic evolution and innovative strategies that have underpinned the platform’s success in connecting millions worldwide. The talk traces the early days of experimentation with various quality assurance models, both in-house and outsourced, reflecting on the lessons learned and the pivotal decisions that shaped the future of quality at Tinder. A significant milestone in this journey...

The primary draw for implementation of AWS serverless applications is the supposed simplicity. Anyone that has attempted to implement testing on a serverless application, however, knows that it is anything but simple. Serverless technologies allow for the faster construction of more complex applications with more complex integrations while also providing new technologies and execution environments, all of which pose a challenge to those used to testing in a more traditional way. This presentation looks at an API-based serverless application as an example and introduces how the application...

What do you think about when you hear the words "test automation"? Are you considering developing your own tools to help you probe the product deeply, or will you apply a commercial tool for automated checking? Are you excited by new, powerful, enabling technologies, or do you worry that a robot will replace you? One thing is for sure: when we apply tools, we fundamentally change the context and the nature of the work we do.Our panelists are software testing experts who will discuss all this and more with you! Together, we'll probe what people mean by automation, the power that tools can...

We prepare for the future by learning from the lessons of the past. During this session, you will look back at some of the craziest bugs John Jenkins has run across during his career, and see what lessons can be gleaned from them to help tackle the problems of tomorrow. Bugs come in all shapes and sizes, and can exist in processes just as easily as they can exist in code. In this session, both types will be examined, including: the too much free space bug, the V1 bug, the too much test data bug, and more. The session will also explore some of the best practices John has developed in his...

UI testing tools offer a robust solution for web application assessment, yet face a bottleneck when scaling up to handle extensive UI test suites that require hours to complete. In this talk, Sargis will address this challenge by guiding you through the creation and deployment of a Dockerized Selenium grid, enhanced with autoscaling and video recording features. Capable of efficiently executing several thousand tests in a limited period, this advanced setup optimizes speed and reliability for UI tests. This deep dive will cover the strategic implementation of a high-performance Selenium...

In today's data-driven landscape, real-time data processing is the backbone of modern applications. Kafka, a distributed event streaming platform, has emerged as a critical component in building data-intensive systems. This presentation provides an in-depth exploration of Kafka and the essential practice of Kafka testing, offering attendees valuable insights into harnessing the power of real-time data streams while ensuring robust system reliability. Key topics to be covered are: an introduction to Kafka to understand Kafka's architecture and core components, importance of Kafka Testing,...

Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.

Several years ago, Dave was a seasoned QA Engineer starting a new job. As the new guy, he was initially tasked with the mind-numbing task of verifying that data in reports matched expected data in a spreadsheet. This task took three weeks to complete manually. He vowed he would never do that again, so the next time around, Dave automated the process in two weeks using an open source automation tool he had never used before, all while laying the foundation for an automation framework that now has over 90 contributors across 12 product lines. Session attendees will learn how to build,...

Everyone involved in the SDLC knows quality is important. Absolutely. After all, who wants to push out (let alone use) software that doesn't work well? But, does your organization really embrace QA in all its glory? Do they see QA as more than ‘just’ testing? Do you see QA as more than ‘just’ testing? If your answer is 'No' to any of these questions, then this talk is for you. Yes, we test and log defects, but we also have to be diplomatic champions of quality assurance. We have to work to make sure our organizations see QA as a proactive function that spans the Software Development Life...

The barrier to entry for AI, specifically Large Language Models (LLM), is low and we can take advantage of them in our own tools, projects, and apps. In this session, we’ll build a simple app that uses an LLM which will help us cover: The steps to using AI in a program. LLM Basics. Pick the right LLM. Data Preparation. Evals and Testing. Insights and issues to consider. Tips that you can use as you build your own. Join us for a hands-on session that will help you build your first LLM app or level up your current project!

In CI/CD pipelines, automated testing services validate functionality of apps across hundreds of real-world mobile devices and OS versions. However, these same automated testing services can use methods and tools that violate security policies such as: emulators, virtualization, resigning, debugging, dual spaces, Magisk and more. Once security protections are added to a mobile app, the security features will trigger and may prevent automated testing. In this session, Karen will discuss how you can eliminate the need to test protected and unprotected builds separately. You will also...

Feeling unheard in your fight for web accessibility? What if you could turn this struggle into a success story? Join this candid conversation on navigating the nuanced journey of integrating accessibility, even when convincing leadership seems like an uphill battle. Together, we'll reflect on Renata's initial stumbles, identify common pitfalls, and strategize to avoid them. Anticipate leadership concerns by understanding deeper motivations behind their resistance. Master the art of speaking their language and tailor your message to resonate with decision-makers. Empower your champions,...

As a Quality Engineering Director for a consulting firm delivering innovative data products to the US Department of Defense, Sufyan was faced with a new challenge. The US Government had directed all agencies delivering software solutions to the Department of Defense to provide the ultimate advantage to its warfighters. All software solutions must meet the Compile to Combat (C2C24) directive in that all requests for changes to software being used by the military must be delivered in 24 hours from the point of development to delivery. As a Quality Engineering team, this meant long and...