STARWEST 2024 - Testing in DevOps
Sunday, September 22
DevOps for AI and Machine Learning
ISTQB Certified Tester—Test Automation Engineer
Agile & DevOps Leadership—ICAgile Certification
Fundamentals of Agile Test Automation
Monday, September 23
Ramping Up Modern Performance
Modern software is developed in a continuous manner, with several backend services frequently being deployed and scaled in the cloud. Furthermore, as organizations move toward agile, DevOps, and continuous delivery, it is vital for them to move away from traditional approaches to evaluate performance. Are you interested in ramping up or polishing your skills on performance testing? Leandro Melendez will introduce attendees to modern, agile, and continuous performance testing. You’ll learn performance assurance principles and everything from fundamental performance concepts like correlation...
Instill a DevOps Testing Culture in Your Team and Organization
The DevOps movement is here. Companies across many industries are breaking down siloed IT departments and federating them into product development teams. Testing and its practices are at the heart of these changes. Traditionally, IT organizations have been staffed with mostly manual testers and a limited number of automation and performance engineers. To keep pace with development in the new “you build it, you own it” environment, testing teams and individuals must develop new technical skills and even embrace coding to stay relevant and add greater value to the business. DevOps really...
Full-Stack Testing for Microservices Architectures
Software development is trending toward building systems using small, autonomous, independently deployable microservices. Leveraging microservices makes it easier to release software early, more frequently, and even continuously, which aligns well with Agile and DevOps. But how does the microservices architectural pattern affect software testing and testability? How can you ensure microservice-based applications have an adequate level of test coverage at each level? Does this paradigm change the test automation pyramid, and if so what does that look like? Join Tariq King as he walks...
Tuesday, September 24
Supercharge Your Workflow: To GitHub and Beyond
Whether you are new or experienced with GitHub this class is for you! Supercharging your workflow caters to anyone who wants to enhance their Agile and DevOps process with the capabilities of GitHub. GitHub has long been the premier site for open-source projects and is now turning a pivotal corner into becoming the predominant platform for all aspects of the development lifecycle. Some examples of this include; protecting company code through various GitHub Products or curating marketplace actions and workflows prior to use. This tutorial will look at how to leverage GitHub Actions (CI/CD...
Getting Smart on AI-Assisted API Testing
API testing has become more and more popular as service-oriented architectures have become common. In addition, testing at the API level can be effectively automated to provide maintainable regression tests that work well in a DevOps process. In this tutorial, Jeffery Payne discusses what API testing is all about and how AI is being leveraged today to make it easier to perform. Techniques and tools are discussed that highlight where in the testing process API testing makes the most sense. Various open-source and commercial tools will be demonstrated and the pros and cons of various...
Wednesday, September 25
Engineering Love Stories: Behind the Scenes of Tinder's Quality Practices
Jun-young Kwak (Sr. Director, Engineering), and Priyanka Halder (Sr. Leadership, QA & Release) will delve into the fascinating journey of Tinder’s quality engineering over the past decade, highlighting the dynamic evolution and innovative strategies that have underpinned the platform’s success in connecting millions worldwide. The talk traces the early days of experimentation with various quality assurance models, both in-house and outsourced, reflecting on the lessons learned and the pivotal decisions that shaped the future of quality at Tinder. A significant milestone in this journey...
The Rise of the Virtual QA Engineer: Harnessing GenAI
In this talk, Dmitriy will delve into the transformative journey of integrating GenAI, into the core of his team's testing and development processes. This integration has not only enhanced their productivity by 15% but also yielded a 20% time saving and a significant cost reduction per test case. Want to know how? The session will explore his team's strategic implementation of GenAI, overcoming security challenges, leveraging diverse (LLMs), and the meticulous design of prompts that culminated in a prompt library. See how tailored extensions for the code editors and corporate chats...
Flowstate, Automation, and LLMs: Don’t Let Tests Block Productivity
It is known that developers are most productive when they can stay in flow, but also that delaying or omitting tests can cause disruption, breakage, and security issues down the line. By properly leveraging background automation, team collaboration, and machine learning in your native DevOps workflow, you can get the best of both worlds: productive flowstate AND safe code. In this talk, Jon Peck will take a look at ways to take advantage of asynchronous test notifications, single-pane-of-glass reviews, and GPT-based tools for faster coding, test generation, and vulnerability remediation....
Enabling a DevOps Culture with Embedded Systems
In today's technology-driven landscape, where software and hardware intertwine seamlessly in embedded systems, adopting a DevOps culture becomes imperative. This talk delves into the dynamic world of embedded systems and explores how organizations can successfully implement and nurture a DevOps culture within this unique domain. DevOps, with its emphasis on collaboration, automation, and continuous improvement, has revolutionized software development. However, adapting these principles to the realm of embedded systems presents distinct challenges and opportunities. Our discussion will...
Efficiency Matters: Mastering Dockerized, Scalable Grid for Selenium and Playwright Test Suites
UI testing tools offer a robust solution for web application assessment, yet face a bottleneck when scaling up to handle extensive UI test suites that require hours to complete. In this talk, Sargis will address this challenge by guiding you through the creation and deployment of a Dockerized Selenium grid, enhanced with autoscaling and video recording features. Capable of efficiently executing several thousand tests in a limited period, this advanced setup optimizes speed and reliability for UI tests. This deep dive will cover the strategic implementation of a high-performance Selenium...
Quality Is More Than Testing—How to Build a Test Team with a Customer-Centric Mindset
Testers are not part of the process; they don’t have sufficient knowledge of the client’s business to understand the big picture. This failure to understand leads to unsatisfactory outcomes that leave the client with unanswered questions. For a client to feel testing is of value, the software must work seamlessly and exceed their expectations. The solution is to shift testing left towards discovery and include testers early in the process so they have a stake in end-to-end results. Testers must understand the subject matter, ask questions, and be a valued part of the core team. Testing is...
AI in Testing: A Moderated Panel Discussion
Artificial intelligence is the newest trend in software testing. But what is it, and how will it impact the tester's role, both today and in the future? What do you need to do to embrace this emerging technology? Tariq King will moderate this panel discussion to give you an opportunity to hear the opinions of industry leaders about AI in testing. You will have a chance to drive the debate, so come prepared with all your AI questions.
Thursday, September 26
Traffic-Driven Testing—A Primer on Kubernetes Performance Engineering
Migrating your apps to Kubernetes and breaking up monoliths pose a unique set of testing challenges. Container-based testing gives us enormous flexibility and scalability and your testing strategy should take that into account. Waiting for a full environment and simply migrating your test scripts is risky and doesn't take advantage of Kubernetes container management features. Making sure your migrated app can handle normal load as well as spikes requires careful planning. You may also want to compare different clouds. In this talk, Matthew will go through some proven strategies for using...
End-to-End Automation for Performance Testing and Engineering
Join Vinod Kashid as he walks through his experience building end-to-end automation for performance testing and engineering. His team was tasked to do daily performance testing activities for a critical application and business executives were expecting detailed application performance outcomes on a daily basis. Manual performance test execution and analysis were time consuming processes and were delaying the overall run time for final report. Business stakeholders wanted to implement zero touch automation from performance test execution to analysis and reporting (including deep-dive...
The Quality Assurance of Artificial Intelligence: How to Test the Tests!
Many companies are asking the question: "What can AI do to improve our QA practices?" But is this the right question? David believes that as QA practitioners the real question is "How should we be preparing to efficiently test emerging and complex ML an AI systems?" AI testing is different from traditional testing because AI systems are not static, but dynamic and adaptive. They learn from data and feedback, and change their behavior accordingly. This means that AI testing must account for the variability and unpredictability of AI systems, and ensure that they are not only functional, but...
Compile to Combat in 24 Hours—The Death of Regression Tests
As a Quality Engineering Director for a consulting firm delivering innovative data products to the US Department of Defense, Sufyan was faced with a new challenge. The US Government had directed all agencies delivering software solutions to the Department of Defense to provide the ultimate advantage to its warfighters. All software solutions must meet the Compile to Combat (C2C24) directive in that all requests for changes to software being used by the military must be delivered in 24 hours from the point of development to delivery. As a Quality Engineering team, this meant long and...
Not All Who Wander Are Lost—Exploratory Testing in Agile/DevOps
As we modernize and automate our tests in DevOps, or even adopt AI, we need to consider what we might be missing. In this presentation, Aaron will discuss the history of exploratory testing, how it gained popularity with agile and DevOps practices, and why we still need it as we move forward with AI-driven testing. We will briefly look at what a healthy test pyramid involves and discuss why we would want to use planned exploratory testing as part of the healthy pyramid. We will cover how exploratory testing is different than ad hoc testing, how to plan it, time box it, and use a charter....