STARWEST 2020 - Test Strategy, Planning, Metrics | TechWell

STARWEST Virtual+ 2020 - Test Strategy, Planning, Metrics

Monday, October 5


Artificial Intelligence and Machine Learning Skills for the Testing World

Monday, October 5, 2020 - 2:00pm to 5:30pm

Software continues to revolutionize the world, impacting nearly every aspect of our work, family, and personal life. Artificial intelligence (AI) and machine learning (ML) are playing key roles in this revolution through improvements in search results, recommendations, forecasts, and other predictions. AI and ML technologies are being used in platforms for digital assistants, home entertainment, medical diagnosis, customer support, and autonomous vehicles. Testing practitioners are recognizing the potential for advances in AI and ML to be leveraged for automated testing—an area that...


Better Test Design for Great Test Automation

Monday, October 5, 2020 - 2:00pm to 5:30pm

Test automation is an essential element in modern system development. And test design can make or break automation efforts throughout the entire CI/CD pipeline. We want automated tests to find problems in a build quickly, run without a hitch, and be easily maintained. However, if tests are badly structured and unnecessarily detailed, you may have a hard time automating them—even with great tools and great technical expertise. Hans Buwalda explores how testers, both technical and non-technical, can design or restructure tests to make them suitable for automation. In this session, you’ll...


Develop and Refine Your Company Testing Strategy

Monday, October 5, 2020 - 2:00pm to 5:30pm

Every quality director wants to implement a modern, forward-looking testing strategy, and many test managers look to other companies to figure out the "magic bullet" for achieving excellent quality quickly and reliably. But the truth is that everything you need to know about your best test strategy is already in your company. In this workshop you will use your quality priorities, strategies, and code base as the foundation for defining and improving your testing strategy. You’ll work individually and in small groups to examine your current testing structure and methodologies, perform risk...

Tuesday, October 6


X-Ray Vision For Testers: How to Analyze Things

Tuesday, October 6, 2020 - 10:00am to 5:30pm

How do we go about understanding something complex? How do we move from confusion to clarity? What strategies and approaches can we use to identify and reason about things that matter? When we’re dropped into a testing situation, how do we make sense of it all? How can we rapidly achieve a deeper understanding of things that we know little or nothing about? How can we develop skills to make us more powerful testers? The answer to these questions is analysis - the study of things and ideas by examining their elements and structure. In this one-day tutorial, Michael Bolton will lead...


Introduction to Selenium

Tuesday, October 6, 2020 - 10:00am to 5:30pm

Knowledge of Selenium, the industry-standard tool for testing web applications, is a much sought after skill in today’s world of test automation. If you want to learn Selenium, then this full-day tutorial provides a great start. Byron Katz shows you how to build test automation using Selenium. But he doesn’t stop there. He uses his years of experience to show you how to build automation that is clean, robust, and easy to maintain. You will be introduced to practices and principles that apply to the whole team. You will write Selenium scripts in two languages, Python and Java, and will...

AmiBug.Com, Inc.

Test Estimation in the Face of Uncertainty

Tuesday, October 6, 2020 - 10:00am to 1:30pm

Anyone who has ever attempted to estimate software testing effort realizes just how difficult the task can be. The number of factors that can affect the estimate is virtually unlimited. The keys to good estimates are understanding the primary variables, comparing them to known standards, and normalizing the estimates based on their differences. This is easy to say but difficult to accomplish because estimates are frequently required even when we know very little about the project—and what we do know is constantly changing. Throw in a healthy dose of politics and a bit of wishful...

Upland InGenius

Automation Framework Essentials

Tuesday, October 6, 2020 - 10:00am to 1:30pm

Automation is critical in today’s software delivery lifecycle, and yet many organizations struggle to keep their automation running. How can we mitigate difficulties and get consistent automation runs and results we can trust? The secret is implementing a solid automation framework, but that isn’t as easy as it seems. Chris Loder has built several automation frameworks over his career and has learned what works—and, more importantly, what doesn’t. This tutorial will cover what an automation framework is, the benefits of having one, and the keys to a successful framework, including...

Ultimate Software

Holistic Performance Testing for Modern Applications

Tuesday, October 6, 2020 - 2:00pm to 5:30pm

With the advent of frameworks like Angular, React, and Vue, the landscape of application performance has changed significantly in terms of testing and measurement. Gone are the days of measuring response time as a single value based on back-end performance. In modern web and mobile applications, additional layers need to be peeled apart at the front end to truly understand its performance characteristics. Traditional approaches to performance testing are no longer sufficient to provide a delightfully responsive user experience. Join Kaushal Dalvi as he details new developments in...


Quality and Testing Measures and Metrics

Tuesday, October 6, 2020 - 2:00pm to 5:30pm

To be most effective, leaders—including development and testing managers, ScrumMasters, product owners, and IT managers—need metrics to help direct their efforts and make informed recommendations about the software’s release readiness and associated risks. Because one important evaluation activity is to “measure” the quality of the software, the progress and results of both development and testing must be measured. Collecting, analyzing, and using metrics are complicated because developers and testers often are concerned that the metrics will be used against them. Join Mike Sowers...

Melissa Benua

Continuous Testing Using Containers

Tuesday, October 6, 2020 - 2:00pm to 5:30pm

Containers. Every manager thinks they want them, but few teams have experience in knowing what to DO with them. Used thoughtfully, containerization of your services can transform the way your organization thinks about testing. Gone can be the days of maintaining X different compute environments with Y different configurations. Imagine instead spinning up just the code you need, on the machine type it needs, and only for as long as you need it. In this technical training, Melissa will walk through what containerization means for a legacy code base attempting to practice continuous...

Thursday, October 8

Airline Tariff Publishing Company

Test 360 with BDD at V-Speeds

Thursday, October 8, 2020 - 2:15pm to 3:15pm

In Aviation, V-Speeds are the speeds derived from data obtained from designers and manufacturers during flight testing. Using them is considered the best practice to maximize aviation safety and performance. Can this same model be applied to Software testing? How about aviation software testing? We, at Airline Tariff Publishing Company applied the same principles of V-Speeds to obtain data about the application in a 360 viewpoint (i.e. from the designers, subject matter experts and product owners) to maximize our test script development efficiency within the BDD framework. This talk...


Data Science Testing

Thursday, October 8, 2020 - 2:15pm to 3:15pm

The presentation will cover from the very basics of data science to my journey into the data science world and how do we actually seek for quality in our product when testing a data rich project. My aim would be to cover the following areas; What is data science? What is testing data science models? How can we achieve a smooth process? Exploratory testing with data science. What have I achieved? What can you achieve/learn? Who would make a good data science tester? and the importance of documentation. Once you understand the how data science it performing to interpret vital and...


Leveraging Cloud Architecture (AWS Focused) to Build a Robust Test Automation Platform

Thursday, October 8, 2020 - 2:15pm to 3:15pm

A huge opportunity exists for testing practitioners to leverage the power of the cloud for testing environments and testing tools. I recently designed a serverless cloud based test automation platform for a F500 company that allowed them to retire a legacy testing lab that was costing them $250k per year to maintain. The new platform was not only about 1/10th the cost, but also provides unlimited scalability on-demand as their needs grow. I will start the presentation with an overview of some relevant cloud native services and expand on the architecture of a few of those services and then...

Dusko Vuksanovic
TheZenith Insurance

Tolerance Metrics in Test Automation

Thursday, October 8, 2020 - 3:45pm to 4:45pm

Web applications are not built perfectly. Even though we see our tests passing, it doesn't necessary mean that application is performing well. There are secondary indicators of the application stability, which if not properly observed, can lead to development nightmares. To be more precise, this presentation is about how to cover discovered issues which manifest as slow responses, flaky page loading, browser console error logs, etc. The challenge is how to observe these issues, and properly report on them. How to make sure the business understands what's going on, and can prioritize any...

Sargis Sargsyan

Building in House Scalable Mobile Lab for Automation

Thursday, October 8, 2020 - 3:45pm to 4:45pm

It is becoming more and more challenging to test mobile apps on different devices, with different screen sizes, running different operating systems. During the development of a mobile app, we can easily verify and test the app on a mobile simulator or emulator. However, only simulator or emulator testing isn't enough, we need to make sure that our app works on devices that our users carry with them in their pocket. Creating a in house Automation Mobile Lab will be a good decision if you're looking to do automated testing, for example with Selenium and Appium. An automation Mobile Device...

Pawel Piwosz
EPAM Systems

Test Your Infrastructure!

Thursday, October 8, 2020 - 3:45pm to 4:45pm

We are testing everything. We are so devoted to test that we even invented "DevTestOps". And then... Yes... What about our Infrastructure as a Code templates? How many times did you run your template again and again, fix issues, run again, fix issues... This is very common, we all have to admit it. Even if we use the CI/CD tools for our infrastructure (how many of us is really doing it? We are still missing the testing phase. But no worries! Let me show you how CloudFormation templates can be tested; how to be sure that code committed to the repository will be properly prepared and ready...