STARWEST 2024 - Product Development

GOOD NEWS! To build a high quality customer-centric AI app, you need to bring your old-timey software testing practices into the AI era. But what does that mean? Well, it turns out building AI apps is pretty much like building ANY other app…with a FEW added extras. We need to bring customer focus to EVERY step of our building and testing process. Things like, how do we choose the data we’ll use to train our AI product? Which humans are in the loop? How to fine-tune and ground our models in REAL data? And, of course, how to leverage our usual software quality bread-and-butter (red-teaming,...