Testing in Production

Talia Nassi (~talia)




How do you know your feature is working perfectly in production? If something breaks in production, how will you know? Will you wait for a user to report it to you? What do you do when your staging test results do not reflect current production behavior? In order to test proactively as opposed to reactively, try testing in production! You will have an increased accuracy of test results, your tests will run faster due to the elimination of bad data, and you will have higher confidence before releases. This can be accomplished through feature flagging, canary releases, setting up a proper CI/CD pipeline, and data cleanup. You will leave this talk with strategies to mitigate risk, to better your understanding of the steps to get there, and to shift your company’s testing culture, so you can provide the best possible experience to your users. At the end of the day, we don't care if your features work in staging, we care if they work in production.

Talk outline: First 5 Min - Why staging is not idea, my personal experiences with staging. Next 10 Min - Why test in production, Step by step how to test in production, tool installation. Next 5 min - Talk about test data in production. Next 5 min - Alternatives to testing in prod. Next 5 min - shifting your company's testing culture

Slides: https://docs.google.com/presentation/d/1BWFdj8b3LlSVgqxE4Gec_jxMPFkwSqDM59eXB6unc3g/edit?usp=sharing

Thanks! Talia



Video URL:


Content URLs:

https://www.youtube.com/watch?v=adPQCuotAr4 https://www.split.io/blog/feature-flags-test-in-production/

Speaker Info:

Talia Nassi is an international keynote speaker who delivers content on all things testing and quality. She is a developer advocate at Split.io where she works closely with engineering teams globally to ship software more efficiently. She is passionate about feature flagging, canary launches, CI/CD, testing in production, and A/B testing. She has spoken at countless conferences internationally, ranging from audiences of 100 to 2000!

Speaker Links:

https://www.youtube.com/watch?v=adPQCuotAr4 https://www.split.io/blog/feature-flags-test-in-production/ https://www.youtube.com/watch?v=Y_D9t98dGh4 https://www.youtube.com/watch?v=jeXa2kvI1Qk https://www.youtube.com/watch?v=h33H82602Ek

Section: Culture and society
Type: Talks
Target Audience: Intermediate
Last Updated: