![[Seedcamp Firsts] How to A/B Test Product Changes and Set up Good Data Science Practices](https://s3.castbox.fm/c0/24/e6/d6372d2e264489bd25b008bdefa3c0ad96_scaled_v1_400.jpg "[Seedcamp Firsts] How to A/B Test Product Changes and Set up Good Data Science Practices")
[Seedcamp Firsts] How to A/B Test Product Changes and Set up Good Data Science Practices
Update: 2024-03-07
Description
In a follow-up to their Seedcamp Firsts conversation on data, our Venture Partner Devin Hunt and Candice Ren, Founder of analytics agency 173Tech and a member of the Seedcamp Expert Collective, dive deep into A/B testing and good data science practices.
With new and exciting AI technology emerging around recommendation engines, how can product leads evaluate which solution is better and how to really measure a “better recommendation”?
Focusing on a specific case study - a furniture marketplace, Candice, who worked on A/B testing and recommendation engines for Bumble, Plend Loans, MUBI, Treatwell and many others, shares her thoughts on:
- the intricacies of setting up and analyzing an A/B test experiment focused on comparing two different recommendation algorithms
- how you set your hypothesis
- the best way to segment your user basis
- how to select what you are controlling for (e.g. click-through rate)
- how to interpret test results and consider broader business metrics impact.
Candice and Devin also emphasize the importance of granular testing, proper test design, and documentation of test results for informed decision-making within a company's testing framework.
With new and exciting AI technology emerging around recommendation engines, how can product leads evaluate which solution is better and how to really measure a “better recommendation”?
Focusing on a specific case study - a furniture marketplace, Candice, who worked on A/B testing and recommendation engines for Bumble, Plend Loans, MUBI, Treatwell and many others, shares her thoughts on:
- the intricacies of setting up and analyzing an A/B test experiment focused on comparing two different recommendation algorithms
- how you set your hypothesis
- the best way to segment your user basis
- how to select what you are controlling for (e.g. click-through rate)
- how to interpret test results and consider broader business metrics impact.
Candice and Devin also emphasize the importance of granular testing, proper test design, and documentation of test results for informed decision-making within a company's testing framework.
Comments
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
