Nerd Alert: Where A/B Testing Goes Wrong
Update: 2024-09-12
Description
Welcome to Nerd Alert, a series of special episodes bridging the gap between marketing academia and practitioners. We’re breaking down highly involved, complex research into plain language and takeaways any marketer can use.
In this episode, Elena and Rob explore how sophisticated advertising algorithms can skew A/B test results, potentially leading marketers to draw misleading conclusions about ad performance.
Topics covered:
To learn more, visit marketingarchitects.com/podcast
Resources:
Braun, M., & Schwartz, E. M. (2024). Where A-B Testing Goes Wrong: How Divergent Delivery Affects What Online Experiments Cannot (and Can) Tell You About How Customers Respond to Advertising. Journal of Marketing.
Get more research-backed marketing strategies by subscribing to The Marketing Architects on Apple Podcasts, Spotify, or wherever you listen to podcasts.
In this episode, Elena and Rob explore how sophisticated advertising algorithms can skew A/B test results, potentially leading marketers to draw misleading conclusions about ad performance.
Topics covered:
- [00:45 ] "Where A-B Testing Goes Wrong”
- [02:00 ] Divergent delivery in online advertising platforms
- [03:00 ] How user types and targeting policies impact tests
- [04:10 ] Pizza party analogy explaining divergent delivery
- [05:40 ] Marketing Architects' approach to testing
- [06:50 ] Using synthetic audiences for more controlled testing
To learn more, visit marketingarchitects.com/podcast
Resources:
Braun, M., & Schwartz, E. M. (2024). Where A-B Testing Goes Wrong: How Divergent Delivery Affects What Online Experiments Cannot (and Can) Tell You About How Customers Respond to Advertising. Journal of Marketing.
Get more research-backed marketing strategies by subscribing to The Marketing Architects on Apple Podcasts, Spotify, or wherever you listen to podcasts.
Comments
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
