DiscoverHigh SignalEpisode 4: How to Build an Experimentation Machine and Where Most Go Wrong
Episode 4: How to Build an Experimentation Machine and Where Most Go Wrong

Episode 4: How to Build an Experimentation Machine and Where Most Go Wrong

Update: 2024-11-07
Share

Description

Ramesh Johari (Stanford, Uber, Airbnb, and more) explores the art and science of online experimentation, especially in the context of marketplaces and tech companies.



Ramesh shares insights on how organizations evolve from basic experimentation practices to becoming fast, adaptive, and self learning organizations. We dive into challenges like the risk aversion trap, the importance of learning from negative results, and how generative AI is reshaping the experimentation landscape.



We also talk about common failure modes and the types of things you're probably doing wrong, along with strategies to avoid these pitfalls. Plus, we discussed the role of incentives, the necessity of data driven decision making, and what it means to experiment in high stakes environments.

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Episode 4: How to Build an Experimentation Machine and Where Most Go Wrong

Episode 4: How to Build an Experimentation Machine and Where Most Go Wrong

Delphina