DiscoverHeavybit PodcastsEp. #27, Rethinking AI Evals with Adam Hevenor
Ep. #27, Rethinking AI Evals with Adam Hevenor

Ep. #27, Rethinking AI Evals with Adam Hevenor

Update: 2025-12-11
Share

Description

On episode 27 of Open Source Ready, Brian Douglas and John McBride speak with Adam Hevenor, creator of Vibecheck. Together they explore the fundamentals of evals, how teams can run structured experiments across model variations, and why cost-efficient design matters more than ever. Adam also offers grounded perspectives on MCP adoption, Claude Skills, and the economics shaping today’s AI tooling ecosystem.

The post appeared first on Heavybit.

Comments 
In Channel
Ep. #27, Rethinking AI Evals with Adam Hevenor

Ep. #27, Rethinking AI Evals with Adam Hevenor

2025-12-1140:16

Ep. #49, Dumpster Phoenix with Denise Koessler Gosnell and Kathryn Erickson

Ep. #49, Dumpster Phoenix with Denise Koessler Gosnell and Kathryn Erickson

2025-12-1035:09

Ep. #4, Streaming Made Practical with Micah Wylde

Ep. #4, Streaming Made Practical with Micah Wylde

2025-12-0945:42

Ep. #48, Trusting AI with Sarah Novotny

Ep. #48, Trusting AI with Sarah Novotny

2025-11-2640:05

Ep. #3, Building Tools That Shape Data with Maxime Beauchemin

Ep. #3, Building Tools That Shape Data with Maxime Beauchemin

2025-11-2552:42

Ep. #2, Data Journalism Unleashed with Simon Willison

Ep. #2, Data Journalism Unleashed with Simon Willison

2025-11-2557:01

Ep. #26, The Economics of AI Coding with Quinn Slack

Ep. #26, The Economics of AI Coding with Quinn Slack

2025-11-2447:25

Ep. #1, Introducing Data Renegades

Ep. #1, Introducing Data Renegades

2025-11-2242:19

Ep. #25, Death of the Web Browser with Rachel-Lee Nabors

Ep. #25, Death of the Web Browser with Rachel-Lee Nabors

2025-11-1447:06

Ep. #47, The Tech Bros with Milette Gillow and Sedinam Simpson

Ep. #47, The Tech Bros with Milette Gillow and Sedinam Simpson

2025-11-1333:29

Ep. #24, Runtime for Agents with Ivan Burazin of Daytona

Ep. #24, Runtime for Agents with Ivan Burazin of Daytona

2025-10-3047:18

Ep. #46, Canned Monkeys with Don Marti

Ep. #46, Canned Monkeys with Don Marti

2025-10-3040:25

Ep. #86, 12 Years and 100 Million Customers with Amarilis Campos of Nubank

Ep. #86, 12 Years and 100 Million Customers with Amarilis Campos of Nubank

2025-10-2937:23

Ep. #45, Perspective Density with Allegra Guinan of Lumiera

Ep. #45, Perspective Density with Allegra Guinan of Lumiera

2025-10-1628:38

Ep. #23, Kubernetes, AI, and Community Engagement with Davanum Srinivas

Ep. #23, Kubernetes, AI, and Community Engagement with Davanum Srinivas

2025-10-0845:55

Ep. #15, Everything’s Recorded Whether You Know It or Not with Amrit Dhangal

Ep. #15, Everything’s Recorded Whether You Know It or Not with Amrit Dhangal

2025-10-0758:00

Ep. #22, AI and Container Security with Benji Kalman of Root

Ep. #22, AI and Container Security with Benji Kalman of Root

2025-09-2553:04

Ep. #44, Why Unikernels Are Cool with Felipe Huici of Unikraft

Ep. #44, Why Unikernels Are Cool with Felipe Huici of Unikraft

2025-09-2223:57

Ep. #14, Navigating Restaurant Tech’s Roadmaps with Anthony Presley

Ep. #14, Navigating Restaurant Tech’s Roadmaps with Anthony Presley

2025-09-2249:27

Ep. #21, Continuous AI with Chad Metcalf of Continue

Ep. #21, Continuous AI with Chad Metcalf of Continue

2025-09-1056:38

loading
Google Play
Download from Google Play
Castbox
Download from App Store
usUnited States
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Ep. #27, Rethinking AI Evals with Adam Hevenor

Ep. #27, Rethinking AI Evals with Adam Hevenor

Heavybit