DiscoverTech on the RocksOptimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner
Optimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner

Optimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner

Update: 2025-01-03
Share

Description

In this episode, we chat with Ben, founder of Espresso AI, about his journey from building Excel Python integrations to optimizing data warehouse compute costs. 

We explore his experience at companies like Uber and Google, where he worked on everything from distributed systems to ML and storage infrastructure. 

We learn about the evolution of his latest venture, which started as a C++ compiler optimization project and transformed into a system for optimizing Snowflake workloads using ML. 

Ben shares insights about applying LLMs to SQL optimization, the challenges of verified code transformation, and the importance of formal verification in ML systems. Finally, we discuss his practical approach to choosing ML models and the critical lesson he learned about talking to users before building products.

Chapters

00:00 Ben's Journey: From Startups to Big Tech
13:00 The Importance of Timing in Entrepreneurship
19:22 Consulting Insights: Learning from Clients
23:32 Transitioning to Big Tech: Experiences at Uber and Google
30:58 The Future of AI: End-to-End Systems and Data Utilization
35:53 Transitioning Between Domains: From ML to Distributed Systems
44:24 Espresso's Mission: Optimizing SQL with ML
51:26 The Future of Code Optimization and AI

Click here to view the episode transcript.

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Optimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner

Optimizing SQL with LLMs: Building Verified AI Systems at Espresso AI with Ben Lerner

Kostas, Nitay