DiscoverThe MAD Podcast with Matt TurckMaking AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini
Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini

Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini

Update: 2024-07-25
Share

Description

In this episode, we reconnect with Sharon Zhou, co-founder and CEO of Lamini, to dive deep into the ever-evolving world of enterprise AI.




We discuss how the AI hype is evolving and what enterprises are doing to stay ahead, break down the different players in the Inference market, explore how Memory Tuning is reducing hallucinations in AI models, the role of agents in enterprise AI, and the challenges of making them real-time and reliable.




Lamini


Website - https://www.lamini.ai


Twitter - https://x.com/laminiai




Sharon Zhou


LinkedIn - https://www.linkedin.com/in/zhousharon


Twitter - https://x.com/realsharonzhou




FIRSTMARK


Website - https://firstmark.com


Twitter - https://twitter.com/FirstMarkCap




Matt Turck (Managing Director)


LinkedIn - https://www.linkedin.com/in/turck/


Twitter - https://twitter.com/mattturck




(00:00 ) Intro


(02:18 ) The state of the AI market in July, 2024


(10:51 ) What is Lamini?


(11:43 ) What is Inference?


(15:36 ) GPU shortage in the enterprise


(18:06 ) AMD vs Nvidia


(22:10 ) What is Lamini's final product?


(25:30 ) What is Memory Tuning?


(29:01 ) What is LoRA?


(32:39 ) More on Memory Tuning


(35:51 ) Sharon's perspective on AI agents


(40:01 ) What is next for Lamini?


(41:54 ) Reasoning vs pure compute in AI

Comments 
loading
In Channel
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini

Making AI Work: Fine-Tuning, Inference, Memory | Sharon Zhou, CEO, Lamini

Matt Turck