DiscoverThinking Machines: AI & PhilosophyThe Future is Fine Tuned (with Dev Rishi, Predibase)
The Future is Fine Tuned (with Dev Rishi, Predibase)

The Future is Fine Tuned (with Dev Rishi, Predibase)

Update: 2024-05-24
Share

Description

Dev Rishi is the founder and CEO of Predibase, the company behind Ludwig and LoRAX. Predibase just released LoRA Land, a technical report showing 310 models that can outcompete GPT-4 on specific tasks through fine-tuning. In this episode, Dev tries (pretty successfully) to convince me that fine-tuning is the future, while answering a bunch of interesting questions, like:

  • Is fine-tuning hard?
  • If LoRAX is a competitive advantage for you, why open-source it?
  • Is model hosting becoming commoditized? If so, how can anyone compete?
  • What are people actually fine-tuning language models for?
  • How worried are you about OpenAI eating your lunch?

I had a ton of fun with Dev on this one. Also, check out Predibase’s newsletter called fine-tuned (great name!) and LoRA Land.

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

The Future is Fine Tuned (with Dev Rishi, Predibase)

The Future is Fine Tuned (with Dev Rishi, Predibase)

Daniel Reid Cahn