DiscoverThe Data Exchange with Ben LoricaUnlocking the Power of LLMs with Data Prep Kit
Unlocking the Power of LLMs with Data Prep Kit

Unlocking the Power of LLMs with Data Prep Kit

Update: 2024-09-12
Share

Description

Petros Zerfos and Hima Patel of IBM Research are part of the team behind Data Prep Kit, an open-source toolkit that helps process and prepare raw text and code data at scale for use in large language model applications.

Subscribe to the Gradient Flow Newsletterhttps://gradientflow.substack.com/

Subscribe: AppleSpotify OvercastPocket CastsAntennaPodPodcast AddictAmazon •  RSS.

Detailed show notes - with links to many references - can be found on The Data Exchange web site.

Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Unlocking the Power of LLMs with Data Prep Kit

Unlocking the Power of LLMs with Data Prep Kit

Ben Lorica