DiscoverSOA Podcasts - Society of ActuariesEmerging Topics Community: Understanding LLMs - Tokenization
Emerging Topics Community: Understanding LLMs - Tokenization

Emerging Topics Community: Understanding LLMs - Tokenization

Update: 2024-09-06
Share

Description

Join Anders Larson and Shea Parkes as they delve into the technical aspects of large language models (LLMs); this episode focuses specifically on the process of tokenization. They discuss how understanding the workings of these models can aid in interpreting their outputs and integrating them into actuarial work. The conversation covers the evolution of natural language processing, the significance of tokens in LLMs for bridging text to numbers, and the stochastic process of generating new tokens.

Comments 
In Channel
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Emerging Topics Community: Understanding LLMs - Tokenization

Emerging Topics Community: Understanding LLMs - Tokenization