DiscoverDeep PapersThe Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs
The Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs

The Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs

Update: 2024-10-16
Share

Description

In this byte-sized podcast, Harrison Chu, Director of Engineering at Arize, breaks down the Shrek Sampler. 

This innovative Entropy-Based Sampling technique--nicknamed the 'Shrek Sampler--is transforming LLMs. Harrison talks about how this method improves upon traditional sampling strategies by leveraging entropy and varentropy to produce more dynamic and intelligent responses. Explore its potential to enhance open-source AI models and enable human-like reasoning in smaller language models. 

Learn more about AI observability and evaluation in our course, join the Arize AI Slack community or get the latest on LinkedIn and X.

Comments 
Top Podcasts
The Best New Comedy Podcast Right Now – June 2024The Best News Podcast Right Now – June 2024The Best New Business Podcast Right Now – June 2024The Best New Sports Podcast Right Now – June 2024The Best New True Crime Podcast Right Now – June 2024The Best New Joe Rogan Experience Podcast Right Now – June 20The Best New Dan Bongino Show Podcast Right Now – June 20The Best New Mark Levin Podcast – June 2024
In Channel
Merge, Ensemble, and Cooperate! A Survey on Collaborative LLM Strategies

Merge, Ensemble, and Cooperate! A Survey on Collaborative LLM Strategies

2024-12-1028:47

Agent-as-a-Judge: Evaluate Agents with Agents

Agent-as-a-Judge: Evaluate Agents with Agents

2024-11-2324:54

Introduction to OpenAI's Realtime API

Introduction to OpenAI's Realtime API

2024-11-1229:56

Swarm: OpenAI's Experimental Approach to Multi-Agent Systems

Swarm: OpenAI's Experimental Approach to Multi-Agent Systems

2024-10-2946:46

KV Cache Explained

KV Cache Explained

2024-10-2404:19

The Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs

The Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs

2024-10-1603:31

Google's NotebookLM and the Future of AI-Generated Audio

Google's NotebookLM and the Future of AI-Generated Audio

2024-10-1543:28

Exploring OpenAI's o1-preview and o1-mini

Exploring OpenAI's o1-preview and o1-mini

2024-09-2742:02

Breaking Down Reflection Tuning: Enhancing LLM Performance with Self-Learning

Breaking Down Reflection Tuning: Enhancing LLM Performance with Self-Learning

2024-09-1926:54

Composable Interventions for Language Models

Composable Interventions for Language Models

2024-09-1142:35

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges

2024-08-1639:05

Breaking Down Meta's Llama 3 Herd of Models

Breaking Down Meta's Llama 3 Herd of Models

2024-08-0644:40

DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines

DSPy Assertions: Computational Constraints for Self-Refining Language Model Pipelines

2024-07-2333:57

RAFT: Adapting Language Model to Domain Specific RAG

RAFT: Adapting Language Model to Domain Specific RAG

2024-06-2844:01

LLM Interpretability and Sparse Autoencoders: Research from OpenAI and Anthropic

LLM Interpretability and Sparse Autoencoders: Research from OpenAI and Anthropic

2024-06-1444:00

Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models' Alignment

Trustworthy LLMs: A Survey and Guideline for Evaluating Large Language Models' Alignment

2024-05-3048:07

Breaking Down EvalGen: Who Validates the Validators?

Breaking Down EvalGen: Who Validates the Validators?

2024-05-1344:47

Keys To Understanding ReAct: Synergizing Reasoning and Acting in Language Models

Keys To Understanding ReAct: Synergizing Reasoning and Acting in Language Models

2024-04-2645:07

Demystifying Chronos: Learning the Language of Time Series

Demystifying Chronos: Learning the Language of Time Series

2024-04-0444:40

Anthropic Claude 3

Anthropic Claude 3

2024-03-2543:01

loading
Google Play
Download from Google Play
Castbox
Download from App Store
usUnited States
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

The Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs

The Shrek Sampler: How Entropy-Based Sampling is Revolutionizing LLMs

Arize AI