Recursive LM - model solves context rot
Update: 2026-01-19
Description
This episode explores Recursive Language Models (RLMs), a groundbreaking inference strategy that enables large language models to process prompts two orders of magnitude beyond their standard context windows. We discuss how RLMs treat long inputs as part of an external environment, using a Python REPL to programmatically decompose data and recursively call the model over specific snippets. Learn how this approach effectively overcomes "context rot" to significantly outperform base models and existing scaffolds on complex, information-dense tasks.
Comments
In Channel
Download from Google Play
Download from App Store
United States00:00
00:00
x
