DiscoverBest AI papers explainedContext Language Models
Context Language Models

Context Language Models

Update: 2026-10-10
Share

Description

This paper introduce Context Language Models (CLMs), a novel approach that enables language models to natively manage their own context by treating it as an editable file rather than relying on traditional append-only histories or external harnesses. By granting models unrestricted read and write access to their context, CLMs achieve superior performance and greater efficiency across long-horizon coding, deep research, and open discovery tasks. The literature demonstrates that these models can be further enhanced through in-context learning, natural-language steering, and online reinforcement learning with success-gated efficiency rewards. To address the computational challenges of frequent context edits, the authors propose Suffix Cache Reuse (SCR), an advanced serving optimization that reuses cached states for surviving suffix tokens to significantly reduce server-side compute. Ultimately, this paradigm shift from external harness control to intrinsic model behavior unlocks more adaptive, creative, and resource-efficient context-management strategies.

Comments 
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Context Language Models

Context Language Models

Enoch H. Kang