Context Windows are Stupid

LINKS: Free Skool Community: https://www.skool.com/prompt-to-prod Work with me: https://consulting.jayminwest.com/ My Github: https://github.com/jayminwest Free Agentic Engineering Book: https://jayminwest.com/agentic-engineering-book Sapling: https://github.com/jayminwest/sapling Recursive Language Models Paper: https://arxiv.org/html/2512.24601v1 Diagram from this video: https://app.eraser.io/workspace/Ijvoqy5I8SaZxZNriLrN?origin=share --- The way we're handling context windows in LLM applications is naive and lossy. In this video, I talk about techniques used by the biggest LLM products and how I think they could be improved. --- 00:00 Why Context Management Matters 00:35 The Real Cost of Context Bloat 01:05 The Naive Chat Thread Pattern 02:17 Claude Code Conversation Compaction 03:52 Sapling Active Context Pruning 04:51 Inside Sapling Pipeline 07:44 Delegation and Focus Agents 10:33 Recursive Language Models Paper 12:46 What Changes Next for Agents 13:19 Wrap Up and Links #agenticai #codegeneration #programming #claudecode #aicoding #llms #openai #geminiai #claudeai #agentswarms #gastown