Topic
Deepseek V4
5 episodes
-
Welcome Beam: a 501B open model you can own, customize, and scale
Reflection's Beam lands as a 501B open-weight model—Apache 2.0, 1M context, MoE powered—built for coding and agents. Cathy digs into real deployment cost and open-weight reality, Jessica sees the product fit and release polish. The tension: is this truly usable at the scale it claims, or does the open-label overstate how many teams can actually deploy it? Real disagreement, lots of detail, a brisk ZOOM OUT to where Beam fits against DeepSeek and Meta's Muse, and a sharp call on whether this model actually sees adoption.
-
Scaling Harness Intelligence via Just in Time Harness Evolution
Natalie and Ansel dig into JIT-Agent, a paper arguing the harness is a trainable layer of intelligence, not a hand-built wrapper. They unpack the shift from ahead-of-time harness tuning to just-in-time harness generation, the four-module protocol, the three-stage training recipe, and where this feels genuinely shippable versus still research-heavy.
-
Overview: Active vs Total Parameters
We finally slow down on active vs total parameters, because we keep throwing the phrase around like it explains itself. This is us making the difference click: what a model stores versus what it actually uses when it answers.
-
FlashMemory DeepSeek V4: Lightning Index Ultra Long Context via Lookahead Sparse Attention
Researchers propose Lookahead Sparse Attention (LSA) with a Neural Memory Indexer to slash GPU memory usage for ultra-long LLM context by pre-predicting which KV cache chunks matter, trained independently without the full backbone. FlashMemory-DeepSeek-V4 cuts physical KV cache to 13.5% of baseline on average while maintaining or improving accuracy (+0.6% abs) across LongBench-v2, LongMemEval, RULER—at 500K tokens, it suppresses KV overhead by over 90%. Project paused due to org changes; code not yet public.
-
Rethinking Continual Experience Internalization for Self Evolving LLM Agents
Jingwen Chen et al. diagnose why iterative experience internalization fails in LLMs and prescribe a three-part fix—principle-level granularity, step-wise injection, off-policy context-distillation—that turns capability collapse into compounding improvement.