Research Digest: What the Chinchilla Paper Still Gets Right About Scaling Laws
A 2022 paper on the ratio of parameters to training data reshaped how models are built. Most of its conclusions have held up.
Research Digest
Plain-language summaries of AI research that matters — what was found, why it is significant, and what it might lead to. Not every paper. The ones worth your time.
What a Longer Context Window Actually Buys You
Context windows have grown enormously. The ability to use everything in them has not grown at the same rate, and the gap matters.
Why Models Make Things Up, and What Genuinely Reduces It
Confident invention is a consequence of what these systems are trained to do. It can be reduced substantially and it cannot be eliminated by prompting.