Gradient Summit 2026

A fictional ML research conference: two days, four tracks, twelve sessions.

Curriculum Schedules for Trillion-Token Pretraining

September 15, 2026 09:00 · Aurora Hall

How the order you feed data in changes what a trillion-token model ends up knowing.
Speculative Decoding Beyond Draft Models

September 15, 2026 10:00 · Room 210

Getting speculative-decoding speedups without training and hosting a separate draft model.
Gradient Noise as a Signal: Adaptive Batch Sizing

September 15, 2026 11:00 · Cobalt Theatre

Using the geometry of gradient noise to grow the batch size on the fly.
Planning with Verifier-Guided Tree Search

September 15, 2026 13:00 · Cobalt Theatre

Combining a learned verifier with explicit search for reliable multi-step planning.
KV-Cache Compression at Long Context

September 15, 2026 14:00 · Room 200

Keeping the KV cache small enough to serve 200k-token contexts affordably.
Mechanistic Auditing of Deceptive Circuits

September 15, 2026 15:00 · Room 200

Interpretability tools for finding circuits that behave differently when a model thinks it is watched.

The program