Program

6 sessions

Training

• Curriculum Schedules for Trillion-Token Pretraining

  September 15, 2026 09:00 · Aurora Hall

  How the order you feed data in changes what a trillion-token model ends up knowing.

• Gradient Noise as a Signal: Adaptive Batch Sizing

  September 15, 2026 11:00 · Cobalt Theatre

  Using the geometry of gradient noise to grow the batch size on the fly.

Inference

• Speculative Decoding Beyond Draft Models

  September 15, 2026 10:00 · Room 210

  Getting speculative-decoding speedups without training and hosting a separate draft model.

• KV-Cache Compression at Long Context

  September 15, 2026 14:00 · Room 200

  Keeping the KV cache small enough to serve 200k-token contexts affordably.

Agents

• Planning with Verifier-Guided Tree Search

  September 15, 2026 13:00 · Cobalt Theatre

  Combining a learned verifier with explicit search for reliable multi-step planning.

Safety

• Mechanistic Auditing of Deceptive Circuits

  September 15, 2026 15:00 · Room 200

  Interpretability tools for finding circuits that behave differently when a model thinks it is watched.