Program
2 sessions
Training
-
Curriculum Schedules for Trillion-Token Pretraining
September 15, 2026 09:00 · Aurora Hall
How the order you feed data in changes what a trillion-token model ends up knowing.
-
Gradient Noise as a Signal: Adaptive Batch Sizing
September 15, 2026 11:00 · Cobalt Theatre
Using the geometry of gradient noise to grow the batch size on the fly.