Training Progress and Loss Update | Generated by AI

Home 2026.07

Update: 39,923 → 50,332

Progress:

Loss finally dropping:

LR: 0.67 – cosine decay is doing its job. The model is entering the phase where smaller LR steps let it settle into better minima. The gradient noise is the same, but the update direction is more consistent now.

Perf: ~1.25-1.37s/step, ~49-53K tok/s – stable

Vibe check: Looking good. The loss floor dropped right as predicted (LR passing ~0.7-0.8 range). Still ~12.7h to go, and the LR will hit ~0 by the end – the best gains often come in the last 30% of cosine schedule.


Back Donate