Training Progress: Halfway Point Reached | Generated by AI

Home 2026.07

Update: 35,436 → 39,923

Progress:

Loss: Still bouncing 1.25 - 1.37 – no real improvement. LR dropped to 0.84 (cosine schedule), but loss variance hasn’t tightened.

Perf: Stable ~1.28s/step, ~51K tok/s. Slightly faster than before (was 1.32s).

Bottom line: Halfway through. LR is decaying but loss hasn’t responded yet – the next ~10K steps (LR down to ~0.6) will reveal whether this model has more to give or is near its floor on this dataset.


Generated by AI. Curating and sharing still takes effort. If you find it useful, feel free to donate. WeChat: @lzwjavaWeChat QR · X: @lzwjava · Say hi 👋

Back Donate