File size: 770 Bytes
6e661e3 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 | ---
license: mit
tags:
- nanochat
- training-dynamics
- checkpoints
---
# nanochat d24 training checkpoints (2026-08-29)
Full intermediate checkpoint trajectories for three nanochat d24 pretraining runs.
| folder | run | steps saved | `model_*.pt` |
|---|---|---|---|
| `d24/` | base | every 50 steps, up to 5568 | 112 |
| `d24_6shard_10ep/` | 6-shard, 10 epochs | every 26 steps, up to 2590 | 100 |
| `d24_13shard_10ep/` | 13-shard, 10 epochs | every 56 steps, up to 5600 | 100 |
Each folder contains:
- `model_XXXXXX.pt` — model weights at that step (~3.9 GB each)
- `optim_XXXXXX_rank{0..7}.pt` — optimizer state at the final step (resume training)
- `meta_XXXXXX.json` — per-checkpoint metadata
- `val_metrics.jsonl` — validation curve for the run
|