My 2nd modded-nanogpt world record attempt: 30.67 seconds?
My second record attempt on modded-nanogpt: four overheads removed from the current record's training step (#393), with no change to the model, data or step count.