gpt2-steering-denoiser / training_log.csv
KorolOrol's picture
Publish audited v2 denoiser checkpoint
0c50024 verified
Raw History Blame Contribute Delete
1.65 kB
step,train_loss,validation_reconstruction,validation_identity_baseline,mean_relative_norm,grad_norm,lr,minutes
500,1.425553560256958,1.4036635756492615,3.7162914127111435,0.5513623841106892,1.117541790008545,0.00029918064143792314,0.18
1000,1.217713713645935,1.27421959862113,3.7162914127111435,0.5513623841106892,1.039292812347412,0.0002900766990739982,0.35
1500,1.1535580158233643,1.1793685965240002,3.7162914127111435,0.5513623841106892,0.8821267485618591,0.0002715339687685131,0.53
2000,1.0992958545684814,1.110007043927908,3.7162914127111435,0.5513623841106892,0.7873677611351013,0.0002449517591097723,0.7
2500,1.0394974946975708,1.0597233921289444,3.7162914127111435,0.5513623841106892,0.6670681834220886,0.00021233606995102182,0.86
3000,1.0408940315246582,1.0219528060406446,3.7162914127111435,0.5513623841106892,0.6705328822135925,0.00017614821163876486,1.03
3500,1.0179837942123413,0.9935051333159208,3.7162914127111435,0.5513623841106892,0.6433517932891846,0.00013911906469029532,1.21
4000,1.0044758319854736,0.9724951721727848,3.7162914127111435,0.5513623841106892,0.4952111542224884,0.00010404299662802996,1.38
4500,0.9420108795166016,0.957408407703042,3.7162914127111435,0.5513623841106892,0.5394185185432434,7.356698783052497e-05,1.56
5000,0.931006133556366,0.9466902650892735,3.7162914127111435,0.5513623841106892,0.4025919735431671,4.9990879806825864e-05,1.73
5500,0.9798283576965332,0.9391558654606342,3.7162914127111435,0.5513623841106892,0.45799756050109863,3.509381995825119e-05,1.89
6000,0.9502205848693848,0.9339428953826427,3.7162914127111435,0.5513623841106892,0.3763216733932495,2.9999999999999997e-05,2.06