Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.4
)
Resume training from cifar100_save/endpoints/WideResNet28x10-4/sgd/checkpoint-0.pt
total epochs: 200
33072024.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4375    46.6720     1.6499    43.3000   154.2936
31987075.0 / 36489290
   2     0.1000     0.9042    67.8080     1.1795    63.1300   150.9637
31201036.0 / 36489290
   3     0.1000     0.6831    76.1380     0.7821    74.7100   151.2310
30561903.0 / 36489290
   4     0.1000     0.5570    80.6740     1.0750    69.4900   150.1113
30014325.0 / 36489290
   5     0.1000     0.4738    83.6260     0.8650    73.5000   150.7842
29530888.0 / 36489290
   6     0.1000     0.4184    85.5860     0.5316    81.5100   150.5589
29092652.0 / 36489290
   7     0.1000     0.3701    87.2780     0.5765    81.9200   150.9063
28692707.0 / 36489290
   8     0.1000     0.3383    88.3020     0.5646    81.6900   151.0711
28322862.0 / 36489290
   9     0.1000     0.3032    89.5420     0.4976    84.6900   150.9681
27975449.0 / 36489290
  10     0.1000     0.2759    90.4360     0.5745    82.5500   151.5297
27649935.0 / 36489290
  11     0.1000     0.2508    91.3420     0.4373    86.4400   150.9664
27340915.0 / 36489290
  12     0.1000     0.2301    91.8980     0.4578    85.9000   150.4570
27049212.0 / 36489290
  13     0.1000     0.2155    92.5100     0.6220    82.7800   150.8702
26771424.0 / 36489290
  14     0.1000     0.1975    93.1200     0.4399    86.9500   150.1961
26503743.0 / 36489290
  15     0.1000     0.1770    93.7800     0.4552    86.9700   150.2918
26249673.0 / 36489290
  16     0.1000     0.1692    93.9700     0.6177    83.1200   150.1172
26003415.0 / 36489290
  17     0.1000     0.1518    94.6720     0.3296    89.6800   150.8378
25766805.0 / 36489290
  18     0.1000     0.1465    94.8820     0.4615    87.3500   150.4336
25540331.0 / 36489290
  19     0.1000     0.1288    95.4620     0.4241    87.5900   150.1585
25320641.0 / 36489290
  20     0.1000     0.1235    95.6240     0.6129    83.5200   150.8789
25105997.0 / 36489290
  21     0.1000     0.1140    96.0480     0.3960    89.0700   149.8102
24899266.0 / 36489290
  22     0.1000     0.1033    96.3820     0.3673    89.7400   150.3527
24697965.0 / 36489290
  23     0.1000     0.0969    96.5220     0.4655    88.0000   150.8570
24503393.0 / 36489290
  24     0.1000     0.0888    96.8920     0.5669    86.1700   149.9064
24314426.0 / 36489290
  25     0.1000     0.0850    97.0360     0.3274    91.2100   149.6499
24129052.0 / 36489290
  26     0.1000     0.0771    97.3140     0.3133    91.1100   150.3958
23949150.0 / 36489290
  27     0.1000     0.0734    97.3880     0.4227    89.5900   150.6124
23774143.0 / 36489290
  28     0.1000     0.0689    97.5480     0.6102    85.3600   150.6719
23603960.0 / 36489290
  29     0.1000     0.0651    97.7200     0.3696    90.8400   149.4677
23436405.0 / 36489290
  30     0.1000     0.0608    97.8300     0.3848    90.8700   150.4834
23274897.0 / 36489290
  31     0.1000     0.0615    97.8120     0.6090    85.7600   149.2309
23113502.0 / 36489290
  32     0.1000     0.0511    98.2240     0.4889    89.1100   149.6109
22959364.0 / 36489290
  33     0.1000     0.0522    98.1640     0.3333    91.3800   149.4980
22805962.0 / 36489290
  34     0.1000     0.0464    98.3860     0.4131    90.2700   150.3642
22654193.0 / 36489290
  35     0.1000     0.0410    98.6500     0.3970    90.9100   151.3096
22507093.0 / 36489290
  36     0.1000     0.0422    98.5640     0.3836    90.9900   150.2265
22364103.0 / 36489290
  37     0.1000     0.0412    98.5860     0.3872    91.0600   150.8466
22223465.0 / 36489290
  38     0.1000     0.0359    98.7620     0.3484    92.0300   150.6703
22084404.0 / 36489290
  39     0.1000     0.0379    98.7100     0.3838    91.2500   149.0747
21947136.0 / 36489290
  40     0.1000     0.0304    99.0120     0.3723    91.7600   150.9254
21814283.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0353    98.7800     0.3541    92.0800   150.6716
21681576.0 / 36489290
  42     0.1000     0.0289    99.0200     0.4595    90.1300   150.5209
21554575.0 / 36489290
  43     0.1000     0.0354    98.8160     0.3996    91.2200   150.7309
21426372.0 / 36489290
  44     0.1000     0.0261    99.1060     0.4304    90.7400   150.9080
21300301.0 / 36489290
  45     0.1000     0.0242    99.1900     0.3983    91.5600   150.5678
21177628.0 / 36489290
  46     0.1000     0.0243    99.1420     0.3776    91.9200   149.7988
21052802.0 / 36489290
  47     0.1000     0.0198    99.3400     0.4573    90.8500   151.2366
20932790.0 / 36489290
  48     0.1000     0.0234    99.1920     0.4114    91.3900   150.6610
20816787.0 / 36489290
  49     0.1000     0.0271    99.0620     0.4254    91.1800   150.7685
20699480.0 / 36489290
  50     0.1000     0.0200    99.3140     0.3593    92.0900   150.2425
20584906.0 / 36489290
  51     0.1000     0.0200    99.2860     0.4176    91.7900   150.7437
20472827.0 / 36489290
  52     0.1000     0.0219    99.2760     0.3954    91.7800   150.7552
20363692.0 / 36489290
  53     0.1000     0.0219    99.2460     0.3926    91.8100   150.7457
20252556.0 / 36489290
  54     0.1000     0.0175    99.3880     0.3902    92.3300   150.7679
20145846.0 / 36489290
  55     0.1000     0.0192    99.3680     0.4549    91.1900   150.9364
20038468.0 / 36489290
  56     0.1000     0.0188    99.3800     0.4125    91.9400   149.7491
19930280.0 / 36489290
  57     0.1000     0.0102    99.6960     0.3283    93.1900   150.4041
19823441.0 / 36489290
  58     0.1000     0.0128    99.6100     0.3582    92.7200   150.0432
19723067.0 / 36489290
  59     0.1000     0.0176    99.3880     0.3555    92.6800   149.6999
19623198.0 / 36489290
  60     0.1000     0.0194    99.3560     0.3565    92.2200   150.3213
19522532.0 / 36489290
  61     0.1000     0.0161    99.4240     0.4287    91.7300   150.7676
19425207.0 / 36489290
  62     0.1000     0.0158    99.4740     0.5708    90.0500   150.3873
19328725.0 / 36489290
  63     0.1000     0.0163    99.4040     0.5473    90.2700   150.4113
19234230.0 / 36489290
  64     0.1000     0.0154    99.5160     0.3701    92.2900   150.8602
19135860.0 / 36489290
  65     0.1000     0.0103    99.7040     0.3637    92.8200   150.6342
19043290.0 / 36489290
  66     0.1000     0.0139    99.5280     0.3697    92.8300   150.5853
18950923.0 / 36489290
  67     0.1000     0.0141    99.5500     0.3652    92.7000   150.5632
18856731.0 / 36489290
  68     0.1000     0.0094    99.7040     0.3750    92.9300   150.6758
18766950.0 / 36489290
  69     0.1000     0.0115    99.6420     0.3619    93.0100   151.0116
18677154.0 / 36489290
  70     0.1000     0.0114    99.6280     0.4137    91.9800   151.1434
18590751.0 / 36489290
  71     0.1000     0.0142    99.5240     0.6056    89.6900   150.9120
18505678.0 / 36489290
  72     0.1000     0.0159    99.4800     0.3859    92.4700   150.1152
18417808.0 / 36489290
  73     0.1000     0.0110    99.6360     0.3917    92.5100   149.8341
18329690.0 / 36489290
  74     0.1000     0.0099    99.6960     0.3965    92.2900   149.0750
18243281.0 / 36489290
  75     0.1000     0.0085    99.7340     0.4326    92.4200   150.6379
18158428.0 / 36489290
  76     0.1000     0.0092    99.6880     0.4674    91.2500   150.6396
18077508.0 / 36489290
  77     0.1000     0.0112    99.6240     0.4277    92.2800   150.4389
17996468.0 / 36489290
  78     0.1000     0.0121    99.5960     0.3909    92.3300   151.2216
17912986.0 / 36489290
  79     0.1000     0.0070    99.7860     0.3813    93.0500   150.2872
17833469.0 / 36489290
  80     0.1000     0.0124    99.6080     0.3933    92.4900   150.2839
17757366.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0143    99.5380     0.3593    92.7800   150.4372
17679566.0 / 36489290
  82     0.1000     0.0106    99.6680     0.4057    92.3800   150.6150
17598285.0 / 36489290
  83     0.1000     0.0065    99.8140     0.3762    92.9600   150.6307
17519839.0 / 36489290
  84     0.1000     0.0075    99.7640     0.4172    92.4500   150.5255
17446373.0 / 36489290
  85     0.1000     0.0121    99.5880     0.3970    92.3700   150.5174
17370034.0 / 36489290
  86     0.1000     0.0092    99.7180     0.4088    92.5300   150.4825
17295142.0 / 36489290
  87     0.1000     0.0086    99.7120     0.3958    92.4900   150.6340
17219451.0 / 36489290
  88     0.1000     0.0072    99.7660     0.3691    93.0000   150.4841
17145651.0 / 36489290
  89     0.1000     0.0069    99.7740     0.3818    92.4000   150.9267
17073340.0 / 36489290
  90     0.1000     0.0085    99.7060     0.3884    92.4700   151.2054
17000027.0 / 36489290
  91     0.1000     0.0077    99.7580     0.3805    92.8600   150.8859
16931562.0 / 36489290
  92     0.1000     0.0093    99.7240     0.4438    92.2900   150.3954
16859518.0 / 36489290
  93     0.1000     0.0076    99.7560     0.3623    93.0400   149.9851
16786583.0 / 36489290
  94     0.1000     0.0051    99.8280     0.4021    92.7700   150.4743
16717910.0 / 36489290
  95     0.1000     0.0079    99.7400     0.4534    92.4100   151.2499
16649589.0 / 36489290
  96     0.1000     0.0077    99.7480     0.4085    92.6800   150.5718
16583315.0 / 36489290
  97     0.1000     0.0106    99.6460     0.3627    93.0400   151.3922
16516799.0 / 36489290
  98     0.1000     0.0084    99.7160     0.4456    91.9800   151.0624
16450220.0 / 36489290
  99     0.1000     0.0071    99.7740     0.3827    93.1000   150.5692
16383769.0 / 36489290
 100     0.1000     0.0071    99.7520     0.3832    92.9400   150.3859
16319795.0 / 36489290
 101     0.0988     0.0069    99.7740     0.4631    92.1300   150.6047
16253437.0 / 36489290
 102     0.0975     0.0050    99.8520     0.3754    93.0200   151.1709
16186585.0 / 36489290
 103     0.0963     0.0023    99.9420     0.3474    93.6000   150.8903
16119964.0 / 36489290
 104     0.0950     0.0023    99.9360     0.3815    93.0000   150.1949
16058216.0 / 36489290
 105     0.0938     0.0050    99.8460     0.3740    93.2100   150.4697
15995537.0 / 36489290
 106     0.0926     0.0040    99.8720     0.3640    93.4800   150.3076
15934067.0 / 36489290
 107     0.0913     0.0028    99.9240     0.3822    93.2600   150.7182
15871486.0 / 36489290
 108     0.0901     0.0016    99.9480     0.3679    93.5200   149.0244
15810117.0 / 36489290
 109     0.0889     0.0013    99.9720     0.3674    93.7100   150.7149
15749943.0 / 36489290
 110     0.0876     0.0010    99.9800     0.3531    93.8700   151.0160
15690205.0 / 36489290
 111     0.0864     0.0011    99.9720     0.3707    93.5200   149.0040
15632880.0 / 36489290
 112     0.0852     0.0012    99.9720     0.3523    93.7700   151.4384
15576567.0 / 36489290
 113     0.0839     0.0010    99.9760     0.3569    93.5900   150.4062
15521030.0 / 36489290
 114     0.0827     0.0018    99.9480     0.3737    93.2600   151.1917
15467462.0 / 36489290
 115     0.0814     0.0008    99.9780     0.3721    93.4900   150.5989
15413539.0 / 36489290
 116     0.0802     0.0005    99.9880     0.3610    93.7300   150.7222
15360762.0 / 36489290
 117     0.0790     0.0006    99.9860     0.3660    93.6100   150.5664
15309849.0 / 36489290
 118     0.0777     0.0009    99.9760     0.3709    93.4300   150.9426
15259646.0 / 36489290
 119     0.0765     0.0013    99.9720     0.3597    93.5700   150.9747
15210044.0 / 36489290
 120     0.0753     0.0006    99.9860     0.3431    93.7500   151.2912
15161394.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0004    99.9960     0.3438    93.5800   151.1387
15113289.0 / 36489290
 122     0.0728     0.0005    99.9940     0.3476    93.7000   150.4106
15067115.0 / 36489290
 123     0.0715     0.0003    99.9980     0.3397    93.8300   150.9376
15021181.0 / 36489290
 124     0.0703     0.0004    99.9960     0.3783    93.4200   149.8973
14976298.0 / 36489290
 125     0.0691     0.0004    99.9920     0.3587    93.7300   150.8428
14932877.0 / 36489290
 126     0.0678     0.0002    99.9980     0.3481    93.7700   150.4388
14890079.0 / 36489290
 127     0.0666     0.0003    99.9980     0.3439    93.7700   150.6678
14848027.0 / 36489290
 128     0.0654     0.0002    99.9980     0.3493    93.8700   150.7905
14807498.0 / 36489290
 129     0.0641     0.0002   100.0000     0.3503    94.0100   150.6838
14767568.0 / 36489290
 130     0.0629     0.0003    99.9940     0.3477    93.8900   150.5393
14728502.0 / 36489290
 131     0.0616     0.0002    99.9980     0.3418    93.9300   150.9613
14690073.0 / 36489290
 132     0.0604     0.0002    99.9980     0.3452    93.9300   150.4529
14653310.0 / 36489290
 133     0.0592     0.0002    99.9960     0.3527    93.8800   150.4166
14616915.0 / 36489290
 134     0.0579     0.0002    99.9980     0.3464    93.8300   150.7136
14581316.0 / 36489290
 135     0.0567     0.0002    99.9960     0.3571    93.8500   150.7231
14546789.0 / 36489290
 136     0.0554     0.0002    99.9980     0.3479    93.9000   150.4042
14513175.0 / 36489290
 137     0.0542     0.0001   100.0000     0.3514    93.9400   150.4066
14480923.0 / 36489290
 138     0.0530     0.0001   100.0000     0.3530    93.8900   150.6981
14448987.0 / 36489290
 139     0.0517     0.0001    99.9980     0.3402    93.9800   150.2477
14418048.0 / 36489290
 140     0.0505     0.0001   100.0000     0.3420    93.9800   150.5249
14387698.0 / 36489290
 141     0.0493     0.0002    99.9980     0.3468    93.8700   149.6385
14358210.0 / 36489290
 142     0.0480     0.0001   100.0000     0.3424    94.1200   150.5452
14329620.0 / 36489290
 143     0.0468     0.0002    99.9980     0.3516    93.9900   151.0274
14301744.0 / 36489290
 144     0.0456     0.0001   100.0000     0.3458    93.9800   150.9478
14274891.0 / 36489290
 145     0.0443     0.0001   100.0000     0.3436    94.0100   151.0955
14248963.0 / 36489290
 146     0.0431     0.0001    99.9980     0.3423    94.0400   150.4603
14223821.0 / 36489290
 147     0.0418     0.0001   100.0000     0.3400    94.1100   151.0168
14199171.0 / 36489290
 148     0.0406     0.0001   100.0000     0.3373    94.0000   150.1629
14175394.0 / 36489290
 149     0.0394     0.0001   100.0000     0.3424    94.1100   150.9599
14152471.0 / 36489290
 150     0.0381     0.0001   100.0000     0.3406    93.9600   150.8549
14130408.0 / 36489290
 151     0.0369     0.0001   100.0000     0.3408    94.1500   150.5821
14108980.0 / 36489290
 152     0.0357     0.0001   100.0000     0.3419    94.1300   148.4937
14088259.0 / 36489290
 153     0.0344     0.0001    99.9980     0.3486    94.1600   150.6738
14068251.0 / 36489290
 154     0.0332     0.0001   100.0000     0.3450    94.2100   150.5316
14049225.0 / 36489290
 155     0.0319     0.0001   100.0000     0.3477    94.1600   150.8903
14030659.0 / 36489290
 156     0.0307     0.0001   100.0000     0.3389    94.1500   150.6305
14013254.0 / 36489290
 157     0.0295     0.0001   100.0000     0.3353    94.2200   150.5631
13996407.0 / 36489290
 158     0.0282     0.0001   100.0000     0.3390    94.1800   149.6364
13980206.0 / 36489290
 159     0.0270     0.0001   100.0000     0.3424    94.2700   150.6251
13964823.0 / 36489290
 160     0.0257     0.0001   100.0000     0.3413    94.2600   150.9271
13950161.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0001    99.9980     0.3463    94.1200   150.7014
13936358.0 / 36489290
 162     0.0233     0.0001   100.0000     0.3399    94.1900   150.3930
13923364.0 / 36489290
 163     0.0220     0.0001   100.0000     0.3395    94.1600   150.7694
13910806.0 / 36489290
 164     0.0208     0.0001   100.0000     0.3402    94.1700   150.2560
13899184.0 / 36489290
 165     0.0196     0.0001   100.0000     0.3382    94.2700   150.7781
13888330.0 / 36489290
 166     0.0183     0.0001    99.9980     0.3357    94.0800   150.7200
13878048.0 / 36489290
 167     0.0171     0.0001   100.0000     0.3456    94.2400   150.8468
13868500.0 / 36489290
 168     0.0159     0.0001   100.0000     0.3391    94.2100   150.9233
13859869.0 / 36489290
 169     0.0146     0.0001   100.0000     0.3369    94.1500   150.9340
13851846.0 / 36489290
 170     0.0134     0.0001   100.0000     0.3401    94.2400   150.8499
13844571.0 / 36489290
 171     0.0121     0.0001   100.0000     0.3388    94.2200   150.2925
13837918.0 / 36489290
 172     0.0109     0.0001   100.0000     0.3389    94.2000   150.2898
13832132.0 / 36489290
 173     0.0097     0.0001   100.0000     0.3393    94.1800   150.7429
13826994.0 / 36489290
 174     0.0084     0.0001   100.0000     0.3389    94.1400   151.0246
13822491.0 / 36489290
 175     0.0072     0.0001   100.0000     0.3361    94.1900   150.6222
13818834.0 / 36489290
 176     0.0060     0.0001    99.9980     0.3388    94.2300   150.2154
13815888.0 / 36489290
 177     0.0047     0.0001   100.0000     0.3414    94.2500   150.7237
13813735.0 / 36489290
 178     0.0035     0.0001   100.0000     0.3431    94.1300   150.7265
13812372.0 / 36489290
 179     0.0022     0.0001   100.0000     0.3426    94.1200   151.0454
13811621.0 / 36489290
 180     0.0010     0.0001    99.9980     0.3322    94.1500   151.0371
13810886.0 / 36489290
 181     0.0010     0.0001   100.0000     0.3357    94.1300   150.8754
13810154.0 / 36489290
 182     0.0010     0.0001   100.0000     0.3337    94.2600   150.5891
13809395.0 / 36489290
 183     0.0010     0.0001   100.0000     0.3351    94.2400   150.4638
13808643.0 / 36489290
 184     0.0010     0.0001   100.0000     0.3378    94.0900   150.7764
13807952.0 / 36489290
 185     0.0010     0.0001   100.0000     0.3389    94.2500   150.2295
13807227.0 / 36489290
 186     0.0010     0.0001   100.0000     0.3373    94.1500   150.7232
13806476.0 / 36489290
 187     0.0010     0.0001   100.0000     0.3362    94.1600   150.3101
13805789.0 / 36489290
 188     0.0010     0.0001   100.0000     0.3443    94.1500   150.4600
13805068.0 / 36489290
 189     0.0010     0.0001   100.0000     0.3382    94.1600   150.6299
13804425.0 / 36489290
 190     0.0010     0.0001   100.0000     0.3383    94.1500   150.5948
13803672.0 / 36489290
 191     0.0010     0.0001   100.0000     0.3364    94.1200   150.7335
13802928.0 / 36489290
 192     0.0010     0.0001   100.0000     0.3354    94.1500   150.4790
13802201.0 / 36489290
 193     0.0010     0.0001   100.0000     0.3424    94.1400   150.5672
13801463.0 / 36489290
 194     0.0010     0.0001   100.0000     0.3423    94.1900   150.6046
13800717.0 / 36489290
 195     0.0010     0.0001   100.0000     0.3381    94.1700   150.4371
13800019.0 / 36489290
 196     0.0010     0.0001   100.0000     0.3365    94.2200   150.8879
13799333.0 / 36489290
 197     0.0010     0.0001    99.9980     0.3332    94.2200   150.4020
13798690.0 / 36489290
 198     0.0010     0.0001   100.0000     0.3424    94.1500   150.8414
13797978.0 / 36489290
 199     0.0010     0.0001    99.9980     0.3362    94.2200   149.2656
13797231.0 / 36489290
 200     0.0010     0.0001   100.0000     0.3372    94.2100   149.9007
