Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.65
)
Resume training from cifar100_save/endpoints/WideResNet28x10-2/sgd/checkpoint-0.pt
total epochs: 200
27960582.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4483    46.2620     1.6430    42.9600    99.4688
23129198.0 / 36489290
   2     0.1000     0.9191    67.1380     1.3055    60.1000    97.1212
19128448.0 / 36489290
   3     0.1000     0.7039    75.4780     0.9397    70.5900    96.9719
15599234.0 / 36489290
   4     0.1000     0.5820    79.7940     1.8630    56.7900    96.7264
12448829.0 / 36489290
   5     0.1000     0.5055    82.5520     1.1849    68.3500    96.6341
9776335.0 / 36489290
   6     0.1000     0.4555    84.3440     0.5579    80.5900    96.4487
7758294.0 / 36489290
   7     0.1000     0.4168    85.6240     0.6102    79.4000    96.4852
6398045.0 / 36489290
   8     0.1000     0.3880    86.6920     0.6944    77.6600    96.4667
5475978.0 / 36489290
   9     0.1000     0.3558    87.6860     0.6749    80.0100    96.4193
4827940.0 / 36489290
  10     0.1000     0.3331    88.4740     0.6150    81.1400    96.2266
4346759.0 / 36489290
  11     0.1000     0.3068    89.5380     0.4810    85.4800    96.2305
3979873.0 / 36489290
  12     0.1000     0.2853    90.2260     0.5031    83.9900    96.5052
3694148.0 / 36489290
  13     0.1000     0.2685    90.7820     0.7838    79.1100    96.3939
3466917.0 / 36489290
  14     0.1000     0.2522    91.3740     0.4937    84.8000    96.4297
3284422.0 / 36489290
  15     0.1000     0.2330    91.8920     0.4377    86.2000    96.4543
3133830.0 / 36489290
  16     0.1000     0.2216    92.3360     0.4628    84.8700    96.2834
2993726.0 / 36489290
  17     0.1000     0.2005    93.1180     0.4069    87.4900    96.0205
2875482.0 / 36489290
  18     0.1000     0.1933    93.2440     0.6239    82.6300    95.9451
2778896.0 / 36489290
  19     0.1000     0.1783    93.8760     0.6873    81.5400    96.1344
2690472.0 / 36489290
  20     0.1000     0.1702    94.1040     0.6911    80.8400    96.1401
2606954.0 / 36489290
  21     0.1000     0.1601    94.5000     0.3260    89.7300    96.0082
2533862.0 / 36489290
  22     0.1000     0.1461    94.9780     0.3582    89.3400    95.9971
2472162.0 / 36489290
  23     0.1000     0.1401    95.1540     0.3225    90.7400    96.0424
2413906.0 / 36489290
  24     0.1000     0.1323    95.4220     0.8892    78.8500    95.9079
2360946.0 / 36489290
  25     0.1000     0.1254    95.6320     0.4504    87.2000    96.0619
2313828.0 / 36489290
  26     0.1000     0.1199    95.8420     0.3727    89.3000    95.9890
2266519.0 / 36489290
  27     0.1000     0.1122    96.0800     0.5166    87.3200    96.0532
2222224.0 / 36489290
  28     0.1000     0.1068    96.2140     0.3793    89.2200    95.9557
2181468.0 / 36489290
  29     0.1000     0.0995    96.5160     0.3451    90.6900    95.9785
2142112.0 / 36489290
  30     0.1000     0.0979    96.5560     0.3272    90.6500    95.9836
2111077.0 / 36489290
  31     0.1000     0.0956    96.6780     0.3625    89.7600    95.8869
2070709.0 / 36489290
  32     0.1000     0.0852    96.9820     0.3921    89.4100    95.8791
2033804.0 / 36489290
  33     0.1000     0.0820    97.1860     0.4728    88.4500    96.1784
2000956.0 / 36489290
  34     0.1000     0.0795    97.2780     0.3716    90.5800    95.9575
1968013.0 / 36489290
  35     0.1000     0.0730    97.4040     0.4680    88.1600    95.8372
1936337.0 / 36489290
  36     0.1000     0.0729    97.4240     0.4738    87.7200    95.8690
1908809.0 / 36489290
  37     0.1000     0.0715    97.5720     0.4233    89.5400    95.7530
1882293.0 / 36489290
  38     0.1000     0.0648    97.7380     0.5283    88.3800    95.7557
1852545.0 / 36489290
  39     0.1000     0.0625    97.8560     0.4495    89.8600    95.8884
1824654.0 / 36489290
  40     0.1000     0.0588    97.9440     0.4073    89.7300    95.9057
1805658.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0650    97.7300     0.3170    91.8100    96.0239
1782270.0 / 36489290
  42     0.1000     0.0585    97.9980     0.5205    86.8300    95.8464
1756688.0 / 36489290
  43     0.1000     0.0541    98.1140     0.4488    89.1000    95.8004
1735549.0 / 36489290
  44     0.1000     0.0534    98.1180     0.4245    89.9400    95.7148
1712361.0 / 36489290
  45     0.1000     0.0502    98.2520     0.3720    91.2600    95.7098
1692095.0 / 36489290
  46     0.1000     0.0522    98.1860     0.3391    91.4500    95.6734
1669002.0 / 36489290
  47     0.1000     0.0467    98.4120     0.3532    91.9500    95.8577
1649767.0 / 36489290
  48     0.1000     0.0482    98.3560     0.4142    90.6500    95.7725
1631552.0 / 36489290
  49     0.1000     0.0476    98.3820     0.3957    90.5800    95.8012
1604905.0 / 36489290
  50     0.1000     0.0396    98.6460     0.3729    91.2300    95.7598
1597786.0 / 36489290
  51     0.1000     0.0512    98.2500     0.3804    90.7800    95.7073
1573212.0 / 36489290
  52     0.1000     0.0394    98.6740     0.2997    92.5300    95.8011
1556019.0 / 36489290
  53     0.1000     0.0406    98.5700     0.3429    91.6000    95.7792
1541029.0 / 36489290
  54     0.1000     0.0413    98.5620     0.4646    89.6500    95.8838
1531111.0 / 36489290
  55     0.1000     0.0426    98.4800     0.5095    88.6100    96.0330
1509822.0 / 36489290
  56     0.1000     0.0371    98.7200     0.4538    90.1100    96.0486
1502617.0 / 36489290
  57     0.1000     0.0428    98.4800     0.4248    90.9100    96.1976
1485360.0 / 36489290
  58     0.1000     0.0357    98.7400     0.3446    91.8400    96.1044
1470180.0 / 36489290
  59     0.1000     0.0360    98.7900     0.4721    90.2500    96.1706
1456767.0 / 36489290
  60     0.1000     0.0362    98.7160     0.3482    91.8900    96.1566
1437388.0 / 36489290
  61     0.1000     0.0295    98.9800     0.4342    90.6700    95.9572
1433036.0 / 36489290
  62     0.1000     0.0403    98.5840     0.3625    91.6300    96.3975
1414938.0 / 36489290
  63     0.1000     0.0315    98.9220     0.3975    90.9300    96.3373
1403767.0 / 36489290
  64     0.1000     0.0336    98.8380     0.3779    91.6400    96.1577
1390871.0 / 36489290
  65     0.1000     0.0317    98.9180     0.3766    91.7800    96.3326
1381346.0 / 36489290
  66     0.1000     0.0340    98.8080     0.3726    91.7000    96.1793
1369437.0 / 36489290
  67     0.1000     0.0322    98.9180     0.3307    92.0900    96.2027
1353079.0 / 36489290
  68     0.1000     0.0283    99.0680     0.6248    87.8500    96.0861
1347565.0 / 36489290
  69     0.1000     0.0340    98.8280     0.2886    93.2900    96.0254
1330194.0 / 36489290
  70     0.1000     0.0279    99.0740     0.6194    88.8700    96.1261
1319059.0 / 36489290
  71     0.1000     0.0291    98.9860     0.3228    92.6500    96.0153
1306323.0 / 36489290
  72     0.1000     0.0266    99.1500     1.0421    82.9600    95.9236
1300188.0 / 36489290
  73     0.1000     0.0335    98.8640     0.5479    89.4300    95.7849
1290307.0 / 36489290
  74     0.1000     0.0286    99.0240     0.3341    92.6800    95.8375
1278265.0 / 36489290
  75     0.1000     0.0259    99.1560     0.4676    89.8400    95.6759
1271592.0 / 36489290
  76     0.1000     0.0301    98.9760     0.3904    91.6400    95.7553
1261107.0 / 36489290
  77     0.1000     0.0265    99.0800     0.3695    92.0700    95.8707
1251834.0 / 36489290
  78     0.1000     0.0275    99.0740     0.3730    91.5700    95.7208
1242109.0 / 36489290
  79     0.1000     0.0251    99.1380     0.3156    92.6200    95.7166
1234222.0 / 36489290
  80     0.1000     0.0279    99.0300     0.3336    92.5900    95.7487
1227528.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0274    99.0760     0.5109    89.3300    95.6931
1217668.0 / 36489290
  82     0.1000     0.0244    99.1620     0.3434    92.5500    95.7456
1206561.0 / 36489290
  83     0.1000     0.0226    99.2460     0.4022    91.5200    95.7527
1195788.0 / 36489290
  84     0.1000     0.0236    99.1940     0.4473    90.9500    95.7688
1185207.0 / 36489290
  85     0.1000     0.0220    99.2760     0.3609    92.2500    95.7325
1175308.0 / 36489290
  86     0.1000     0.0231    99.2620     0.3358    92.9500    95.8264
1170492.0 / 36489290
  87     0.1000     0.0254    99.1360     0.3719    92.4100    95.8566
1168531.0 / 36489290
  88     0.1000     0.0271    99.0880     0.3993    91.5600    95.7556
1156683.0 / 36489290
  89     0.1000     0.0202    99.3160     0.3577    92.2500    95.9130
1155289.0 / 36489290
  90     0.1000     0.0265    99.0620     0.4251    91.0400    95.9656
1151056.0 / 36489290
  91     0.1000     0.0252    99.1260     0.4311    91.5000    95.9408
1141196.0 / 36489290
  92     0.1000     0.0206    99.2900     0.3627    91.8600    95.8188
1133620.0 / 36489290
  93     0.1000     0.0213    99.2880     0.3407    92.7600    95.9709
1124918.0 / 36489290
  94     0.1000     0.0195    99.3720     0.4231    91.6200    96.0237
1122380.0 / 36489290
  95     0.1000     0.0259    99.1460     0.4312    91.0200    95.7963
1116673.0 / 36489290
  96     0.1000     0.0222    99.2880     0.4956    90.0700    95.9615
1111804.0 / 36489290
  97     0.1000     0.0240    99.2000     0.3173    93.0100    95.6759
1101298.0 / 36489290
  98     0.1000     0.0189    99.4140     0.3637    92.7500    95.6402
1088618.0 / 36489290
  99     0.1000     0.0164    99.4800     0.3471    93.0100    95.5552
1083879.0 / 36489290
 100     0.1000     0.0211    99.2760     0.3294    92.5400    95.7729
1074285.0 / 36489290
 101     0.0988     0.0166    99.4320     0.3327    92.8900    95.7418
1070519.0 / 36489290
 102     0.0975     0.0213    99.2440     0.4013    91.7100    95.8046
1063047.0 / 36489290
 103     0.0963     0.0180    99.3940     0.3318    92.8700    95.7167
1054955.0 / 36489290
 104     0.0950     0.0178    99.3920     0.3360    92.9500    96.0307
1048597.0 / 36489290
 105     0.0938     0.0187    99.3460     0.3254    93.1800    95.9578
1034942.0 / 36489290
 106     0.0926     0.0115    99.6540     0.3485    92.9000    95.8027
1027730.0 / 36489290
 107     0.0913     0.0158    99.4780     0.3747    92.7400    95.8695
1022430.0 / 36489290
 108     0.0901     0.0182    99.4360     0.3507    92.8400    95.7436
1013304.0 / 36489290
 109     0.0889     0.0146    99.5300     0.3684    92.6800    95.7655
1006345.0 / 36489290
 110     0.0876     0.0148    99.4980     0.5645    90.5900    95.8253
998165.0 / 36489290
 111     0.0864     0.0134    99.5560     0.3444    92.9400    95.6739
987176.0 / 36489290
 112     0.0852     0.0117    99.6280     0.6988    87.1500    95.7346
980141.0 / 36489290
 113     0.0839     0.0137    99.5300     0.3757    92.4300    95.5670
969380.0 / 36489290
 114     0.0827     0.0101    99.6880     0.3584    93.0500    95.7982
958305.0 / 36489290
 115     0.0814     0.0096    99.6820     0.3843    92.1100    95.7335
953261.0 / 36489290
 116     0.0802     0.0133    99.5680     0.3407    93.1600    95.7286
944001.0 / 36489290
 117     0.0790     0.0105    99.6860     0.3385    93.2400    95.7554
937667.0 / 36489290
 118     0.0777     0.0110    99.6580     0.3378    93.2600    95.6650
929453.0 / 36489290
 119     0.0765     0.0099    99.6760     0.3109    93.5400    95.8230
915990.0 / 36489290
 120     0.0753     0.0052    99.8580     0.3118    93.7400    95.6900
909238.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0099    99.6780     0.3444    93.3400    95.7456
897722.0 / 36489290
 122     0.0728     0.0056    99.8380     0.3155    93.6000    95.6382
887898.0 / 36489290
 123     0.0715     0.0069    99.7740     0.3759    92.9500    95.6786
883374.0 / 36489290
 124     0.0703     0.0100    99.6760     0.3545    93.0600    95.8315
877971.0 / 36489290
 125     0.0691     0.0094    99.6940     0.3490    93.3900    95.6641
872924.0 / 36489290
 126     0.0678     0.0092    99.7080     0.3311    93.3600    95.7582
864054.0 / 36489290
 127     0.0666     0.0055    99.8620     0.3231    93.6900    95.7591
855725.0 / 36489290
 128     0.0654     0.0054    99.8020     0.3814    93.2200    95.6629
848590.0 / 36489290
 129     0.0641     0.0062    99.7980     0.3977    92.9600    95.6467
843197.0 / 36489290
 130     0.0629     0.0074    99.7660     0.3547    93.1800    95.6667
837300.0 / 36489290
 131     0.0616     0.0074    99.7520     0.3238    93.7000    95.6369
833639.0 / 36489290
 132     0.0604     0.0085    99.7140     0.3710    93.0000    95.6944
829739.0 / 36489290
 133     0.0592     0.0075    99.7580     0.3151    93.7800    95.6547
822283.0 / 36489290
 134     0.0579     0.0047    99.8740     0.3338    93.9100    95.6008
813988.0 / 36489290
 135     0.0567     0.0040    99.8900     0.3372    93.8100    95.7874
806223.0 / 36489290
 136     0.0554     0.0041    99.8860     0.3648    93.1500    95.8264
798562.0 / 36489290
 137     0.0542     0.0034    99.9160     0.3244    93.9900    95.8693
790584.0 / 36489290
 138     0.0530     0.0029    99.9260     0.3325    93.7700    95.7821
782387.0 / 36489290
 139     0.0517     0.0027    99.9300     0.3292    93.7800    95.8049
775274.0 / 36489290
 140     0.0505     0.0027    99.9360     0.3263    93.9800    95.8104
768296.0 / 36489290
 141     0.0493     0.0026    99.9240     0.3245    94.2200    95.7156
762378.0 / 36489290
 142     0.0480     0.0034    99.8980     0.3502    93.8200    95.8899
756273.0 / 36489290
 143     0.0468     0.0034    99.9080     0.3516    93.8700    95.9408
751051.0 / 36489290
 144     0.0456     0.0030    99.9020     0.3366    94.0000    95.9377
746249.0 / 36489290
 145     0.0443     0.0036    99.8940     0.3222    94.1100    95.5621
740144.0 / 36489290
 146     0.0431     0.0023    99.9360     0.3084    94.3700    95.5245
733801.0 / 36489290
 147     0.0418     0.0017    99.9540     0.3550    94.0600    95.9184
727435.0 / 36489290
 148     0.0406     0.0014    99.9540     0.3156    94.2700    95.9398
721454.0 / 36489290
 149     0.0394     0.0016    99.9560     0.3308    94.1500    95.6363
716342.0 / 36489290
 150     0.0381     0.0020    99.9500     0.3201    94.2700    95.7836
711889.0 / 36489290
 151     0.0369     0.0024    99.9200     0.3281    94.4700    95.9193
707023.0 / 36489290
 152     0.0357     0.0015    99.9600     0.3205    94.3300    95.4948
701839.0 / 36489290
 153     0.0344     0.0013    99.9700     0.3227    94.4200    95.6550
697003.0 / 36489290
 154     0.0332     0.0012    99.9740     0.3082    94.4000    95.5589
692475.0 / 36489290
 155     0.0319     0.0011    99.9740     0.3168    94.3600    95.6194
688279.0 / 36489290
 156     0.0307     0.0014    99.9660     0.3229    94.4200    95.5118
684290.0 / 36489290
 157     0.0295     0.0012    99.9620     0.3315    94.2700    95.5304
680458.0 / 36489290
 158     0.0282     0.0011    99.9760     0.3197    94.3500    95.8438
676285.0 / 36489290
 159     0.0270     0.0007    99.9900     0.3180    94.4500    95.9819
672421.0 / 36489290
 160     0.0257     0.0006    99.9900     0.3145    94.4000    95.7386
668985.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0006    99.9920     0.3245    94.4400    95.7327
665657.0 / 36489290
 162     0.0233     0.0005    99.9900     0.3251    94.4700    95.7794
662355.0 / 36489290
 163     0.0220     0.0005    99.9920     0.3151    94.4900    95.6678
659283.0 / 36489290
 164     0.0208     0.0004    99.9980     0.3120    94.4100    95.5973
656346.0 / 36489290
 165     0.0196     0.0003    99.9980     0.3148    94.5800    95.4392
653558.0 / 36489290
 166     0.0183     0.0003   100.0000     0.3131    94.5600    95.5358
651134.0 / 36489290
 167     0.0171     0.0003    99.9980     0.3163    94.5000    95.5036
648930.0 / 36489290
 168     0.0159     0.0004    99.9960     0.3141    94.5300    95.4127
646965.0 / 36489290
 169     0.0146     0.0003    99.9940     0.3135    94.5600    95.5639
645080.0 / 36489290
 170     0.0134     0.0002   100.0000     0.3129    94.5900    95.8606
643478.0 / 36489290
 171     0.0121     0.0003    99.9940     0.3170    94.6300    95.6727
642020.0 / 36489290
 172     0.0109     0.0004    99.9940     0.3079    94.6400    95.8939
640770.0 / 36489290
 173     0.0097     0.0003    99.9960     0.3163    94.6700    95.7242
639798.0 / 36489290
 174     0.0084     0.0003    99.9960     0.3065    94.6000    95.7275
638869.0 / 36489290
 175     0.0072     0.0003    99.9960     0.3113    94.6700    95.8735
638100.0 / 36489290
 176     0.0060     0.0003    99.9960     0.3095    94.6200    95.7033
637551.0 / 36489290
 177     0.0047     0.0003    99.9980     0.3141    94.6200    95.7099
637075.0 / 36489290
 178     0.0035     0.0003    99.9960     0.3174    94.5800    95.7970
636811.0 / 36489290
 179     0.0022     0.0003    99.9980     0.3144    94.4900    95.7631
636661.0 / 36489290
 180     0.0010     0.0002   100.0000     0.3068    94.6300    95.7961
636521.0 / 36489290
 181     0.0010     0.0002    99.9980     0.3088    94.6300    95.7776
636370.0 / 36489290
 182     0.0010     0.0002   100.0000     0.3105    94.5900    95.7888
636213.0 / 36489290
 183     0.0010     0.0003    99.9960     0.3119    94.6100    95.6791
636071.0 / 36489290
 184     0.0010     0.0002    99.9980     0.3124    94.6900    95.9301
635900.0 / 36489290
 185     0.0010     0.0002   100.0000     0.3121    94.5800    95.7455
635755.0 / 36489290
 186     0.0010     0.0003    99.9960     0.3118    94.6000    95.5620
635595.0 / 36489290
 187     0.0010     0.0003    99.9960     0.3096    94.6200    95.7233
635460.0 / 36489290
 188     0.0010     0.0002    99.9980     0.3125    94.5900    95.6105
635291.0 / 36489290
 189     0.0010     0.0002   100.0000     0.3077    94.6700    95.7218
635119.0 / 36489290
 190     0.0010     0.0003    99.9980     0.3141    94.6000    95.7519
634978.0 / 36489290
 191     0.0010     0.0002   100.0000     0.3076    94.6100    95.9364
634839.0 / 36489290
 192     0.0010     0.0003    99.9980     0.3103    94.6300    95.8152
634717.0 / 36489290
 193     0.0010     0.0002   100.0000     0.3150    94.6100    96.9007
634561.0 / 36489290
 194     0.0010     0.0002    99.9980     0.3150    94.6200    96.4159
634438.0 / 36489290
 195     0.0010     0.0003    99.9920     0.3143    94.6400    96.1558
634299.0 / 36489290
 196     0.0010     0.0002    99.9960     0.3092    94.5600    96.0427
634155.0 / 36489290
 197     0.0010     0.0003    99.9960     0.3093    94.6500    96.4014
633993.0 / 36489290
 198     0.0010     0.0003    99.9940     0.3110    94.6000    97.8699
633860.0 / 36489290
 199     0.0010     0.0002   100.0000     0.3108    94.7200    96.6209
633710.0 / 36489290
 200     0.0010     0.0002   100.0000     0.3133    94.6000    96.6524
