Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.501
)
Resume training from cifar100_save/endpoints/WideResNet28x10-1/sgd/checkpoint-0.pt
total epochs: 200
31547289.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4407    46.7100     1.6473    43.9700   152.6396
29504683.0 / 36489290
   2     0.1000     0.9121    67.4460     1.3218    60.9000   148.2914
27941104.0 / 36489290
   3     0.1000     0.6880    76.0160     0.8839    71.8200   148.2915
26623487.0 / 36489290
   4     0.1000     0.5629    80.4720     1.0375    69.5100   148.2810
25467880.0 / 36489290
   5     0.1000     0.4805    83.2580     1.0557    69.9600   148.3192
24423924.0 / 36489290
   6     0.1000     0.4223    85.6520     0.5975    78.9300   148.3119
23465384.0 / 36489290
   7     0.1000     0.3788    86.9880     0.5081    84.0800   148.2363
22577359.0 / 36489290
   8     0.1000     0.3452    87.9860     0.5357    83.1100   148.3293
21742861.0 / 36489290
   9     0.1000     0.3120    89.1820     0.5975    81.6400   148.2117
20958143.0 / 36489290
  10     0.1000     0.2854    90.1240     0.5014    84.2500   148.2315
20217156.0 / 36489290
  11     0.1000     0.2622    90.8640     0.4927    84.7300   148.1945
19512786.0 / 36489290
  12     0.1000     0.2418    91.4960     0.4728    85.2900   148.2363
18846268.0 / 36489290
  13     0.1000     0.2263    92.1920     0.4433    86.3700   148.2044
18209184.0 / 36489290
  14     0.1000     0.2094    92.7240     0.4389    86.6600   148.1950
17602326.0 / 36489290
  15     0.1000     0.1920    93.2620     0.3820    87.6300   148.1552
17024756.0 / 36489290
  16     0.1000     0.1804    93.7260     0.4119    86.8900   148.1488
16473406.0 / 36489290
  17     0.1000     0.1654    94.2520     0.3207    89.8000   148.1346
15951594.0 / 36489290
  18     0.1000     0.1551    94.5560     0.7176    82.8600   148.0991
15456807.0 / 36489290
  19     0.1000     0.1466    94.8980     0.6181    83.7000   148.0872
14984664.0 / 36489290
  20     0.1000     0.1378    95.2860     0.6443    83.2300   148.0685
14534909.0 / 36489290
  21     0.1000     0.1278    95.5740     0.3365    90.3000   148.1069
14110197.0 / 36489290
  22     0.1000     0.1149    95.9480     0.3682    89.4100   148.0591
13709638.0 / 36489290
  23     0.1000     0.1119    96.0620     0.3310    90.8100   148.0805
13326852.0 / 36489290
  24     0.1000     0.1029    96.4100     0.5238    86.5900   148.0680
12966113.0 / 36489290
  25     0.1000     0.0995    96.5640     0.3773    89.0100   148.0167
12623437.0 / 36489290
  26     0.1000     0.0923    96.8300     0.4121    89.4500   148.0182
12304627.0 / 36489290
  27     0.1000     0.0910    96.8160     0.5856    86.7300   148.0056
11998450.0 / 36489290
  28     0.1000     0.0805    97.2060     0.4975    87.3400   147.9580
11710193.0 / 36489290
  29     0.1000     0.0769    97.3220     0.4791    88.8900   148.0155
11437426.0 / 36489290
  30     0.1000     0.0737    97.3980     0.3340    91.2400   147.9664
11184732.0 / 36489290
  31     0.1000     0.0729    97.4060     0.4999    87.4800   147.9474
10941887.0 / 36489290
  32     0.1000     0.0664    97.5860     0.4483    89.2400   148.0029
10712137.0 / 36489290
  33     0.1000     0.0639    97.7380     0.3935    89.3300   148.0101
10494960.0 / 36489290
  34     0.1000     0.0607    97.8560     0.3844    90.2900   147.9418
10279993.0 / 36489290
  35     0.1000     0.0531    98.1200     0.3758    90.9200   147.9996
10084179.0 / 36489290
  36     0.1000     0.0562    98.0940     0.3595    91.3300   147.9161
9896208.0 / 36489290
  37     0.1000     0.0510    98.2240     0.4452    89.4400   147.9275
9719569.0 / 36489290
  38     0.1000     0.0494    98.3180     0.3353    91.5000   147.9841
9546126.0 / 36489290
  39     0.1000     0.0470    98.4140     0.3668    91.6000   147.9010
9376940.0 / 36489290
  40     0.1000     0.0410    98.6620     0.4687    89.4200   148.1028
9220454.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0430    98.5340     0.4130    90.4400   147.9183
9076561.0 / 36489290
  42     0.1000     0.0434    98.4880     0.3199    92.4700   147.9580
8935384.0 / 36489290
  43     0.1000     0.0417    98.5500     0.5614    88.3500   147.9780
8786299.0 / 36489290
  44     0.1000     0.0309    98.9780     0.5510    89.3100   147.9139
8650532.0 / 36489290
  45     0.1000     0.0329    98.9020     0.3897    91.4100   147.9635
8528708.0 / 36489290
  46     0.1000     0.0382    98.6900     0.4505    89.9000   147.9200
8408934.0 / 36489290
  47     0.1000     0.0337    98.8600     0.4063    91.1300   147.9240
8298448.0 / 36489290
  48     0.1000     0.0355    98.8160     0.4499    90.1500   147.9200
8180437.0 / 36489290
  49     0.1000     0.0295    99.0080     0.3741    91.6900   147.9074
8071899.0 / 36489290
  50     0.1000     0.0305    99.0060     0.3250    92.2800   148.0028
7972986.0 / 36489290
  51     0.1000     0.0314    98.8900     0.3616    91.7800   147.8565
7867257.0 / 36489290
  52     0.1000     0.0261    99.1240     0.3167    92.6000   147.9705
7771857.0 / 36489290
  53     0.1000     0.0290    99.0520     0.3372    92.2000   147.8624
7671964.0 / 36489290
  54     0.1000     0.0238    99.2240     0.6211    88.7200   147.9598
7580387.0 / 36489290
  55     0.1000     0.0237    99.2120     0.5865    88.5800   147.9270
7505939.0 / 36489290
  56     0.1000     0.0310    98.8900     0.4526    90.6900   147.9329
7419379.0 / 36489290
  57     0.1000     0.0240    99.2040     0.5245    89.1900   147.9508
7330133.0 / 36489290
  58     0.1000     0.0210    99.3220     0.4864    90.0900   147.8057
7267330.0 / 36489290
  59     0.1000     0.0317    98.9260     0.4409    90.6000   147.8894
7185615.0 / 36489290
  60     0.1000     0.0223    99.2440     0.3472    92.5600   147.9301
7109919.0 / 36489290
  61     0.1000     0.0230    99.2380     0.5032    90.3100   147.8988
7048313.0 / 36489290
  62     0.1000     0.0270    99.0680     0.4122    91.1700   148.0401
6976440.0 / 36489290
  63     0.1000     0.0207    99.3080     0.3784    91.9500   147.9035
6899724.0 / 36489290
  64     0.1000     0.0184    99.4020     0.3330    92.7400   148.0006
6820761.0 / 36489290
  65     0.1000     0.0152    99.4920     0.4435    91.4700   147.8923
6769817.0 / 36489290
  66     0.1000     0.0283    99.0800     0.3943    91.9800   147.9028
6710029.0 / 36489290
  67     0.1000     0.0206    99.3100     0.3733    92.4000   147.9044
6641293.0 / 36489290
  68     0.1000     0.0162    99.4680     0.3973    92.1700   147.9228
6579524.0 / 36489290
  69     0.1000     0.0189    99.3820     0.3942    92.0200   147.9788
6521982.0 / 36489290
  70     0.1000     0.0180    99.3660     0.4213    91.2200   147.9430
6476463.0 / 36489290
  71     0.1000     0.0235    99.1540     0.5569    88.9600   147.9084
6410004.0 / 36489290
  72     0.1000     0.0133    99.5880     0.3721    92.6500   147.9162
6350200.0 / 36489290
  73     0.1000     0.0158    99.5000     0.4061    92.1400   147.8812
6296614.0 / 36489290
  74     0.1000     0.0168    99.4300     0.3607    92.3200   147.8791
6240111.0 / 36489290
  75     0.1000     0.0147    99.5300     0.3964    91.9700   147.8866
6202160.0 / 36489290
  76     0.1000     0.0203    99.3120     0.4180    91.6800   148.1079
6155547.0 / 36489290
  77     0.1000     0.0172    99.4360     0.3828    92.2200   147.8844
6110590.0 / 36489290
  78     0.1000     0.0164    99.4380     0.3849    92.3100   147.9272
6059517.0 / 36489290
  79     0.1000     0.0142    99.4980     0.3980    92.1600   147.9245
6015360.0 / 36489290
  80     0.1000     0.0173    99.4260     0.4015    91.9200   147.9496
5977311.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0183    99.3700     0.4123    91.8500   147.8759
5926813.0 / 36489290
  82     0.1000     0.0124    99.6000     0.3909    92.3800   147.9531
5867807.0 / 36489290
  83     0.1000     0.0088    99.7020     0.6219    88.8100   147.9508
5822084.0 / 36489290
  84     0.1000     0.0127    99.6000     0.3869    92.4700   147.9234
5782123.0 / 36489290
  85     0.1000     0.0141    99.5380     0.3792    92.7500   147.9818
5747678.0 / 36489290
  86     0.1000     0.0161    99.4680     0.4402    91.5100   147.8965
5721910.0 / 36489290
  87     0.1000     0.0198    99.3340     0.3959    92.0400   147.8802
5696294.0 / 36489290
  88     0.1000     0.0196    99.3720     0.3746    92.6000   147.9022
5644066.0 / 36489290
  89     0.1000     0.0089    99.7200     0.6181    89.8700   147.8822
5612448.0 / 36489290
  90     0.1000     0.0158    99.4480     0.3625    92.7500   147.9765
5571423.0 / 36489290
  91     0.1000     0.0120    99.6060     0.3430    93.3400   147.8310
5537067.0 / 36489290
  92     0.1000     0.0129    99.6060     0.4223    92.2800   147.9082
5494852.0 / 36489290
  93     0.1000     0.0108    99.6440     0.3832    92.7200   147.9137
5464929.0 / 36489290
  94     0.1000     0.0144    99.5220     0.3896    92.4800   147.8817
5444397.0 / 36489290
  95     0.1000     0.0178    99.3800     0.4433    91.8200   147.8698
5416496.0 / 36489290
  96     0.1000     0.0153    99.4860     0.4535    91.6300   147.8697
5386492.0 / 36489290
  97     0.1000     0.0142    99.5320     0.3925    92.2400   147.8590
5349824.0 / 36489290
  98     0.1000     0.0106    99.6540     0.3724    92.7600   147.8330
5311165.0 / 36489290
  99     0.1000     0.0095    99.7060     0.3722    92.8000   147.8902
5270877.0 / 36489290
 100     0.1000     0.0084    99.7360     0.3282    93.2300   147.9151
5227586.0 / 36489290
 101     0.0988     0.0068    99.7720     0.3937    93.4400   147.9203
5184028.0 / 36489290
 102     0.0975     0.0068    99.8000     0.3685    93.3000   147.9389
5149194.0 / 36489290
 103     0.0963     0.0083    99.7460     0.3851    92.6800   147.9403
5122425.0 / 36489290
 104     0.0950     0.0134    99.5980     0.3755    92.7000   147.8782
5085831.0 / 36489290
 105     0.0938     0.0080    99.7580     0.3730    93.1700   147.8912
5053450.0 / 36489290
 106     0.0926     0.0081    99.7540     0.3922    93.1700   147.8918
5020835.0 / 36489290
 107     0.0913     0.0080    99.7300     0.3888    92.9900   147.9640
4983998.0 / 36489290
 108     0.0901     0.0057    99.8260     0.3502    93.6700   147.8184
4940299.0 / 36489290
 109     0.0889     0.0030    99.9180     0.3431    93.6800   147.8736
4898115.0 / 36489290
 110     0.0876     0.0031    99.9060     0.3361    93.7000   147.9103
4858192.0 / 36489290
 111     0.0864     0.0034    99.9000     0.3396    93.9300   147.8850
4817670.0 / 36489290
 112     0.0852     0.0027    99.9140     0.6948    88.8600   147.8868
4774299.0 / 36489290
 113     0.0839     0.0016    99.9700     0.3446    94.0900   147.9105
4734071.0 / 36489290
 114     0.0827     0.0024    99.9320     0.4156    92.5900   147.8715
4695319.0 / 36489290
 115     0.0814     0.0022    99.9560     0.3654    93.5200   147.8776
4657507.0 / 36489290
 116     0.0802     0.0021    99.9440     0.3495    93.8700   147.8675
4619421.0 / 36489290
 117     0.0790     0.0016    99.9640     0.3631    93.8700   147.8698
4583611.0 / 36489290
 118     0.0777     0.0022    99.9400     0.3422    93.9200   147.9083
4546707.0 / 36489290
 119     0.0765     0.0015    99.9600     0.3406    94.0900   147.8738
4511857.0 / 36489290
 120     0.0753     0.0014    99.9620     0.3313    94.0400   147.8910
4477805.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0012    99.9700     0.3368    94.2100   147.9496
4444618.0 / 36489290
 122     0.0728     0.0013    99.9620     0.3264    94.1500   147.8562
4410869.0 / 36489290
 123     0.0715     0.0011    99.9780     0.3226    94.4600   147.8534
4378697.0 / 36489290
 124     0.0703     0.0010    99.9720     0.3441    94.1800   147.8503
4345779.0 / 36489290
 125     0.0691     0.0006    99.9920     0.3484    94.0700   148.0403
4314452.0 / 36489290
 126     0.0678     0.0006    99.9920     0.3375    94.2700   147.8238
4285128.0 / 36489290
 127     0.0666     0.0011    99.9680     0.3504    93.9400   147.9067
4256113.0 / 36489290
 128     0.0654     0.0009    99.9760     0.3463    94.3100   147.8549
4227530.0 / 36489290
 129     0.0641     0.0009    99.9720     0.3446    94.3700   147.8389
4200243.0 / 36489290
 130     0.0629     0.0009    99.9760     0.3494    94.2400   147.8081
4173877.0 / 36489290
 131     0.0616     0.0011    99.9700     0.3421    94.1500   147.8626
4148611.0 / 36489290
 132     0.0604     0.0009    99.9820     0.3516    94.0700   147.9083
4122649.0 / 36489290
 133     0.0592     0.0005    99.9940     0.3471    94.2300   147.8934
4097723.0 / 36489290
 134     0.0579     0.0005    99.9880     0.3292    94.5000   147.8634
4073282.0 / 36489290
 135     0.0567     0.0006    99.9820     0.3415    94.3100   147.9043
4049430.0 / 36489290
 136     0.0554     0.0003    99.9980     0.3397    94.1900   147.9446
4026247.0 / 36489290
 137     0.0542     0.0004    99.9900     0.3365    94.4100   147.9683
4003461.0 / 36489290
 138     0.0530     0.0003    99.9980     0.3360    94.4100   147.8666
3981391.0 / 36489290
 139     0.0517     0.0002   100.0000     0.3297    94.5300   147.8569
3960028.0 / 36489290
 140     0.0505     0.0002    99.9980     0.3312    94.4400   147.8492
3939273.0 / 36489290
 141     0.0493     0.0002    99.9960     0.3361    94.3800   147.8862
3919552.0 / 36489290
 142     0.0480     0.0004    99.9900     0.3426    94.2200   147.9012
3900360.0 / 36489290
 143     0.0468     0.0003    99.9940     0.3298    94.4200   148.0944
3881587.0 / 36489290
 144     0.0456     0.0002   100.0000     0.3284    94.4800   147.9273
3863436.0 / 36489290
 145     0.0443     0.0002    99.9960     0.3272    94.5200   148.0173
3846010.0 / 36489290
 146     0.0431     0.0002    99.9980     0.3293    94.5300   147.8721
3829240.0 / 36489290
 147     0.0418     0.0001   100.0000     0.3243    94.4600   147.8871
3812601.0 / 36489290
 148     0.0406     0.0002   100.0000     0.3195    94.5800   147.8746
3797017.0 / 36489290
 149     0.0394     0.0002    99.9980     0.3264    94.4400   147.9137
3782175.0 / 36489290
 150     0.0381     0.0001   100.0000     0.3249    94.4400   147.9122
3767632.0 / 36489290
 151     0.0369     0.0002    99.9980     0.3276    94.5100   147.8178
3753471.0 / 36489290
 152     0.0357     0.0002    99.9980     0.3306    94.5600   147.8182
3740298.0 / 36489290
 153     0.0344     0.0002    99.9980     0.3308    94.4600   147.9153
3727657.0 / 36489290
 154     0.0332     0.0002   100.0000     0.3289    94.4700   147.9381
3715392.0 / 36489290
 155     0.0319     0.0001   100.0000     0.3262    94.5700   147.9290
3703673.0 / 36489290
 156     0.0307     0.0001   100.0000     0.3256    94.5700   147.9007
3692478.0 / 36489290
 157     0.0295     0.0001   100.0000     0.3210    94.4300   147.9123
3681632.0 / 36489290
 158     0.0282     0.0001   100.0000     0.3241    94.5400   147.8626
3671535.0 / 36489290
 159     0.0270     0.0001   100.0000     0.3229    94.5000   147.8745
3661976.0 / 36489290
 160     0.0257     0.0001   100.0000     0.3216    94.5200   147.8867
3653006.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0001   100.0000     0.3275    94.3900   149.2112
3644344.0 / 36489290
 162     0.0233     0.0001   100.0000     0.3225    94.5500   144.9997
3636100.0 / 36489290
 163     0.0220     0.0001   100.0000     0.3181    94.6400   144.9306
3628539.0 / 36489290
 164     0.0208     0.0001   100.0000     0.3182    94.6500   144.9183
3621360.0 / 36489290
 165     0.0196     0.0001   100.0000     0.3161    94.5800   144.9051
3614730.0 / 36489290
 166     0.0183     0.0001    99.9980     0.3185    94.6700   144.9183
3608535.0 / 36489290
 167     0.0171     0.0001   100.0000     0.3217    94.5900   144.9176
3602933.0 / 36489290
 168     0.0159     0.0001   100.0000     0.3186    94.6000   144.9391
3597788.0 / 36489290
 169     0.0146     0.0001   100.0000     0.3201    94.6200   144.9760
3593105.0 / 36489290
 170     0.0134     0.0001   100.0000     0.3188    94.5700   144.9706
3588839.0 / 36489290
 171     0.0121     0.0001   100.0000     0.3195    94.6100   144.9341
3585034.0 / 36489290
 172     0.0109     0.0001   100.0000     0.3171    94.5800   144.8657
3581662.0 / 36489290
 173     0.0097     0.0001   100.0000     0.3163    94.6400   144.9888
3578747.0 / 36489290
 174     0.0084     0.0001   100.0000     0.3219    94.6000   144.9186
3576314.0 / 36489290
 175     0.0072     0.0001   100.0000     0.3234    94.5600   144.8792
3574383.0 / 36489290
 176     0.0060     0.0001   100.0000     0.3195    94.5100   144.9082
3572682.0 / 36489290
 177     0.0047     0.0001   100.0000     0.3152    94.6400   144.7618
3571284.0 / 36489290
 178     0.0035     0.0001   100.0000     0.3209    94.6100   144.7994
3570625.0 / 36489290
 179     0.0022     0.0001   100.0000     0.3154    94.6300   144.8701
3570263.0 / 36489290
 180     0.0010     0.0001   100.0000     0.3164    94.6500   144.8493
3569914.0 / 36489290
 181     0.0010     0.0001    99.9960     0.3184    94.6300   144.8552
3569578.0 / 36489290
 182     0.0010     0.0001   100.0000     0.3135    94.5900   144.7501
3569257.0 / 36489290
 183     0.0010     0.0001   100.0000     0.3190    94.6300   144.9102
3568938.0 / 36489290
 184     0.0010     0.0001   100.0000     0.3177    94.6500   144.8841
3568642.0 / 36489290
 185     0.0010     0.0001   100.0000     0.3228    94.5400   144.8842
3568313.0 / 36489290
 186     0.0010     0.0001   100.0000     0.3130    94.6100   144.8271
3567986.0 / 36489290
 187     0.0010     0.0001   100.0000     0.3173    94.5700   144.8652
3567671.0 / 36489290
 188     0.0010     0.0001   100.0000     0.3152    94.6300   144.8379
3567285.0 / 36489290
 189     0.0010     0.0001   100.0000     0.3134    94.6100   144.7846
3566988.0 / 36489290
 190     0.0010     0.0001   100.0000     0.3156    94.6200   144.7981
3566619.0 / 36489290
 191     0.0010     0.0001   100.0000     0.3189    94.6000   144.7813
3566303.0 / 36489290
 192     0.0010     0.0001   100.0000     0.3201    94.6700   144.8373
3565952.0 / 36489290
 193     0.0010     0.0001   100.0000     0.3204    94.6800   144.7812
3565597.0 / 36489290
 194     0.0010     0.0001   100.0000     0.3208    94.6600   144.8659
3565252.0 / 36489290
 195     0.0010     0.0001   100.0000     0.3171    94.5600   144.8434
3564965.0 / 36489290
 196     0.0010     0.0001   100.0000     0.3195    94.5500   144.8296
3564611.0 / 36489290
 197     0.0010     0.0001   100.0000     0.3159    94.5900   144.8728
3564291.0 / 36489290
 198     0.0010     0.0001   100.0000     0.3169    94.5900   144.8187
3563963.0 / 36489290
 199     0.0010     0.0001   100.0000     0.3168    94.6700   144.8237
3563637.0 / 36489290
 200     0.0010     0.0001   100.0000     0.3174    94.6100   144.9806

