Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.4
)
Resume training from cifar100_save/endpoints/WideResNet28x10-3/sgd/checkpoint-0.pt
total epochs: 200
33074094.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4386    46.5900     1.6616    44.7200    97.5603
31989934.0 / 36489290
   2     0.1000     0.9092    67.4900     1.3888    58.5600    95.0754
31203955.0 / 36489290
   3     0.1000     0.6886    76.0220     0.9046    71.1300    95.3965
30563770.0 / 36489290
   4     0.1000     0.5608    80.4140     1.0298    69.7300    95.1384
30015057.0 / 36489290
   5     0.1000     0.4777    83.4000     0.9590    71.6100    95.1873
29530980.0 / 36489290
   6     0.1000     0.4198    85.5760     0.5027    82.8700    95.4809
29092995.0 / 36489290
   7     0.1000     0.3728    87.1080     0.5314    82.6900    95.4520
28691526.0 / 36489290
   8     0.1000     0.3396    88.2160     0.5461    81.8600    95.4173
28320622.0 / 36489290
   9     0.1000     0.3047    89.3380     0.4162    86.6400    95.3620
27974104.0 / 36489290
  10     0.1000     0.2782    90.3280     0.4802    84.7600    95.4604
27647867.0 / 36489290
  11     0.1000     0.2547    91.2680     0.4155    86.8200    95.5054
27339513.0 / 36489290
  12     0.1000     0.2309    92.0060     0.5738    84.0900    95.1642
27046954.0 / 36489290
  13     0.1000     0.2163    92.4020     0.7556    79.6200    95.2919
26767943.0 / 36489290
  14     0.1000     0.2004    93.1040     0.4224    87.0300    95.2794
26500355.0 / 36489290
  15     0.1000     0.1796    93.7020     0.4489    86.5900    95.0338
26244934.0 / 36489290
  16     0.1000     0.1707    93.9600     0.4048    87.5800    95.2799
25999733.0 / 36489290
  17     0.1000     0.1516    94.6880     0.3295    89.7400    95.2245
25763937.0 / 36489290
  18     0.1000     0.1451    94.9420     0.7492    81.9700    94.9877
25535458.0 / 36489290
  19     0.1000     0.1324    95.3800     0.5119    85.9500    95.4304
25315393.0 / 36489290
  20     0.1000     0.1237    95.6120     0.7590    81.6100    95.1017
25103913.0 / 36489290
  21     0.1000     0.1136    96.0260     0.3314    90.4100    95.0327
24896787.0 / 36489290
  22     0.1000     0.1043    96.4260     0.3431    90.4000    95.2105
24695841.0 / 36489290
  23     0.1000     0.0982    96.6100     0.3722    90.0700    95.4653
24499896.0 / 36489290
  24     0.1000     0.0900    96.8440     0.6127    86.4400    95.3239
24309870.0 / 36489290
  25     0.1000     0.0879    96.8500     0.3828    89.6300    95.4194
24123472.0 / 36489290
  26     0.1000     0.0764    97.3140     0.4338    88.7200    95.4589
23944244.0 / 36489290
  27     0.1000     0.0729    97.4200     0.6514    85.8300    95.5930
23770273.0 / 36489290
  28     0.1000     0.0739    97.4360     0.4078    89.2700    95.4591
23598316.0 / 36489290
  29     0.1000     0.0614    97.8740     0.4484    89.1900    95.1136
23431710.0 / 36489290
  30     0.1000     0.0635    97.8280     0.3417    91.0400    95.3791
23268948.0 / 36489290
  31     0.1000     0.0611    97.8800     0.5147    88.2600    95.3585
23109068.0 / 36489290
  32     0.1000     0.0530    98.1280     0.3446    91.2200    95.3707
22953659.0 / 36489290
  33     0.1000     0.0487    98.3060     0.3890    90.4100    95.2170
22799924.0 / 36489290
  34     0.1000     0.0478    98.2960     0.3508    91.1700    95.1635
22649402.0 / 36489290
  35     0.1000     0.0396    98.6360     0.4003    90.9100    95.1955
22504055.0 / 36489290
  36     0.1000     0.0453    98.4580     0.3521    91.1900    95.2917
22361179.0 / 36489290
  37     0.1000     0.0433    98.3880     0.3547    91.5100    95.5202
22219458.0 / 36489290
  38     0.1000     0.0366    98.6960     0.3600    91.7500    95.5856
22078349.0 / 36489290
  39     0.1000     0.0329    98.8540     0.4163    91.4300    95.2790
21942706.0 / 36489290
  40     0.1000     0.0339    98.8280     0.3739    91.5200    95.1862
21810449.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0354    98.7960     0.3745    91.3300    95.1824
21679455.0 / 36489290
  42     0.1000     0.0299    98.9980     0.3429    92.3700    95.0708
21550120.0 / 36489290
  43     0.1000     0.0302    98.9540     0.4965    89.8800    95.0600
21421878.0 / 36489290
  44     0.1000     0.0344    98.8340     0.4401    90.4300    95.1667
21297507.0 / 36489290
  45     0.1000     0.0267    99.1240     0.3375    92.8100    95.4256
21173648.0 / 36489290
  46     0.1000     0.0244    99.1440     0.4286    91.2300    95.2052
21049595.0 / 36489290
  47     0.1000     0.0202    99.3440     0.4294    91.4900    95.2033
20929420.0 / 36489290
  48     0.1000     0.0216    99.2820     0.3500    92.3300    95.3466
20812890.0 / 36489290
  49     0.1000     0.0239    99.2020     0.4720    90.5200    95.1881
20695442.0 / 36489290
  50     0.1000     0.0220    99.2180     0.4973    89.4700    95.2858
20582590.0 / 36489290
  51     0.1000     0.0232    99.2260     0.3671    92.3100    94.9798
20469084.0 / 36489290
  52     0.1000     0.0195    99.3640     0.4693    90.8700    95.1640
20358851.0 / 36489290
  53     0.1000     0.0206    99.2780     0.3490    92.7600    95.1328
20247020.0 / 36489290
  54     0.1000     0.0171    99.4120     0.3837    91.7600    95.1995
20138905.0 / 36489290
  55     0.1000     0.0172    99.4660     0.3424    92.8500    95.1861
20034288.0 / 36489290
  56     0.1000     0.0212    99.2700     0.4107    91.4400    94.8965
19928253.0 / 36489290
  57     0.1000     0.0155    99.4940     0.3222    92.8400    95.1872
19824339.0 / 36489290
  58     0.1000     0.0159    99.4600     0.3373    92.6900    95.2015
19720379.0 / 36489290
  59     0.1000     0.0140    99.5200     0.3410    92.8600    95.2724
19617186.0 / 36489290
  60     0.1000     0.0135    99.5480     0.6878    88.2400    95.0782
19517109.0 / 36489290
  61     0.1000     0.0140    99.5180     0.4498    91.6600    94.9677
19420251.0 / 36489290
  62     0.1000     0.0206    99.2380     0.3980    92.1400    95.0678
19325336.0 / 36489290
  63     0.1000     0.0171    99.4060     0.3657    92.6200    95.1829
19231993.0 / 36489290
  64     0.1000     0.0211    99.2800     0.3410    92.5800    95.0559
19137404.0 / 36489290
  65     0.1000     0.0143    99.5540     0.7597    87.6400    95.0949
19042058.0 / 36489290
  66     0.1000     0.0126    99.5960     0.3982    92.3200    95.1114
18948481.0 / 36489290
  67     0.1000     0.0123    99.6000     0.3807    92.2100    95.0745
18857734.0 / 36489290
  68     0.1000     0.0147    99.4960     0.4008    92.3800    95.1152
18767640.0 / 36489290
  69     0.1000     0.0137    99.5420     0.3456    93.0300    95.1367
18675945.0 / 36489290
  70     0.1000     0.0110    99.6640     0.3508    92.8600    95.1186
18587498.0 / 36489290
  71     0.1000     0.0127    99.5800     0.3721    92.5800    94.9104
18498309.0 / 36489290
  72     0.1000     0.0097    99.6820     0.3747    92.7900    95.0674
18409555.0 / 36489290
  73     0.1000     0.0088    99.7140     0.4612    91.8600    95.3402
18326046.0 / 36489290
  74     0.1000     0.0143    99.4640     0.4694    91.1200    94.9535
18240495.0 / 36489290
  75     0.1000     0.0096    99.6920     0.3954    92.7000    95.0165
18156656.0 / 36489290
  76     0.1000     0.0102    99.6620     0.3945    92.5700    95.3802
18074798.0 / 36489290
  77     0.1000     0.0115    99.6300     0.3684    92.9100    95.3967
17990713.0 / 36489290
  78     0.1000     0.0081    99.7480     0.3389    93.2200    95.0521
17909343.0 / 36489290
  79     0.1000     0.0102    99.6720     0.3542    93.0800    95.1231
17827374.0 / 36489290
  80     0.1000     0.0080    99.7560     0.4558    91.7500    95.2247
17750066.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0135    99.5620     0.4576    91.6600    95.5486
17672772.0 / 36489290
  82     0.1000     0.0118    99.5880     0.3925    92.2700    95.2480
17592366.0 / 36489290
  83     0.1000     0.0068    99.8120     0.3472    93.1800    95.2667
17512581.0 / 36489290
  84     0.1000     0.0062    99.8020     0.3996    92.4000    95.0863
17440768.0 / 36489290
  85     0.1000     0.0125    99.5940     0.3991    92.5100    95.1660
17365343.0 / 36489290
  86     0.1000     0.0108    99.6520     0.3595    93.0400    95.2320
17287260.0 / 36489290
  87     0.1000     0.0062    99.8080     0.3852    92.7700    95.3029
17216232.0 / 36489290
  88     0.1000     0.0109    99.6400     0.3688    92.8000    95.0638
17140108.0 / 36489290
  89     0.1000     0.0067    99.7880     0.3593    93.1200    95.0860
17066295.0 / 36489290
  90     0.1000     0.0065    99.7920     0.3362    93.3900    94.9807
16990842.0 / 36489290
  91     0.1000     0.0061    99.8180     0.3506    93.1500    95.0393
16917135.0 / 36489290
  92     0.1000     0.0055    99.8580     0.4189    92.2900    94.9776
16842999.0 / 36489290
  93     0.1000     0.0039    99.8880     0.3361    93.6100    95.0843
16767394.0 / 36489290
  94     0.1000     0.0020    99.9580     0.3456    93.5900    95.1936
16696089.0 / 36489290
  95     0.1000     0.0063    99.7900     0.3789    93.2700    94.8536
16627759.0 / 36489290
  96     0.1000     0.0074    99.7800     0.3879    92.8700    95.1879
16562492.0 / 36489290
  97     0.1000     0.0098    99.6720     0.4177    92.3900    95.0721
16496672.0 / 36489290
  98     0.1000     0.0090    99.6800     0.3722    92.8300    95.1385
16429713.0 / 36489290
  99     0.1000     0.0063    99.7940     0.4898    91.4800    95.0904
16369472.0 / 36489290
 100     0.1000     0.0114    99.5900     0.4310    92.1800    94.9452
16306896.0 / 36489290
 101     0.0988     0.0098    99.6700     0.3844    93.1000    94.8333
16239592.0 / 36489290
 102     0.0975     0.0042    99.8820     0.3485    93.3500    94.7635
16174804.0 / 36489290
 103     0.0963     0.0041    99.8740     0.3639    93.1500    94.9492
16110622.0 / 36489290
 104     0.0950     0.0039    99.8740     0.3591    93.2800    94.9342
16047379.0 / 36489290
 105     0.0938     0.0038    99.8800     0.3375    93.5200    94.9209
15986158.0 / 36489290
 106     0.0926     0.0040    99.8680     0.3494    93.5600    94.9249
15922543.0 / 36489290
 107     0.0913     0.0019    99.9560     0.3812    93.1200    95.0125
15860291.0 / 36489290
 108     0.0901     0.0012    99.9740     0.3342    94.0000    95.0790
15798800.0 / 36489290
 109     0.0889     0.0014    99.9720     0.3548    93.6800    95.0827
15738516.0 / 36489290
 110     0.0876     0.0016    99.9540     0.3464    93.7500    95.2412
15680487.0 / 36489290
 111     0.0864     0.0015    99.9600     0.3708    93.7100    95.3540
15622909.0 / 36489290
 112     0.0852     0.0012    99.9740     0.3472    93.8800    95.1957
15566774.0 / 36489290
 113     0.0839     0.0014    99.9580     0.4097    93.0700    95.0798
15511614.0 / 36489290
 114     0.0827     0.0014    99.9700     0.3877    93.3700    95.1230
15458411.0 / 36489290
 115     0.0814     0.0021    99.9320     0.3768    93.4600    95.1194
15405309.0 / 36489290
 116     0.0802     0.0013    99.9680     0.3664    93.6900    95.2941
15353488.0 / 36489290
 117     0.0790     0.0010    99.9760     0.3558    93.6200    95.0490
15302480.0 / 36489290
 118     0.0777     0.0011    99.9780     0.3559    93.8000    95.0889
15252286.0 / 36489290
 119     0.0765     0.0009    99.9800     0.3878    93.4200    94.8866
15203423.0 / 36489290
 120     0.0753     0.0006    99.9920     0.3344    94.0500    95.0678
15154034.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0004    99.9940     0.3342    93.9400    95.1826
15106122.0 / 36489290
 122     0.0728     0.0007    99.9880     0.3333    94.0700    95.1116
15059535.0 / 36489290
 123     0.0715     0.0006    99.9840     0.3326    94.0300    95.0321
15014189.0 / 36489290
 124     0.0703     0.0006    99.9840     0.3430    93.9700    94.9308
14969662.0 / 36489290
 125     0.0691     0.0004    99.9920     0.3364    94.1500    94.9990
14926042.0 / 36489290
 126     0.0678     0.0004    99.9880     0.3430    93.8900    94.8311
14883581.0 / 36489290
 127     0.0666     0.0004    99.9960     0.3365    94.1000    94.9313
14841341.0 / 36489290
 128     0.0654     0.0002   100.0000     0.3359    94.2000    94.9870
14800672.0 / 36489290
 129     0.0641     0.0002    99.9980     0.3342    94.1400    95.0334
14760763.0 / 36489290
 130     0.0629     0.0002    99.9980     0.3360    94.0800    94.8288
14721766.0 / 36489290
 131     0.0616     0.0002    99.9980     0.3304    94.2200    94.9952
14683364.0 / 36489290
 132     0.0604     0.0002   100.0000     0.3298    94.0900    94.8068
14646041.0 / 36489290
 133     0.0592     0.0002    99.9980     0.3401    94.1400    94.9574
14609777.0 / 36489290
 134     0.0579     0.0003    99.9920     0.3343    94.2300    95.0188
14573984.0 / 36489290
 135     0.0567     0.0002   100.0000     0.3365    94.0900    95.0544
14539457.0 / 36489290
 136     0.0554     0.0002    99.9980     0.3330    94.2600    95.0194
14506076.0 / 36489290
 137     0.0542     0.0001   100.0000     0.3336    94.2500    95.0962
14473515.0 / 36489290
 138     0.0530     0.0001   100.0000     0.3321    94.2700    95.1811
14441433.0 / 36489290
 139     0.0517     0.0002   100.0000     0.3254    94.2600    95.0542
14410185.0 / 36489290
 140     0.0505     0.0002    99.9960     0.3294    94.3000    94.8667
14379785.0 / 36489290
 141     0.0493     0.0002    99.9980     0.3325    94.2200    95.1006
14350392.0 / 36489290
 142     0.0480     0.0001   100.0000     0.3314    94.2100    95.1485
14321790.0 / 36489290
 143     0.0468     0.0001   100.0000     0.3344    94.1200    95.0063
14293910.0 / 36489290
 144     0.0456     0.0001   100.0000     0.3306    94.2500    95.1569
14266902.0 / 36489290
 145     0.0443     0.0001   100.0000     0.3285    94.2200    94.8608
14240832.0 / 36489290
 146     0.0431     0.0001   100.0000     0.3308    94.1700    94.9710
14215897.0 / 36489290
 147     0.0418     0.0001    99.9960     0.3312    94.2400    95.0133
14191405.0 / 36489290
 148     0.0406     0.0001   100.0000     0.3281    94.3000    95.0259
14167888.0 / 36489290
 149     0.0394     0.0001   100.0000     0.3303    94.3100    94.9588
14144823.0 / 36489290
 150     0.0381     0.0001   100.0000     0.3277    94.4600    95.0123
14122688.0 / 36489290
 151     0.0369     0.0001   100.0000     0.3277    94.3000    94.9129
14101213.0 / 36489290
 152     0.0357     0.0001   100.0000     0.3280    94.2800    94.9724
14080823.0 / 36489290
 153     0.0344     0.0001   100.0000     0.3322    94.2200    94.9320
14061122.0 / 36489290
 154     0.0332     0.0001    99.9980     0.3270    94.2700    94.8951
14041951.0 / 36489290
 155     0.0319     0.0001    99.9960     0.3322    94.1900    94.9973
14023658.0 / 36489290
 156     0.0307     0.0001    99.9980     0.3296    94.1800    95.1426
14006281.0 / 36489290
 157     0.0295     0.0001   100.0000     0.3263    94.1900    95.1552
13989096.0 / 36489290
 158     0.0282     0.0001    99.9980     0.3326    94.2700    95.1089
13973131.0 / 36489290
 159     0.0270     0.0001   100.0000     0.3383    94.1300    95.0253
13957739.0 / 36489290
 160     0.0257     0.0001   100.0000     0.3311    94.2500    95.0976
13943040.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0001   100.0000     0.3325    94.2500    95.0718
13929041.0 / 36489290
 162     0.0233     0.0001    99.9980     0.3322    94.1600    95.1650
13915973.0 / 36489290
 163     0.0220     0.0001    99.9980     0.3302    94.2000    95.2017
13903718.0 / 36489290
 164     0.0208     0.0001   100.0000     0.3284    94.2600    95.2839
13892134.0 / 36489290
 165     0.0196     0.0001   100.0000     0.3254    94.3000    94.7895
13881261.0 / 36489290
 166     0.0183     0.0001   100.0000     0.3281    94.2600    95.2471
13871057.0 / 36489290
 167     0.0171     0.0001   100.0000     0.3340    94.2400    95.1283
13861423.0 / 36489290
 168     0.0159     0.0001   100.0000     0.3275    94.3100    95.1071
13852688.0 / 36489290
 169     0.0146     0.0001   100.0000     0.3312    94.3200    95.2082
13844700.0 / 36489290
 170     0.0134     0.0001   100.0000     0.3301    94.3500    95.0722
13837505.0 / 36489290
 171     0.0121     0.0001    99.9980     0.3274    94.2500    94.8810
13830871.0 / 36489290
 172     0.0109     0.0001   100.0000     0.3274    94.3200    94.9618
13825088.0 / 36489290
 173     0.0097     0.0001   100.0000     0.3314    94.3100    94.8386
13819833.0 / 36489290
 174     0.0084     0.0001   100.0000     0.3251    94.2900    94.9202
13815529.0 / 36489290
 175     0.0072     0.0001   100.0000     0.3247    94.3800    95.0383
13811901.0 / 36489290
 176     0.0060     0.0001   100.0000     0.3269    94.2600    94.9084
13809007.0 / 36489290
 177     0.0047     0.0001   100.0000     0.3278    94.3100    94.9781
13806830.0 / 36489290
 178     0.0035     0.0001   100.0000     0.3321    94.3400    95.1053
13805312.0 / 36489290
 179     0.0022     0.0001   100.0000     0.3290    94.3000    95.2873
13804580.0 / 36489290
 180     0.0010     0.0001    99.9980     0.3209    94.3700    95.0081
13803890.0 / 36489290
 181     0.0010     0.0001   100.0000     0.3260    94.3400    94.8801
13803160.0 / 36489290
 182     0.0010     0.0001   100.0000     0.3237    94.4100    94.8125
13802510.0 / 36489290
 183     0.0010     0.0001   100.0000     0.3240    94.3900    94.8538
13801750.0 / 36489290
 184     0.0010     0.0001   100.0000     0.3269    94.2800    95.0563
13801023.0 / 36489290
 185     0.0010     0.0001   100.0000     0.3264    94.2700    94.9405
13800300.0 / 36489290
 186     0.0010     0.0001   100.0000     0.3278    94.3500    94.9927
13799569.0 / 36489290
 187     0.0010     0.0001   100.0000     0.3255    94.3800    94.9041
13798854.0 / 36489290
 188     0.0010     0.0001   100.0000     0.3304    94.2900    94.9138
13798131.0 / 36489290
 189     0.0010     0.0001   100.0000     0.3234    94.3600    94.7852
13797409.0 / 36489290
 190     0.0010     0.0001    99.9980     0.3280    94.2400    94.8072
13796684.0 / 36489290
 191     0.0010     0.0001   100.0000     0.3235    94.4300    94.7200
13795912.0 / 36489290
 192     0.0010     0.0001   100.0000     0.3253    94.2400    95.0910
13795210.0 / 36489290
 193     0.0010     0.0001   100.0000     0.3292    94.2800    94.9576
13794472.0 / 36489290
 194     0.0010     0.0001   100.0000     0.3291    94.3400    94.9961
13793714.0 / 36489290
 195     0.0010     0.0001   100.0000     0.3272    94.3300    95.4086
13792992.0 / 36489290
 196     0.0010     0.0001   100.0000     0.3236    94.3900    95.2788
13792288.0 / 36489290
 197     0.0010     0.0001    99.9980     0.3246    94.3500    94.8825
13791580.0 / 36489290
 198     0.0010     0.0001   100.0000     0.3311    94.3100    95.1228
13790841.0 / 36489290
 199     0.0010     0.0001   100.0000     0.3261    94.2100    95.0628
13790123.0 / 36489290
 200     0.0010     0.0001   100.0000     0.3298    94.2100    94.8705
