Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.6
)
Resume training from cifar100_save/endpoints/WideResNet28x10-2/sgd/checkpoint-0.pt
total epochs: 200
29388927.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4360    46.7380     1.6968    41.6100    99.7233
25742514.0 / 36489290
   2     0.1000     0.9158    67.2620     1.3647    59.5600    96.9143
22800107.0 / 36489290
   3     0.1000     0.6980    75.7120     0.9121    70.5700    96.8924
20240754.0 / 36489290
   4     0.1000     0.5761    80.0120     1.2772    64.1900    97.0289
17939104.0 / 36489290
   5     0.1000     0.4946    82.7900     1.1151    67.9900    96.9579
15835943.0 / 36489290
   6     0.1000     0.4407    84.8800     0.5715    80.2400    96.6010
13912964.0 / 36489290
   7     0.1000     0.3981    86.2840     0.6496    79.2400    96.9251
12188609.0 / 36489290
   8     0.1000     0.3684    87.4140     0.5690    81.3600    96.4736
10678823.0 / 36489290
   9     0.1000     0.3363    88.4040     0.5727    81.8600    96.4839
9414686.0 / 36489290
  10     0.1000     0.3119    89.3040     0.7420    79.0600    96.4375
8384952.0 / 36489290
  11     0.1000     0.2910    89.9800     0.4167    86.5600    96.4055
7571759.0 / 36489290
  12     0.1000     0.2708    90.6720     0.5748    82.7700    96.2157
6928663.0 / 36489290
  13     0.1000     0.2570    91.1120     0.5395    83.5800    96.2266
6415447.0 / 36489290
  14     0.1000     0.2392    91.7060     0.5204    83.9700    96.2309
5997281.0 / 36489290
  15     0.1000     0.2226    92.1700     0.5111    84.4100    95.9305
5661070.0 / 36489290
  16     0.1000     0.2102    92.7020     0.8086    78.5500    95.9724
5368580.0 / 36489290
  17     0.1000     0.1943    93.1820     0.4215    86.6400    95.9890
5115861.0 / 36489290
  18     0.1000     0.1835    93.7460     0.8120    79.8800    96.0221
4907221.0 / 36489290
  19     0.1000     0.1713    94.1180     0.7497    79.2300    96.0466
4722278.0 / 36489290
  20     0.1000     0.1638    94.2800     0.5971    82.8700    96.2688
4560113.0 / 36489290
  21     0.1000     0.1534    94.6480     0.4003    88.5200    95.9366
4417053.0 / 36489290
  22     0.1000     0.1403    95.0300     0.4591    86.9200    96.0552
4290780.0 / 36489290
  23     0.1000     0.1341    95.3100     0.3831    89.3300    95.9823
4175964.0 / 36489290
  24     0.1000     0.1268    95.5840     0.8816    78.9000    96.1443
4069565.0 / 36489290
  25     0.1000     0.1196    95.7400     0.4029    87.6800    95.8731
3969030.0 / 36489290
  26     0.1000     0.1120    96.1020     0.4050    88.8900    96.0234
3881514.0 / 36489290
  27     0.1000     0.1074    96.1480     0.3562    90.3300    96.0547
3802322.0 / 36489290
  28     0.1000     0.1028    96.3860     0.3644    90.0300    96.1079
3715719.0 / 36489290
  29     0.1000     0.0918    96.7780     0.4280    88.5500    95.9256
3641836.0 / 36489290
  30     0.1000     0.0918    96.7880     0.3789    89.6700    95.9183
3576157.0 / 36489290
  31     0.1000     0.0880    96.9160     0.5729    85.2700    95.8152
3508212.0 / 36489290
  32     0.1000     0.0779    97.3160     0.4727    88.8300    95.9856
3448665.0 / 36489290
  33     0.1000     0.0770    97.2620     0.4064    89.7000    95.9373
3393658.0 / 36489290
  34     0.1000     0.0756    97.3900     0.4211    88.8700    96.0088
3334138.0 / 36489290
  35     0.1000     0.0675    97.6200     0.3621    90.7700    95.9544
3279663.0 / 36489290
  36     0.1000     0.0668    97.6500     0.3894    90.2400    96.0328
3231645.0 / 36489290
  37     0.1000     0.0681    97.6000     0.3885    90.3300    96.1251
3179647.0 / 36489290
  38     0.1000     0.0588    97.9620     0.3145    91.8400    95.9911
3130986.0 / 36489290
  39     0.1000     0.0570    98.0260     0.3728    91.0300    95.9412
3086726.0 / 36489290
  40     0.1000     0.0555    98.0300     0.4676    88.6100    95.9338
3041750.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0533    98.1940     0.3807    90.8000    96.0974
2997592.0 / 36489290
  42     0.1000     0.0527    98.0980     0.5057    89.2800    95.8904
2960197.0 / 36489290
  43     0.1000     0.0506    98.2340     0.7319    86.1200    96.0063
2909331.0 / 36489290
  44     0.1000     0.0435    98.5260     0.4465    89.9100    95.8684
2869837.0 / 36489290
  45     0.1000     0.0430    98.5360     0.4225    90.7100    95.8820
2833898.0 / 36489290
  46     0.1000     0.0456    98.4160     0.3822    90.9600    95.8907
2792531.0 / 36489290
  47     0.1000     0.0380    98.6900     0.4551    90.0600    96.0189
2767189.0 / 36489290
  48     0.1000     0.0461    98.4200     0.4764    89.0500    95.9168
2738329.0 / 36489290
  49     0.1000     0.0436    98.4680     0.3506    91.7300    95.8452
2702242.0 / 36489290
  50     0.1000     0.0379    98.7140     0.5263    88.5800    95.8890
2670663.0 / 36489290
  51     0.1000     0.0384    98.6500     0.3040    92.6100    95.8963
2644212.0 / 36489290
  52     0.1000     0.0396    98.6320     0.4494    90.0800    95.7924
2612345.0 / 36489290
  53     0.1000     0.0372    98.7280     0.4210    90.6100    95.6886
2579176.0 / 36489290
  54     0.1000     0.0340    98.8180     0.4142    91.1900    95.7136
2549087.0 / 36489290
  55     0.1000     0.0325    98.9560     0.4747    89.8700    95.7745
2525402.0 / 36489290
  56     0.1000     0.0334    98.8480     0.4427    90.2700    95.6623
2502235.0 / 36489290
  57     0.1000     0.0350    98.8080     0.3546    92.1600    95.8060
2483935.0 / 36489290
  58     0.1000     0.0381    98.7020     0.3337    92.1600    95.8789
2454937.0 / 36489290
  59     0.1000     0.0289    99.0420     0.3664    91.9000    95.8679
2438585.0 / 36489290
  60     0.1000     0.0351    98.7540     0.5042    88.7300    95.7523
2410536.0 / 36489290
  61     0.1000     0.0292    99.0100     0.3386    92.4600    95.9739
2389061.0 / 36489290
  62     0.1000     0.0309    98.9680     0.3140    92.8800    95.9407
2352678.0 / 36489290
  63     0.1000     0.0207    99.3700     0.4812    90.8600    95.8409
2335293.0 / 36489290
  64     0.1000     0.0309    98.8860     0.3575    91.8600    95.8951
2303729.0 / 36489290
  65     0.1000     0.0217    99.3000     0.3575    92.2200    95.9477
2287904.0 / 36489290
  66     0.1000     0.0277    99.0540     0.3397    92.5900    95.8676
2263033.0 / 36489290
  67     0.1000     0.0246    99.1900     0.3197    92.6300    95.7964
2256407.0 / 36489290
  68     0.1000     0.0312    98.8880     0.4978    90.2500    95.9194
2244448.0 / 36489290
  69     0.1000     0.0301    98.9200     0.3060    92.8700    95.7882
2215972.0 / 36489290
  70     0.1000     0.0215    99.3140     0.3538    92.0700    95.5626
2198601.0 / 36489290
  71     0.1000     0.0264    99.0960     0.3765    91.9600    95.6121
2178159.0 / 36489290
  72     0.1000     0.0242    99.1940     0.3749    91.7900    95.7094
2170967.0 / 36489290
  73     0.1000     0.0306    98.9180     0.4138    91.2400    95.7269
2154271.0 / 36489290
  74     0.1000     0.0246    99.1920     0.3580    92.1400    95.8259
2135823.0 / 36489290
  75     0.1000     0.0219    99.2700     0.6102    89.4200    95.9120
2120575.0 / 36489290
  76     0.1000     0.0232    99.1860     0.3870    91.9000    95.8079
2102530.0 / 36489290
  77     0.1000     0.0218    99.2540     0.3762    92.3600    95.7559
2094213.0 / 36489290
  78     0.1000     0.0279    99.0360     0.3447    92.9200    95.7118
2067298.0 / 36489290
  79     0.1000     0.0169    99.4760     0.3449    92.8500    95.7578
2047899.0 / 36489290
  80     0.1000     0.0184    99.3740     0.4241    91.2600    95.7870
2037107.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0243    99.2260     0.4992    90.1900    95.7275
2015958.0 / 36489290
  82     0.1000     0.0171    99.4420     0.4536    90.8900    95.8092
2002961.0 / 36489290
  83     0.1000     0.0208    99.3040     0.6612    89.0700    95.7354
1985539.0 / 36489290
  84     0.1000     0.0180    99.4160     0.3733    92.2800    95.6552
1978801.0 / 36489290
  85     0.1000     0.0235    99.1520     0.5226    90.1000    95.7367
1966211.0 / 36489290
  86     0.1000     0.0207    99.2840     0.4173    91.4200    95.7511
1944832.0 / 36489290
  87     0.1000     0.0149    99.5040     0.3342    92.8200    95.8280
1929976.0 / 36489290
  88     0.1000     0.0176    99.4060     0.3331    92.9600    95.7655
1912622.0 / 36489290
  89     0.1000     0.0156    99.5120     0.3633    92.4700    95.6328
1911367.0 / 36489290
  90     0.1000     0.0241    99.2180     0.4464    91.2100    95.5508
1902918.0 / 36489290
  91     0.1000     0.0204    99.3280     0.4454    91.2800    95.7214
1890412.0 / 36489290
  92     0.1000     0.0186    99.3940     0.4373    91.8600    95.6711
1883475.0 / 36489290
  93     0.1000     0.0212    99.2840     0.3645    92.2700    95.7001
1864259.0 / 36489290
  94     0.1000     0.0134    99.5680     0.4764    91.4900    95.8853
1858105.0 / 36489290
  95     0.1000     0.0208    99.2400     0.3702    92.5600    95.6523
1845894.0 / 36489290
  96     0.1000     0.0177    99.4340     0.4940    90.4600    95.6324
1828487.0 / 36489290
  97     0.1000     0.0138    99.5700     0.3597    92.8600    95.6642
1820119.0 / 36489290
  98     0.1000     0.0177    99.4060     0.3370    92.8500    95.6028
1805900.0 / 36489290
  99     0.1000     0.0151    99.5140     0.3985    92.4300    95.5805
1810695.0 / 36489290
 100     0.1000     0.0246    99.1440     0.5375    89.8600    95.7001
1796725.0 / 36489290
 101     0.0988     0.0165    99.4620     0.3464    93.1800    95.8329
1774591.0 / 36489290
 102     0.0975     0.0100    99.7020     0.4454    91.0900    95.8996
1757532.0 / 36489290
 103     0.0963     0.0115    99.6220     0.3857    92.5000    95.9033
1740424.0 / 36489290
 104     0.0950     0.0115    99.6620     0.3432    92.8800    96.0722
1725650.0 / 36489290
 105     0.0938     0.0120    99.6040     0.3496    92.4900    95.8430
1704751.0 / 36489290
 106     0.0926     0.0084    99.7440     0.3528    92.9200    96.1449
1689851.0 / 36489290
 107     0.0913     0.0104    99.6400     0.3728    92.7500    95.7816
1678184.0 / 36489290
 108     0.0901     0.0124    99.5840     0.3760    92.9600    95.8651
1665845.0 / 36489290
 109     0.0889     0.0119    99.6260     0.3562    92.8100    95.7567
1653511.0 / 36489290
 110     0.0876     0.0110    99.6280     0.4006    92.6600    95.8366
1637107.0 / 36489290
 111     0.0864     0.0084    99.7400     0.4782    91.4500    95.6367
1621935.0 / 36489290
 112     0.0852     0.0078    99.7480     0.3687    92.7100    95.5418
1606963.0 / 36489290
 113     0.0839     0.0081    99.7400     0.3566    93.2300    95.6821
1588897.0 / 36489290
 114     0.0827     0.0059    99.8160     0.3639    93.1000    95.5157
1577221.0 / 36489290
 115     0.0814     0.0092    99.6940     0.3503    92.8800    95.5293
1565000.0 / 36489290
 116     0.0802     0.0082    99.7200     0.3393    93.2800    95.5706
1555291.0 / 36489290
 117     0.0790     0.0096    99.6960     0.3742    93.0900    95.6405
1545568.0 / 36489290
 118     0.0777     0.0088    99.7160     0.3077    93.7700    95.7695
1530044.0 / 36489290
 119     0.0765     0.0058    99.8240     0.3250    93.6900    95.6220
1512330.0 / 36489290
 120     0.0753     0.0041    99.8780     0.3111    93.8800    95.5943
1494328.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0037    99.9020     0.3641    92.8400    95.4622
1481767.0 / 36489290
 122     0.0728     0.0056    99.8260     0.3630    93.5200    95.4417
1468214.0 / 36489290
 123     0.0715     0.0050    99.8200     0.3477    93.5300    95.5111
1453155.0 / 36489290
 124     0.0703     0.0036    99.9060     0.3214    94.1800    95.4840
1436672.0 / 36489290
 125     0.0691     0.0026    99.9200     0.3378    93.8500    95.5733
1419941.0 / 36489290
 126     0.0678     0.0022    99.9340     0.3268    93.9700    95.5530
1405453.0 / 36489290
 127     0.0666     0.0031    99.9180     0.4375    92.5000    95.5134
1392578.0 / 36489290
 128     0.0654     0.0037    99.9080     0.3698    93.5800    95.4597
1379939.0 / 36489290
 129     0.0641     0.0033    99.9040     0.3419    93.9900    95.5435
1368368.0 / 36489290
 130     0.0629     0.0031    99.9080     0.3427    93.8500    95.4951
1354480.0 / 36489290
 131     0.0616     0.0022    99.9400     0.3425    93.6800    95.5214
1341893.0 / 36489290
 132     0.0604     0.0022    99.9420     0.3474    93.6400    95.5701
1331896.0 / 36489290
 133     0.0592     0.0035    99.8800     0.3176    94.0300    95.7372
1321717.0 / 36489290
 134     0.0579     0.0035    99.8960     0.3508    93.9300    95.6070
1314534.0 / 36489290
 135     0.0567     0.0043    99.8760     0.3891    93.1200    95.5475
1308217.0 / 36489290
 136     0.0554     0.0053    99.8520     0.3350    93.8000    95.6346
1297150.0 / 36489290
 137     0.0542     0.0022    99.9420     0.3417    93.7200    95.8613
1288434.0 / 36489290
 138     0.0530     0.0026    99.9240     0.3678    93.6900    95.6226
1280885.0 / 36489290
 139     0.0517     0.0034    99.9020     0.3498    93.7300    95.5030
1270830.0 / 36489290
 140     0.0505     0.0022    99.9340     0.3524    93.5000    95.5632
1261052.0 / 36489290
 141     0.0493     0.0019    99.9480     0.3496    93.9000    95.6765
1253773.0 / 36489290
 142     0.0480     0.0029    99.9000     0.3694    93.5400    95.7525
1244781.0 / 36489290
 143     0.0468     0.0015    99.9680     0.3431    94.0200    95.5591
1234797.0 / 36489290
 144     0.0456     0.0011    99.9780     0.3339    94.0600    95.4254
1225727.0 / 36489290
 145     0.0443     0.0013    99.9700     0.3352    94.0300    95.4959
1216500.0 / 36489290
 146     0.0431     0.0008    99.9860     0.3446    93.9700    95.4299
1207623.0 / 36489290
 147     0.0418     0.0011    99.9740     0.3412    93.9500    95.3883
1199040.0 / 36489290
 148     0.0406     0.0009    99.9800     0.3326    93.9900    95.4555
1190528.0 / 36489290
 149     0.0394     0.0007    99.9900     0.3406    94.1600    95.6068
1182483.0 / 36489290
 150     0.0381     0.0005    99.9940     0.3368    94.2700    95.8339
1174225.0 / 36489290
 151     0.0369     0.0003   100.0000     0.3292    94.3400    95.6736
1166447.0 / 36489290
 152     0.0357     0.0003    99.9960     0.3316    94.1900    95.8834
1159171.0 / 36489290
 153     0.0344     0.0004    99.9900     0.3407    94.3300    96.0133
1151941.0 / 36489290
 154     0.0332     0.0005    99.9920     0.3226    94.3000    95.7191
1145218.0 / 36489290
 155     0.0319     0.0003    99.9980     0.3286    94.2400    95.7962
1138519.0 / 36489290
 156     0.0307     0.0003    99.9920     0.3318    94.2300    95.8557
1132608.0 / 36489290
 157     0.0295     0.0004    99.9900     0.3343    94.1700    95.8895
1126855.0 / 36489290
 158     0.0282     0.0005    99.9920     0.3326    94.2500    95.7004
1121376.0 / 36489290
 159     0.0270     0.0003   100.0000     0.3285    94.3300    95.5731
1115967.0 / 36489290
 160     0.0257     0.0003    99.9980     0.3257    94.2900    95.5067
1111031.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0002    99.9980     0.3333    94.2200    95.5057
1106285.0 / 36489290
 162     0.0233     0.0003    99.9940     0.3357    94.0400    95.5160
1101975.0 / 36489290
 163     0.0220     0.0004    99.9940     0.3315    94.2500    95.4737
1097940.0 / 36489290
 164     0.0208     0.0003    99.9940     0.3354    94.1200    95.5357
1094167.0 / 36489290
 165     0.0196     0.0003    99.9980     0.3262    94.1800    95.5778
1090727.0 / 36489290
 166     0.0183     0.0003    99.9960     0.3266    94.2100    95.6227
1087398.0 / 36489290
 167     0.0171     0.0002    99.9980     0.3310    94.1300    95.4397
1084420.0 / 36489290
 168     0.0159     0.0003    99.9960     0.3284    94.1400    95.5139
1081875.0 / 36489290
 169     0.0146     0.0002   100.0000     0.3378    94.1200    95.5643
1079608.0 / 36489290
 170     0.0134     0.0002    99.9980     0.3324    94.2000    95.6547
1077455.0 / 36489290
 171     0.0121     0.0002    99.9980     0.3272    94.1700    95.4098
1075533.0 / 36489290
 172     0.0109     0.0002    99.9980     0.3306    94.2600    95.5602
1073831.0 / 36489290
 173     0.0097     0.0001   100.0000     0.3283    94.2400    95.4979
1072357.0 / 36489290
 174     0.0084     0.0002    99.9980     0.3295    94.2800    95.7265
1071201.0 / 36489290
 175     0.0072     0.0002   100.0000     0.3272    94.3400    95.5754
1070189.0 / 36489290
 176     0.0060     0.0002   100.0000     0.3275    94.2600    95.4886
1069515.0 / 36489290
 177     0.0047     0.0002    99.9960     0.3281    94.2200    95.5217
1068900.0 / 36489290
 178     0.0035     0.0002    99.9960     0.3303    94.2000    95.5707
1068570.0 / 36489290
 179     0.0022     0.0002    99.9960     0.3294    94.2400    95.5274
1068440.0 / 36489290
 180     0.0010     0.0002   100.0000     0.3238    94.3700    95.6838
1068285.0 / 36489290
 181     0.0010     0.0002    99.9960     0.3257    94.2400    95.5376
1068114.0 / 36489290
 182     0.0010     0.0002   100.0000     0.3263    94.3700    95.5256
1067963.0 / 36489290
 183     0.0010     0.0002   100.0000     0.3253    94.1700    95.6924
1067798.0 / 36489290
 184     0.0010     0.0001   100.0000     0.3272    94.2200    95.8660
1067676.0 / 36489290
 185     0.0010     0.0002   100.0000     0.3324    94.2600    95.7254
1067498.0 / 36489290
 186     0.0010     0.0002    99.9960     0.3295    94.2700    95.7059
1067371.0 / 36489290
 187     0.0010     0.0002    99.9980     0.3278    94.3200    95.5605
1067215.0 / 36489290
 188     0.0010     0.0002    99.9980     0.3308    94.2200    95.5457
1067065.0 / 36489290
 189     0.0010     0.0002   100.0000     0.3255    94.2800    95.7115
1066916.0 / 36489290
 190     0.0010     0.0001   100.0000     0.3284    94.2300    95.9236
1066763.0 / 36489290
 191     0.0010     0.0002    99.9960     0.3248    94.2800    95.5320
1066600.0 / 36489290
 192     0.0010     0.0002    99.9980     0.3274    94.3000    95.5331
1066478.0 / 36489290
 193     0.0010     0.0002   100.0000     0.3289    94.1900    95.6527
1066308.0 / 36489290
 194     0.0010     0.0001   100.0000     0.3341    94.2400    95.7075
1066174.0 / 36489290
 195     0.0010     0.0002   100.0000     0.3248    94.2900    95.5273
1066023.0 / 36489290
 196     0.0010     0.0001   100.0000     0.3256    94.2500    95.6826
1065866.0 / 36489290
 197     0.0010     0.0003    99.9960     0.3254    94.2900    95.5628
1065729.0 / 36489290
 198     0.0010     0.0001   100.0000     0.3312    94.3000    95.6334
1065588.0 / 36489290
 199     0.0010     0.0002    99.9980     0.3261    94.3100    95.5192
1065448.0 / 36489290
 200     0.0010     0.0002    99.9980     0.3257    94.2400    95.5356
