Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.501
)
Resume training from cifar100_save/endpoints/WideResNet28x10-2/sgd/checkpoint-0.pt
total epochs: 200
31546325.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4434    46.5280     1.4792    47.1100    99.7563
29505283.0 / 36489290
   2     0.1000     0.9050    67.7100     1.5793    57.6200    98.1460
27941006.0 / 36489290
   3     0.1000     0.6851    76.0980     0.9844    68.8200    98.3175
26624968.0 / 36489290
   4     0.1000     0.5593    80.5940     1.2437    66.3600    96.8800
25467899.0 / 36489290
   5     0.1000     0.4795    83.2920     1.0085    71.1500    98.9520
24423988.0 / 36489290
   6     0.1000     0.4216    85.5540     0.5907    79.6200    99.0111
23465321.0 / 36489290
   7     0.1000     0.3785    86.9660     0.5591    82.2900    98.4973
22577127.0 / 36489290
   8     0.1000     0.3425    88.1420     0.5883    80.9400    98.5873
21742833.0 / 36489290
   9     0.1000     0.3113    89.1960     0.5261    83.4700    98.7024
20958289.0 / 36489290
  10     0.1000     0.2847    90.1400     0.5643    83.4500    98.3968
20217879.0 / 36489290
  11     0.1000     0.2608    91.0000     0.4539    85.7300    98.8041
19513016.0 / 36489290
  12     0.1000     0.2403    91.5560     0.4497    85.9300    98.5325
18845311.0 / 36489290
  13     0.1000     0.2242    92.3260     0.4528    85.7000    98.0000
18208217.0 / 36489290
  14     0.1000     0.2106    92.5700     0.5315    83.9000    97.8145
17602771.0 / 36489290
  15     0.1000     0.1910    93.3880     0.4599    86.0900    97.3353
17024954.0 / 36489290
  16     0.1000     0.1790    93.7580     0.4642    85.5300    97.4591
16476723.0 / 36489290
  17     0.1000     0.1632    94.3480     0.3705    88.6500    96.2131
15953523.0 / 36489290
  18     0.1000     0.1583    94.4740     0.4309    88.0500    96.1415
15458816.0 / 36489290
  19     0.1000     0.1427    95.0700     0.4645    86.0700    97.1217
14988241.0 / 36489290
  20     0.1000     0.1360    95.1860     0.5694    84.4600    97.6717
14542614.0 / 36489290
  21     0.1000     0.1283    95.4860     0.5110    86.4500    97.4779
14116215.0 / 36489290
  22     0.1000     0.1134    96.1160     0.4636    87.2500    97.8882
13715310.0 / 36489290
  23     0.1000     0.1125    96.0280     0.3204    90.7400    97.4734
13335226.0 / 36489290
  24     0.1000     0.1027    96.3900     0.4622    87.2700    97.7671
12976240.0 / 36489290
  25     0.1000     0.0979    96.6260     0.3881    89.0300    98.3352
12633688.0 / 36489290
  26     0.1000     0.0892    96.9360     0.3485    90.4600    97.3037
12312273.0 / 36489290
  27     0.1000     0.0876    96.9060     0.3598    90.2600    97.4473
12010075.0 / 36489290
  28     0.1000     0.0823    97.1460     0.3871    89.5900    98.1092
11719798.0 / 36489290
  29     0.1000     0.0717    97.4940     0.6168    85.9000    96.6931
11445772.0 / 36489290
  30     0.1000     0.0742    97.3940     0.3327    91.0200    98.2755
11189988.0 / 36489290
  31     0.1000     0.0709    97.5140     0.5105    87.2900    96.2208
10946707.0 / 36489290
  32     0.1000     0.0642    97.7480     0.3984    90.1000    98.1679
10710711.0 / 36489290
  33     0.1000     0.0585    97.9720     0.3245    91.8300    97.6124
10493999.0 / 36489290
  34     0.1000     0.0603    97.8440     0.3879    90.2700    98.3009
10278788.0 / 36489290
  35     0.1000     0.0516    98.2900     0.4102    90.4500    98.3724
10088957.0 / 36489290
  36     0.1000     0.0571    98.0120     0.7041    84.4100    98.2576
9899325.0 / 36489290
  37     0.1000     0.0509    98.2240     0.3939    90.6600    97.9945
9719669.0 / 36489290
  38     0.1000     0.0466    98.3500     0.3320    91.9000    98.1237
9553531.0 / 36489290
  39     0.1000     0.0507    98.2560     0.3456    91.4200    96.8122
9384941.0 / 36489290
  40     0.1000     0.0424    98.5660     0.4738    88.9800    96.0252
9229431.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0415    98.5920     0.4540    89.9700    96.0750
9081004.0 / 36489290
  42     0.1000     0.0418    98.5760     0.5272    89.1200    96.4180
8939024.0 / 36489290
  43     0.1000     0.0396    98.6460     0.4287    90.5000    97.6795
8807763.0 / 36489290
  44     0.1000     0.0382    98.7040     0.4698    89.3900    97.2658
8673624.0 / 36489290
  45     0.1000     0.0345    98.8280     0.4196    90.7700    97.9441
8543712.0 / 36489290
  46     0.1000     0.0327    98.8900     0.3920    91.1800    98.0364
8423570.0 / 36489290
  47     0.1000     0.0339    98.8220     0.4154    90.5400    98.2118
8307423.0 / 36489290
  48     0.1000     0.0334    98.9020     0.3555    91.5600    98.0133
8190933.0 / 36489290
  49     0.1000     0.0292    99.0320     0.3602    91.9500    97.4228
8082671.0 / 36489290
  50     0.1000     0.0303    99.0060     0.3917    91.1600    98.1310
7976328.0 / 36489290
  51     0.1000     0.0291    99.0520     0.4127    90.6900    97.2771
7874915.0 / 36489290
  52     0.1000     0.0278    99.0400     0.3569    92.2500    96.5600
7775752.0 / 36489290
  53     0.1000     0.0275    99.0920     0.3659    92.2100    98.2263
7682301.0 / 36489290
  54     0.1000     0.0263    99.0820     0.4186    91.1200    97.9550
7586198.0 / 36489290
  55     0.1000     0.0229    99.2640     0.4157    91.6300    97.5523
7495563.0 / 36489290
  56     0.1000     0.0248    99.1540     0.3494    92.2500    97.8093
7410097.0 / 36489290
  57     0.1000     0.0230    99.2440     0.5222    90.0100    97.5412
7332352.0 / 36489290
  58     0.1000     0.0245    99.1580     0.4633    90.3600    98.0466
7262095.0 / 36489290
  59     0.1000     0.0278    99.0500     0.3827    92.0200    97.8339
7179669.0 / 36489290
  60     0.1000     0.0201    99.3620     0.3549    92.5300    97.6430
7105834.0 / 36489290
  61     0.1000     0.0226    99.2280     0.3580    92.3800    98.1670
7026712.0 / 36489290
  62     0.1000     0.0198    99.3700     0.3807    92.0100    97.9387
6956034.0 / 36489290
  63     0.1000     0.0201    99.3240     0.4488    91.0500    97.3076
6901718.0 / 36489290
  64     0.1000     0.0253    99.1160     0.3512    91.9200    96.4826
6823610.0 / 36489290
  65     0.1000     0.0159    99.4840     0.4856    90.4100    97.2361
6762434.0 / 36489290
  66     0.1000     0.0209    99.2980     0.3451    92.4400    96.0731
6704832.0 / 36489290
  67     0.1000     0.0225    99.2040     0.4275    91.4200    97.3685
6640134.0 / 36489290
  68     0.1000     0.0179    99.3980     0.4213    91.7800    96.3654
6586377.0 / 36489290
  69     0.1000     0.0205    99.3080     0.4588    91.0900    97.4244
6536323.0 / 36489290
  70     0.1000     0.0224    99.2240     0.3813    92.3300    97.2640
6487344.0 / 36489290
  71     0.1000     0.0222    99.2500     0.4615    90.6600    97.3334
6435362.0 / 36489290
  72     0.1000     0.0212    99.2780     0.3443    92.7500    97.4559
6378438.0 / 36489290
  73     0.1000     0.0176    99.4360     0.3733    92.1200    97.7590
6314090.0 / 36489290
  74     0.1000     0.0139    99.5780     0.3481    93.0200    97.7255
6249143.0 / 36489290
  75     0.1000     0.0112    99.6480     0.6330    88.4200    97.3019
6197002.0 / 36489290
  76     0.1000     0.0152    99.5220     0.3608    92.2700    98.0388
6146299.0 / 36489290
  77     0.1000     0.0161    99.4660     0.4216    91.7900    97.5948
6091433.0 / 36489290
  78     0.1000     0.0130    99.5700     0.3468    93.3200    97.5904
6049401.0 / 36489290
  79     0.1000     0.0173    99.3880     0.3636    92.5500    97.6212
6009936.0 / 36489290
  80     0.1000     0.0170    99.4180     0.3821    92.2900    97.5822
5970262.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0181    99.4240     0.4866    90.5600    97.8314
5922498.0 / 36489290
  82     0.1000     0.0136    99.5340     0.4147    91.5300    97.5431
5877330.0 / 36489290
  83     0.1000     0.0138    99.5460     0.3646    92.9200    97.5430
5820523.0 / 36489290
  84     0.1000     0.0091    99.7220     0.3685    92.9300    98.4603
5776583.0 / 36489290
  85     0.1000     0.0132    99.5920     0.3461    93.0600    97.7146
5738997.0 / 36489290
  86     0.1000     0.0153    99.5180     0.3605    92.9200    97.8461
5705728.0 / 36489290
  87     0.1000     0.0163    99.4400     0.4060    91.6100    97.9263
5668885.0 / 36489290
  88     0.1000     0.0145    99.5240     0.3274    93.1300    96.1210
5629968.0 / 36489290
  89     0.1000     0.0127    99.5740     0.4062    92.1500    97.8982
5609066.0 / 36489290
  90     0.1000     0.0197    99.3340     0.3717    92.5300    97.8178
5569689.0 / 36489290
  91     0.1000     0.0118    99.6260     0.3712    93.0900    97.4272
5527363.0 / 36489290
  92     0.1000     0.0104    99.6940     0.4817    91.2100    98.1178
5491197.0 / 36489290
  93     0.1000     0.0124    99.6000     0.4165    91.9500    97.6729
5452519.0 / 36489290
  94     0.1000     0.0107    99.6420     0.3931    92.4300    95.8573
5428356.0 / 36489290
  95     0.1000     0.0145    99.4980     0.4082    92.5900    96.1651
5416714.0 / 36489290
  96     0.1000     0.0210    99.2720     0.4120    91.4800    97.8502
5389764.0 / 36489290
  97     0.1000     0.0148    99.4980     0.3631    92.7900    97.2072
5351487.0 / 36489290
  98     0.1000     0.0101    99.6920     0.3310    93.4400    97.3056
5312265.0 / 36489290
  99     0.1000     0.0092    99.6900     0.4711    91.7900    97.5471
5278053.0 / 36489290
 100     0.1000     0.0105    99.6620     0.3533    93.1800    97.9373
5245214.0 / 36489290
 101     0.0988     0.0120    99.6160     0.3613    92.7200    98.2424
5206633.0 / 36489290
 102     0.0975     0.0085    99.7400     0.3850    93.1700    97.4326
5167248.0 / 36489290
 103     0.0963     0.0074    99.7580     0.3564    93.2000    97.5097
5126589.0 / 36489290
 104     0.0950     0.0059    99.8100     0.3862    92.8100    97.9330
5089634.0 / 36489290
 105     0.0938     0.0070    99.7800     0.3752    92.6400    97.2326
5049886.0 / 36489290
 106     0.0926     0.0059    99.8180     0.3347    93.4200    98.1231
5014384.0 / 36489290
 107     0.0913     0.0069    99.7740     0.3576    93.1700    98.1622
4980999.0 / 36489290
 108     0.0901     0.0069    99.7940     0.3579    93.1200    97.7791
4944080.0 / 36489290
 109     0.0889     0.0066    99.8080     0.4027    92.7000    97.6758
4904729.0 / 36489290
 110     0.0876     0.0039    99.8900     0.3523    93.3900    97.9619
4868835.0 / 36489290
 111     0.0864     0.0047    99.8540     0.4091    92.6000    97.9982
4837096.0 / 36489290
 112     0.0852     0.0055    99.8320     0.3760    93.1700    97.6487
4803368.0 / 36489290
 113     0.0839     0.0050    99.8460     0.4059    92.9200    97.2697
4770065.0 / 36489290
 114     0.0827     0.0046    99.8720     0.3697    92.8800    97.9496
4736634.0 / 36489290
 115     0.0814     0.0043    99.8680     0.3445    93.6300    97.1752
4702745.0 / 36489290
 116     0.0802     0.0035    99.8860     0.3596    93.6800    95.9090
4669289.0 / 36489290
 117     0.0790     0.0031    99.9180     0.3693    93.6600    96.5710
4634638.0 / 36489290
 118     0.0777     0.0021    99.9540     0.3306    93.9900    98.3775
4598723.0 / 36489290
 119     0.0765     0.0016    99.9640     0.3223    94.1800    97.5567
4561521.0 / 36489290
 120     0.0753     0.0009    99.9840     0.3221    94.2900    97.4340
4525927.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0013    99.9680     0.3292    94.0700    98.2597
4491322.0 / 36489290
 122     0.0728     0.0013    99.9840     0.3250    94.1500    96.4550
4457820.0 / 36489290
 123     0.0715     0.0011    99.9760     0.3123    94.2600    97.3386
4424372.0 / 36489290
 124     0.0703     0.0009    99.9840     0.3493    93.9700    97.3882
4391323.0 / 36489290
 125     0.0691     0.0008    99.9820     0.3443    94.0100    97.7787
4359481.0 / 36489290
 126     0.0678     0.0007    99.9820     0.3310    93.7900    97.8010
4329603.0 / 36489290
 127     0.0666     0.0010    99.9720     0.3388    94.0500    97.8510
4298905.0 / 36489290
 128     0.0654     0.0005    99.9960     0.3307    94.1600    98.1397
4269384.0 / 36489290
 129     0.0641     0.0005    99.9920     0.3414    93.9300    96.4270
4240621.0 / 36489290
 130     0.0629     0.0004    99.9920     0.3363    94.2200    97.7372
4211989.0 / 36489290
 131     0.0616     0.0003    99.9980     0.3303    94.1600    95.6932
4184350.0 / 36489290
 132     0.0604     0.0004    99.9920     0.3315    94.1000    97.4950
4157831.0 / 36489290
 133     0.0592     0.0003    99.9980     0.3335    94.1700    97.4441
4131825.0 / 36489290
 134     0.0579     0.0002   100.0000     0.3262    94.3100    95.7652
4106522.0 / 36489290
 135     0.0567     0.0002   100.0000     0.3234    94.3000    95.7450
4081990.0 / 36489290
 136     0.0554     0.0002   100.0000     0.3199    94.4400    95.7913
4057782.0 / 36489290
 137     0.0542     0.0002   100.0000     0.3212    94.3100    95.7594
4034530.0 / 36489290
 138     0.0530     0.0002   100.0000     0.3236    94.2700    95.8313
4012414.0 / 36489290
 139     0.0517     0.0002   100.0000     0.3146    94.4900    95.8746
3990719.0 / 36489290
 140     0.0505     0.0002   100.0000     0.3160    94.4600    97.1934
3969496.0 / 36489290
 141     0.0493     0.0002    99.9960     0.3225    94.4200    98.1647
3949166.0 / 36489290
 142     0.0480     0.0002    99.9980     0.3187    94.4700    97.6843
3929658.0 / 36489290
 143     0.0468     0.0002   100.0000     0.3176    94.3500    97.6363
3910625.0 / 36489290
 144     0.0456     0.0001   100.0000     0.3189    94.4000    97.6840
3892705.0 / 36489290
 145     0.0443     0.0002    99.9980     0.3224    94.3500    97.9489
3874898.0 / 36489290
 146     0.0431     0.0002    99.9960     0.3237    94.3100    97.8373
3857776.0 / 36489290
 147     0.0418     0.0001   100.0000     0.3240    94.3800    97.7180
3841059.0 / 36489290
 148     0.0406     0.0001   100.0000     0.3165    94.4300    97.7046
3825466.0 / 36489290
 149     0.0394     0.0001    99.9980     0.3241    94.3500    97.9009
3810424.0 / 36489290
 150     0.0381     0.0001   100.0000     0.3233    94.4300    98.4139
3795792.0 / 36489290
 151     0.0369     0.0002    99.9960     0.3269    94.3400    96.0807
3782217.0 / 36489290
 152     0.0357     0.0002    99.9960     0.3197    94.3800    96.8493
3768751.0 / 36489290
 153     0.0344     0.0001    99.9980     0.3231    94.3800    95.5039
3755720.0 / 36489290
 154     0.0332     0.0001   100.0000     0.3186    94.3600    96.5607
3743545.0 / 36489290
 155     0.0319     0.0001   100.0000     0.3209    94.4100    97.0118
3731594.0 / 36489290
 156     0.0307     0.0002    99.9980     0.3220    94.3400    97.3007
3720480.0 / 36489290
 157     0.0295     0.0001   100.0000     0.3158    94.4500    96.0063
3709938.0 / 36489290
 158     0.0282     0.0001   100.0000     0.3202    94.4300    97.4656
3699626.0 / 36489290
 159     0.0270     0.0002    99.9960     0.3250    94.4000    96.1138
3690182.0 / 36489290
 160     0.0257     0.0001   100.0000     0.3174    94.4600    97.1894
3681122.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0001   100.0000     0.3221    94.4500    95.7344
3672787.0 / 36489290
 162     0.0233     0.0002    99.9960     0.3218    94.4200    96.3892
3664523.0 / 36489290
 163     0.0220     0.0001    99.9980     0.3229    94.3900    96.2082
3656923.0 / 36489290
 164     0.0208     0.0001   100.0000     0.3162    94.4800    95.8595
3649634.0 / 36489290
 165     0.0196     0.0001    99.9980     0.3187    94.4300    95.6994
3643015.0 / 36489290
 166     0.0183     0.0001   100.0000     0.3193    94.4100    96.3524
3636766.0 / 36489290
 167     0.0171     0.0001   100.0000     0.3237    94.3500    95.3879
3631000.0 / 36489290
 168     0.0159     0.0001   100.0000     0.3186    94.3700    95.7478
3625953.0 / 36489290
 169     0.0146     0.0001    99.9980     0.3201    94.4000    96.4380
3621270.0 / 36489290
 170     0.0134     0.0001    99.9980     0.3189    94.3800    96.2321
3616911.0 / 36489290
 171     0.0121     0.0001   100.0000     0.3184    94.3100    97.1546
3613136.0 / 36489290
 172     0.0109     0.0001   100.0000     0.3168    94.3800    96.7820
3609864.0 / 36489290
 173     0.0097     0.0001    99.9960     0.3203    94.3000    96.9174
3606810.0 / 36489290
 174     0.0084     0.0001    99.9960     0.3156    94.4100    96.9883
3604442.0 / 36489290
 175     0.0072     0.0001   100.0000     0.3147    94.4200    96.2244
3602385.0 / 36489290
 176     0.0060     0.0001    99.9980     0.3150    94.4100    96.5743
3600807.0 / 36489290
 177     0.0047     0.0001   100.0000     0.3171    94.4500    96.2992
3599445.0 / 36489290
 178     0.0035     0.0001   100.0000     0.3234    94.4600    96.2025
3598796.0 / 36489290
 179     0.0022     0.0001   100.0000     0.3187    94.4700    96.8243
3598463.0 / 36489290
 180     0.0010     0.0001    99.9980     0.3121    94.4300    96.4557
3598101.0 / 36489290
 181     0.0010     0.0002    99.9980     0.3155    94.3100    97.1790
3597779.0 / 36489290
 182     0.0010     0.0001   100.0000     0.3145    94.4500    96.8157
3597458.0 / 36489290
 183     0.0010     0.0001   100.0000     0.3180    94.4700    97.1310
3597155.0 / 36489290
 184     0.0010     0.0001   100.0000     0.3174    94.3500    96.5702
3596822.0 / 36489290
 185     0.0010     0.0002    99.9960     0.3173    94.3300    97.5869
3596460.0 / 36489290
 186     0.0010     0.0001   100.0000     0.3183    94.4300    97.8574
3596110.0 / 36489290
 187     0.0010     0.0001   100.0000     0.3186    94.3400    97.9160
3595762.0 / 36489290
 188     0.0010     0.0001   100.0000     0.3176    94.3900    97.4799
3595411.0 / 36489290
 189     0.0010     0.0001   100.0000     0.3176    94.3800    96.9032
3595096.0 / 36489290
 190     0.0010     0.0001   100.0000     0.3164    94.3500    97.4447
3594762.0 / 36489290
 191     0.0010     0.0001   100.0000     0.3173    94.4500    96.9161
3594434.0 / 36489290
 192     0.0010     0.0001   100.0000     0.3165    94.4100    95.7471
3594127.0 / 36489290
 193     0.0010     0.0001   100.0000     0.3186    94.4600    97.6879
3593813.0 / 36489290
 194     0.0010     0.0001   100.0000     0.3205    94.4300    97.1588
3593465.0 / 36489290
 195     0.0010     0.0001   100.0000     0.3209    94.4400    95.9237
3593087.0 / 36489290
 196     0.0010     0.0001   100.0000     0.3151    94.4600    96.5211
3592750.0 / 36489290
 197     0.0010     0.0001   100.0000     0.3173    94.3100    95.9676
3592431.0 / 36489290
 198     0.0010     0.0001   100.0000     0.3195    94.3700    97.1615
3592107.0 / 36489290
 199     0.0010     0.0001   100.0000     0.3159    94.4700    95.9031
3591796.0 / 36489290
 200     0.0010     0.0001   100.0000     0.3176    94.3100    96.1758
