Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.65
)
Resume training from cifar100_save/endpoints/WideResNet28x10-3/sgd/checkpoint-0.pt
total epochs: 200
27961743.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4468    46.4420     1.6050    44.5500    99.8238
23128280.0 / 36489290
   2     0.1000     0.9265    66.9540     1.1114    63.5700    97.1414
19127727.0 / 36489290
   3     0.1000     0.7101    75.3540     1.0387    67.3400    97.7698
15600030.0 / 36489290
   4     0.1000     0.5864    79.5580     1.4695    61.7200    98.0775
12447212.0 / 36489290
   5     0.1000     0.5074    82.5560     1.1988    67.2000    98.2754
9771927.0 / 36489290
   6     0.1000     0.4569    84.2140     0.6084    79.4200    97.1732
7752158.0 / 36489290
   7     0.1000     0.4167    85.5800     0.7519    76.8200    97.3961
6381560.0 / 36489290
   8     0.1000     0.3893    86.5440     0.5727    80.4600    97.6506
5460308.0 / 36489290
   9     0.1000     0.3584    87.5900     0.6316    79.7000    97.1283
4812251.0 / 36489290
  10     0.1000     0.3314    88.5560     0.6843    79.7300    98.7849
4325458.0 / 36489290
  11     0.1000     0.3092    89.3580     0.5915    82.1500    97.4520
3960877.0 / 36489290
  12     0.1000     0.2860    90.0740     0.4856    84.7800    97.1852
3674461.0 / 36489290
  13     0.1000     0.2698    90.7300     0.5703    82.4200    97.9460
3445599.0 / 36489290
  14     0.1000     0.2504    91.3980     0.4559    85.3600    98.2066
3264839.0 / 36489290
  15     0.1000     0.2325    91.8700     0.4950    85.2500    97.6048
3108174.0 / 36489290
  16     0.1000     0.2212    92.4400     0.4570    85.8100    97.6939
2973987.0 / 36489290
  17     0.1000     0.2026    93.0620     0.3805    88.0100    97.0119
2859952.0 / 36489290
  18     0.1000     0.1952    93.2480     0.7696    80.1600    96.7407
2761524.0 / 36489290
  19     0.1000     0.1778    93.8040     1.0218    75.9500    97.9886
2673420.0 / 36489290
  20     0.1000     0.1729    93.9560     0.6792    81.9600    98.5769
2591403.0 / 36489290
  21     0.1000     0.1597    94.4040     0.3879    88.6400    97.7130
2520678.0 / 36489290
  22     0.1000     0.1461    94.9320     0.4537    86.6900    97.1038
2460167.0 / 36489290
  23     0.1000     0.1407    95.1000     0.3320    90.3600    97.9773
2404488.0 / 36489290
  24     0.1000     0.1347    95.2560     0.7328    81.9200    97.1688
2347589.0 / 36489290
  25     0.1000     0.1225    95.7700     0.4060    88.3700    97.8076
2296160.0 / 36489290
  26     0.1000     0.1173    95.9480     0.4231    88.3400    97.5539
2251306.0 / 36489290
  27     0.1000     0.1122    96.0700     0.4422    88.1900    97.0109
2210067.0 / 36489290
  28     0.1000     0.1099    96.1600     0.3409    89.3600    98.4560
2160492.0 / 36489290
  29     0.1000     0.0965    96.6980     0.4572    88.0900    96.3552
2123520.0 / 36489290
  30     0.1000     0.0964    96.6820     0.4071    88.4000    97.1704
2093606.0 / 36489290
  31     0.1000     0.0979    96.4700     0.7174    82.1100    96.5863
2054053.0 / 36489290
  32     0.1000     0.0857    96.9980     0.4223    89.0800    97.7453
2017455.0 / 36489290
  33     0.1000     0.0836    97.0400     0.3438    90.6200    97.4298
1986744.0 / 36489290
  34     0.1000     0.0775    97.2460     0.4190    89.5800    97.4788
1954452.0 / 36489290
  35     0.1000     0.0744    97.4120     0.5576    87.1600    96.8045
1925973.0 / 36489290
  36     0.1000     0.0754    97.3340     0.4074    89.5100    97.2070
1901412.0 / 36489290
  37     0.1000     0.0727    97.4860     0.3916    90.4900    97.4941
1872591.0 / 36489290
  38     0.1000     0.0654    97.6700     0.3530    90.8900    96.7089
1844008.0 / 36489290
  39     0.1000     0.0646    97.6840     0.3534    91.3300    97.7345
1811734.0 / 36489290
  40     0.1000     0.0564    98.0300     0.3397    91.1200    97.9071
1789494.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0588    97.9640     0.3293    91.6900    96.6513
1765028.0 / 36489290
  42     0.1000     0.0568    98.0020     0.5519    87.8800    98.2221
1745939.0 / 36489290
  43     0.1000     0.0603    97.9820     0.5172    88.5300    97.0490
1719270.0 / 36489290
  44     0.1000     0.0520    98.2260     0.3360    91.5200    96.4768
1696652.0 / 36489290
  45     0.1000     0.0493    98.2520     0.7645    84.0700    97.4236
1675866.0 / 36489290
  46     0.1000     0.0519    98.2180     0.3274    91.5900    97.0595
1655061.0 / 36489290
  47     0.1000     0.0473    98.3900     0.3519    91.4600    97.0149
1637562.0 / 36489290
  48     0.1000     0.0488    98.2840     0.3666    91.0600    97.5190
1615995.0 / 36489290
  49     0.1000     0.0446    98.4320     0.4505    89.7500    97.6274
1596818.0 / 36489290
  50     0.1000     0.0444    98.4560     0.3388    91.4600    97.1240
1578258.0 / 36489290
  51     0.1000     0.0448    98.4880     0.3028    92.1300    97.8033
1557028.0 / 36489290
  52     0.1000     0.0395    98.6380     0.4441    90.2600    96.1164
1540963.0 / 36489290
  53     0.1000     0.0422    98.5920     0.4076    90.1800    97.0340
1524688.0 / 36489290
  54     0.1000     0.0403    98.5640     0.3339    91.8800    98.8822
1509513.0 / 36489290
  55     0.1000     0.0397    98.6440     0.3367    92.0000    97.3291
1494439.0 / 36489290
  56     0.1000     0.0392    98.6500     0.6491    87.3300    96.5847
1483295.0 / 36489290
  57     0.1000     0.0413    98.5320     0.3228    92.0300    97.7217
1472613.0 / 36489290
  58     0.1000     0.0399    98.6120     0.4254    90.3200    97.9017
1451550.0 / 36489290
  59     0.1000     0.0334    98.8900     0.3351    92.3800    97.6719
1438020.0 / 36489290
  60     0.1000     0.0343    98.8000     0.3507    91.9000    96.9520
1421885.0 / 36489290
  61     0.1000     0.0334    98.8600     0.3853    90.7700    97.8189
1411608.0 / 36489290
  62     0.1000     0.0360    98.7960     0.3694    91.5000    98.1958
1394968.0 / 36489290
  63     0.1000     0.0318    98.9160     0.3481    91.9000    96.3062
1387472.0 / 36489290
  64     0.1000     0.0367    98.7920     0.3089    92.6700    97.0355
1370691.0 / 36489290
  65     0.1000     0.0304    98.9940     0.3228    92.5100    96.3259
1357277.0 / 36489290
  66     0.1000     0.0317    98.9400     0.3415    92.4300    96.4938
1343097.0 / 36489290
  67     0.1000     0.0278    99.0620     0.4319    90.4600    96.1036
1337785.0 / 36489290
  68     0.1000     0.0361    98.7720     0.3570    91.9500    96.2678
1329214.0 / 36489290
  69     0.1000     0.0332    98.8500     0.3143    92.5900    96.2800
1312043.0 / 36489290
  70     0.1000     0.0260    99.1580     0.4535    90.4300    96.0895
1299132.0 / 36489290
  71     0.1000     0.0285    99.0740     0.3667    92.1400    96.3894
1293002.0 / 36489290
  72     0.1000     0.0304    98.9440     0.5402    88.9500    96.2275
1284966.0 / 36489290
  73     0.1000     0.0295    98.9700     0.4627    90.3100    96.5664
1274412.0 / 36489290
  74     0.1000     0.0289    99.0440     0.4677    90.3600    96.2161
1262802.0 / 36489290
  75     0.1000     0.0270    99.0980     0.3315    92.4800    97.3422
1253074.0 / 36489290
  76     0.1000     0.0263    99.1000     0.3269    92.3400    98.0460
1240240.0 / 36489290
  77     0.1000     0.0246    99.1820     0.3521    92.6800    98.0169
1236299.0 / 36489290
  78     0.1000     0.0310    99.0000     0.4047    91.5300    96.0575
1225284.0 / 36489290
  79     0.1000     0.0243    99.1560     0.3577    92.3900    96.1223
1216680.0 / 36489290
  80     0.1000     0.0266    99.1100     0.3616    92.1900    97.1881
1211864.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0288    99.0380     0.3888    91.5300    96.8089
1202335.0 / 36489290
  82     0.1000     0.0242    99.2000     0.4286    91.1700    95.7979
1191107.0 / 36489290
  83     0.1000     0.0223    99.2660     0.4214    91.0900    98.3566
1186703.0 / 36489290
  84     0.1000     0.0262    99.1020     0.3194    93.1500    97.0970
1179680.0 / 36489290
  85     0.1000     0.0252    99.1220     0.3507    92.2100    97.0124
1170266.0 / 36489290
  86     0.1000     0.0238    99.2040     0.4079    91.5900    97.6867
1157691.0 / 36489290
  87     0.1000     0.0201    99.3200     0.5857    89.5500    97.8357
1151151.0 / 36489290
  88     0.1000     0.0232    99.1860     0.3521    92.1700    96.9543
1144529.0 / 36489290
  89     0.1000     0.0228    99.2160     0.3148    92.8300    97.6779
1138172.0 / 36489290
  90     0.1000     0.0252    99.1860     0.3297    92.7800    96.9089
1129600.0 / 36489290
  91     0.1000     0.0215    99.2940     0.5973    89.3700    96.8018
1128663.0 / 36489290
  92     0.1000     0.0267    99.0940     0.3640    92.3300    97.6719
1121506.0 / 36489290
  93     0.1000     0.0227    99.2500     0.4216    91.3900    96.9869
1111293.0 / 36489290
  94     0.1000     0.0202    99.3620     0.3465    92.3300    97.2511
1100823.0 / 36489290
  95     0.1000     0.0186    99.3980     0.4024    91.4500    97.5270
1097389.0 / 36489290
  96     0.1000     0.0232    99.2300     0.3849    92.2600    97.4744
1091207.0 / 36489290
  97     0.1000     0.0229    99.2360     0.3202    93.1000    96.7515
1083021.0 / 36489290
  98     0.1000     0.0193    99.3260     0.3251    93.3100    96.8690
1072746.0 / 36489290
  99     0.1000     0.0167    99.4360     0.4457    90.7700    96.7518
1072955.0 / 36489290
 100     0.1000     0.0231    99.2360     0.4131    91.3600    96.2919
1071925.0 / 36489290
 101     0.0988     0.0237    99.1800     0.5171    90.5600    96.6265
1058277.0 / 36489290
 102     0.0975     0.0143    99.5080     0.3657    92.4300    96.5527
1051729.0 / 36489290
 103     0.0963     0.0191    99.3540     0.3869    91.9700    97.6521
1049159.0 / 36489290
 104     0.0950     0.0218    99.2680     0.3245    92.9600    98.2918
1038630.0 / 36489290
 105     0.0938     0.0158    99.5080     0.3355    92.8300    96.9554
1030518.0 / 36489290
 106     0.0926     0.0166    99.4820     0.4715    91.1900    97.5108
1020072.0 / 36489290
 107     0.0913     0.0142    99.5360     0.3297    92.9600    98.7822
1010598.0 / 36489290
 108     0.0901     0.0145    99.5440     0.3405    92.7800    97.4889
998998.0 / 36489290
 109     0.0889     0.0117    99.6240     0.3313    93.2200    96.4159
989017.0 / 36489290
 110     0.0876     0.0132    99.5800     0.3438    92.7600    96.2602
985726.0 / 36489290
 111     0.0864     0.0163    99.4320     0.3297    93.0000    97.0254
975537.0 / 36489290
 112     0.0852     0.0114    99.6520     0.3218    93.2700    97.2203
967868.0 / 36489290
 113     0.0839     0.0126    99.5940     0.3942    92.2100    96.3596
959598.0 / 36489290
 114     0.0827     0.0118    99.6280     0.6250    88.3200    96.2662
952646.0 / 36489290
 115     0.0814     0.0119    99.6040     0.3280    93.0800    96.3670
942687.0 / 36489290
 116     0.0802     0.0093    99.7000     0.3979    92.4700    97.3095
934261.0 / 36489290
 117     0.0790     0.0101    99.6860     0.3186    93.5900    97.4640
926841.0 / 36489290
 118     0.0777     0.0107    99.6600     0.3590    92.8400    96.7587
924604.0 / 36489290
 119     0.0765     0.0144    99.5220     0.3482    93.3300    96.6311
914435.0 / 36489290
 120     0.0753     0.0081    99.7800     0.3486    93.2700    96.9557
903780.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0072    99.7840     0.3442    93.3300    97.6683
893041.0 / 36489290
 122     0.0728     0.0069    99.7760     0.3501    92.7700    96.8414
886135.0 / 36489290
 123     0.0715     0.0084    99.7380     0.3710    92.7900    97.0419
877750.0 / 36489290
 124     0.0703     0.0070    99.7780     0.3460    93.3300    97.5822
869715.0 / 36489290
 125     0.0691     0.0071    99.7820     0.3224    93.7200    97.0696
865302.0 / 36489290
 126     0.0678     0.0099    99.6700     0.3707    93.1000    96.8307
858653.0 / 36489290
 127     0.0666     0.0077    99.7540     0.3419    93.2800    97.0952
854094.0 / 36489290
 128     0.0654     0.0085    99.7340     0.6217    89.3600    97.1289
845659.0 / 36489290
 129     0.0641     0.0056    99.8280     0.3354    93.6700    96.4582
838864.0 / 36489290
 130     0.0629     0.0062    99.7980     0.3718    92.8700    96.9681
834643.0 / 36489290
 131     0.0616     0.0087    99.7400     0.4036    92.8800    96.8179
825187.0 / 36489290
 132     0.0604     0.0042    99.8900     0.3212    93.7300    95.9574
817295.0 / 36489290
 133     0.0592     0.0051    99.8480     0.3207    93.9000    96.3508
809676.0 / 36489290
 134     0.0579     0.0050    99.8680     0.3284    93.8900    97.1916
800348.0 / 36489290
 135     0.0567     0.0027    99.9500     0.3260    93.9400    96.1080
793046.0 / 36489290
 136     0.0554     0.0047    99.8540     0.3332    93.9500    95.9091
786379.0 / 36489290
 137     0.0542     0.0043    99.8640     0.3239    93.8500    96.5052
779471.0 / 36489290
 138     0.0530     0.0035    99.8800     0.3477    93.6200    97.4094
773160.0 / 36489290
 139     0.0517     0.0038    99.8940     0.3274    94.0800    96.9199
767112.0 / 36489290
 140     0.0505     0.0040    99.8760     0.3435    93.6000    97.3268
760556.0 / 36489290
 141     0.0493     0.0033    99.8980     0.3554    93.3400    96.2563
755337.0 / 36489290
 142     0.0480     0.0043    99.8680     0.3405    93.9100    96.9458
749052.0 / 36489290
 143     0.0468     0.0025    99.9300     0.3362    93.8300    96.9200
742551.0 / 36489290
 144     0.0456     0.0022    99.9400     0.3257    94.0400    96.6755
735684.0 / 36489290
 145     0.0443     0.0018    99.9580     0.3182    94.2000    98.5223
728729.0 / 36489290
 146     0.0431     0.0013    99.9720     0.3259    94.2100    97.2872
722352.0 / 36489290
 147     0.0418     0.0017    99.9540     0.3675    93.6000    96.3066
717280.0 / 36489290
 148     0.0406     0.0023    99.9300     0.3224    94.1700    97.6250
711327.0 / 36489290
 149     0.0394     0.0016    99.9600     0.3261    94.2300    97.1891
705006.0 / 36489290
 150     0.0381     0.0008    99.9900     0.3148    94.4500    97.6209
699274.0 / 36489290
 151     0.0369     0.0010    99.9760     0.3285    94.3400    98.5571
694017.0 / 36489290
 152     0.0357     0.0012    99.9700     0.3414    94.1300    97.9833
688779.0 / 36489290
 153     0.0344     0.0009    99.9820     0.3289    94.4700    97.6541
684205.0 / 36489290
 154     0.0332     0.0012    99.9760     0.3370    94.2500    97.3518
679812.0 / 36489290
 155     0.0319     0.0015    99.9560     0.3496    93.9700    97.5446
675615.0 / 36489290
 156     0.0307     0.0013    99.9720     0.3331    94.3900    98.3360
671566.0 / 36489290
 157     0.0295     0.0013    99.9660     0.3276    94.2900    97.5950
667714.0 / 36489290
 158     0.0282     0.0014    99.9580     0.3257    94.5300    98.4636
664212.0 / 36489290
 159     0.0270     0.0014    99.9760     0.3309    94.4400    98.1366
660618.0 / 36489290
 160     0.0257     0.0007    99.9800     0.3245    94.4000    98.4478
656942.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0006    99.9900     0.3309    94.2200    98.0113
653502.0 / 36489290
 162     0.0233     0.0005    99.9960     0.3200    94.3400    97.8887
650399.0 / 36489290
 163     0.0220     0.0005    99.9860     0.3245    94.2800    98.3306
647638.0 / 36489290
 164     0.0208     0.0006    99.9840     0.3293    94.3200    97.9152
644686.0 / 36489290
 165     0.0196     0.0005    99.9900     0.3165    94.4500    98.0292
642335.0 / 36489290
 166     0.0183     0.0005    99.9920     0.3176    94.3800    98.8434
639855.0 / 36489290
 167     0.0171     0.0004    99.9960     0.3175    94.4900    97.8610
637777.0 / 36489290
 168     0.0159     0.0004    99.9960     0.3171    94.5300    98.2447
635709.0 / 36489290
 169     0.0146     0.0003    99.9960     0.3170    94.5300    98.2734
633817.0 / 36489290
 170     0.0134     0.0003   100.0000     0.3150    94.5700    96.4819
632349.0 / 36489290
 171     0.0121     0.0003    99.9960     0.3149    94.5100    95.6661
630835.0 / 36489290
 172     0.0109     0.0003    99.9980     0.3164    94.5500    95.3830
629555.0 / 36489290
 173     0.0097     0.0004    99.9900     0.3171    94.5100    95.5063
628580.0 / 36489290
 174     0.0084     0.0003   100.0000     0.3116    94.4400    95.4935
627789.0 / 36489290
 175     0.0072     0.0003    99.9980     0.3169    94.5600    95.3820
627006.0 / 36489290
 176     0.0060     0.0002    99.9980     0.3147    94.5200    95.6545
626402.0 / 36489290
 177     0.0047     0.0002    99.9980     0.3168    94.5300    95.7366
626006.0 / 36489290
 178     0.0035     0.0002   100.0000     0.3164    94.6500    95.6618
625732.0 / 36489290
 179     0.0022     0.0003   100.0000     0.3145    94.4900    95.3319
625584.0 / 36489290
 180     0.0010     0.0002   100.0000     0.3106    94.4900    95.4026
625421.0 / 36489290
 181     0.0010     0.0003    99.9960     0.3133    94.5800    95.4332
625285.0 / 36489290
 182     0.0010     0.0002   100.0000     0.3129    94.5600    95.6813
625141.0 / 36489290
 183     0.0010     0.0002   100.0000     0.3125    94.5600    95.5577
624994.0 / 36489290
 184     0.0010     0.0003    99.9980     0.3150    94.6100    95.5630
624875.0 / 36489290
 185     0.0010     0.0002   100.0000     0.3187    94.5100    95.5437
624710.0 / 36489290
 186     0.0010     0.0003    99.9960     0.3153    94.5400    95.6317
624596.0 / 36489290
 187     0.0010     0.0002    99.9980     0.3153    94.4800    95.5627
624427.0 / 36489290
 188     0.0010     0.0003    99.9960     0.3158    94.5600    95.5317
624291.0 / 36489290
 189     0.0010     0.0002    99.9980     0.3105    94.5600    95.4213
624145.0 / 36489290
 190     0.0010     0.0002    99.9980     0.3180    94.5400    95.3848
624008.0 / 36489290
 191     0.0010     0.0002    99.9980     0.3108    94.5100    95.4521
623826.0 / 36489290
 192     0.0010     0.0003    99.9920     0.3162    94.5500    95.4702
623722.0 / 36489290
 193     0.0010     0.0002   100.0000     0.3123    94.6200    95.6716
623571.0 / 36489290
 194     0.0010     0.0002   100.0000     0.3174    94.4900    95.5439
623428.0 / 36489290
 195     0.0010     0.0003    99.9960     0.3158    94.6100    95.4047
623262.0 / 36489290
 196     0.0010     0.0002    99.9960     0.3120    94.6300    95.5147
623140.0 / 36489290
 197     0.0010     0.0002    99.9980     0.3149    94.5100    95.3959
622982.0 / 36489290
 198     0.0010     0.0002   100.0000     0.3184    94.5300    95.4522
622830.0 / 36489290
 199     0.0010     0.0003   100.0000     0.3138    94.6300    95.6708
622677.0 / 36489290
 200     0.0010     0.0003    99.9940     0.3154    94.6500    95.7142
