Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
gRDA (
Parameter Group 0
    c: 0.001
    lr: 0.1
    mu: 0.65
)
Resume training from cifar100_save/endpoints/WideResNet28x10-4/sgd/checkpoint-0.pt
total epochs: 200
27962319.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4462    46.2120     1.6897    42.8300   154.0542
23129579.0 / 36489290
   2     0.1000     0.9223    67.0500     1.3775    59.2800   149.6995
19127477.0 / 36489290
   3     0.1000     0.7049    75.3980     1.0655    66.3600   149.7226
15599236.0 / 36489290
   4     0.1000     0.5829    79.8420     1.5068    60.3500   149.6576
12449733.0 / 36489290
   5     0.1000     0.5079    82.4200     1.2823    63.9000   149.6428
9778784.0 / 36489290
   6     0.1000     0.4580    84.1500     0.5577    80.2700   149.6254
7760729.0 / 36489290
   7     0.1000     0.4187    85.5660     0.6284    79.4600   149.6303
6395875.0 / 36489290
   8     0.1000     0.3899    86.5600     0.6013    79.6800   149.5753
5475283.0 / 36489290
   9     0.1000     0.3591    87.5140     0.6389    79.8600   149.6085
4829390.0 / 36489290
  10     0.1000     0.3316    88.5940     0.5811    82.1700   149.6577
4346040.0 / 36489290
  11     0.1000     0.3091    89.3480     0.4958    84.4300   149.6273
3986481.0 / 36489290
  12     0.1000     0.2875    89.9820     0.4654    85.4500   149.5616
3699113.0 / 36489290
  13     0.1000     0.2696    90.7720     0.5620    82.9100   149.6214
3465868.0 / 36489290
  14     0.1000     0.2507    91.3540     0.8769    76.9900   149.9427
3280943.0 / 36489290
  15     0.1000     0.2327    91.8940     0.4467    86.5900   149.7111
3131395.0 / 36489290
  16     0.1000     0.2229    92.2720     0.5266    83.8300   149.6846
2991621.0 / 36489290
  17     0.1000     0.2016    92.9800     0.4755    84.9100   149.6665
2876014.0 / 36489290
  18     0.1000     0.1946    93.2960     0.5802    82.4800   149.6199
2778118.0 / 36489290
  19     0.1000     0.1788    93.7880     0.9061    76.1600   149.6857
2689072.0 / 36489290
  20     0.1000     0.1682    94.2000     0.6050    83.7900   149.6710
2606369.0 / 36489290
  21     0.1000     0.1593    94.5460     0.3633    88.8400   149.7152
2535060.0 / 36489290
  22     0.1000     0.1469    94.8300     0.3586    89.0600   149.6731
2474101.0 / 36489290
  23     0.1000     0.1422    95.0160     0.3636    89.5200   149.6584
2416018.0 / 36489290
  24     0.1000     0.1318    95.4640     0.5797    85.1700   150.1120
2361334.0 / 36489290
  25     0.1000     0.1218    95.7700     0.4197    87.8500   149.6762
2317660.0 / 36489290
  26     0.1000     0.1197    95.8080     0.3328    90.2700   149.5916
2271590.0 / 36489290
  27     0.1000     0.1128    96.0100     0.5467    86.8900   149.6575
2230775.0 / 36489290
  28     0.1000     0.1079    96.1860     0.3706    89.8100   149.5892
2189186.0 / 36489290
  29     0.1000     0.1025    96.4660     0.3714    89.5800   149.5833
2152362.0 / 36489290
  30     0.1000     0.0984    96.5940     0.3713    90.0500   149.6628
2113741.0 / 36489290
  31     0.1000     0.0893    96.8920     0.4006    89.5200   149.6831
2074600.0 / 36489290
  32     0.1000     0.0854    97.0680     0.6145    85.9700   149.5965
2040484.0 / 36489290
  33     0.1000     0.0841    97.0680     0.4574    88.4400   149.7250
2003911.0 / 36489290
  34     0.1000     0.0781    97.2600     0.3513    90.6900   149.6335
1973112.0 / 36489290
  35     0.1000     0.0759    97.3700     0.3874    90.1800   149.6982
1942716.0 / 36489290
  36     0.1000     0.0739    97.4460     0.5647    86.8800   149.5973
1911652.0 / 36489290
  37     0.1000     0.0704    97.5740     0.3961    90.0200   149.7744
1882992.0 / 36489290
  38     0.1000     0.0639    97.7560     0.3753    91.0400   149.4682
1858625.0 / 36489290
  39     0.1000     0.0657    97.7520     0.4599    89.3200   149.5873
1826300.0 / 36489290
  40     0.1000     0.0576    98.0200     0.5767    86.4700   149.6075
1807109.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0623    97.8340     0.4251    89.8700   149.6198
1778416.0 / 36489290
  42     0.1000     0.0562    98.0500     0.5371    87.1900   149.5590
1760486.0 / 36489290
  43     0.1000     0.0583    97.9000     0.5114    88.5800   149.6125
1732545.0 / 36489290
  44     0.1000     0.0506    98.2860     0.5361    88.0600   149.5115
1710013.0 / 36489290
  45     0.1000     0.0495    98.3200     0.4426    89.7000   149.5888
1687920.0 / 36489290
  46     0.1000     0.0504    98.2180     0.3855    90.7300   149.6107
1671592.0 / 36489290
  47     0.1000     0.0502    98.2160     0.3082    92.5400   149.6861
1653345.0 / 36489290
  48     0.1000     0.0501    98.2760     0.3683    90.8100   149.6079
1632359.0 / 36489290
  49     0.1000     0.0454    98.4640     0.4931    88.6500   149.6499
1609678.0 / 36489290
  50     0.1000     0.0416    98.5660     0.3027    92.4900   149.6594
1597585.0 / 36489290
  51     0.1000     0.0486    98.2940     0.3209    92.1800   149.6214
1578734.0 / 36489290
  52     0.1000     0.0425    98.5340     0.3936    91.1200   149.7726
1564596.0 / 36489290
  53     0.1000     0.0438    98.4800     0.3650    90.9500   149.6029
1542225.0 / 36489290
  54     0.1000     0.0375    98.6660     0.4493    90.5100   149.6564
1526852.0 / 36489290
  55     0.1000     0.0393    98.6680     0.4222    90.2400   149.6935
1513028.0 / 36489290
  56     0.1000     0.0415    98.5460     0.3757    91.0800   149.6771
1497418.0 / 36489290
  57     0.1000     0.0374    98.6700     0.4306    90.6300   149.5046
1476745.0 / 36489290
  58     0.1000     0.0329    98.9080     0.4908    90.1600   149.3907
1468072.0 / 36489290
  59     0.1000     0.0408    98.6080     0.5397    89.2900   149.3720
1447735.0 / 36489290
  60     0.1000     0.0309    98.9500     0.4346    91.0500   149.2867
1434420.0 / 36489290
  61     0.1000     0.0355    98.8080     0.3575    91.7700   149.5273
1423585.0 / 36489290
  62     0.1000     0.0363    98.7320     0.3892    91.1100   149.4390
1403194.0 / 36489290
  63     0.1000     0.0291    99.0420     0.4261    91.1800   149.2710
1397969.0 / 36489290
  64     0.1000     0.0378    98.7280     0.3550    91.5300   149.5669
1382022.0 / 36489290
  65     0.1000     0.0300    98.9940     0.3213    92.5600   149.6350
1372295.0 / 36489290
  66     0.1000     0.0329    98.8340     0.7070    86.8500   149.5254
1364943.0 / 36489290
  67     0.1000     0.0348    98.7520     0.3509    91.7200   149.4048
1350309.0 / 36489290
  68     0.1000     0.0287    99.0320     0.3472    92.6100   149.4017
1337558.0 / 36489290
  69     0.1000     0.0303    98.9680     0.3757    91.8500   149.4047
1325526.0 / 36489290
  70     0.1000     0.0279    99.0740     0.4233    91.1000   149.4387
1316130.0 / 36489290
  71     0.1000     0.0317    98.9660     0.4251    91.3300   149.4237
1304424.0 / 36489290
  72     0.1000     0.0287    99.0680     0.4937    89.6900   149.3209
1289784.0 / 36489290
  73     0.1000     0.0256    99.1320     0.4692    90.1100   149.5179
1279538.0 / 36489290
  74     0.1000     0.0273    99.1040     0.3131    93.1000   149.2467
1269837.0 / 36489290
  75     0.1000     0.0273    99.0700     0.3313    92.7900   149.3150
1262292.0 / 36489290
  76     0.1000     0.0285    99.0240     0.3653    92.0700   149.4755
1255682.0 / 36489290
  77     0.1000     0.0286    99.0360     0.3349    92.5300   149.2640
1249588.0 / 36489290
  78     0.1000     0.0282    99.0280     0.4173    91.6100   149.3161
1238378.0 / 36489290
  79     0.1000     0.0237    99.2020     0.3255    92.7000   149.2564
1232803.0 / 36489290
  80     0.1000     0.0279    99.0060     0.3962    91.5700   149.1541
1228741.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0302    98.9700     0.3394    92.6900   149.0553
1214549.0 / 36489290
  82     0.1000     0.0225    99.3100     0.3705    92.5900   149.3338
1203466.0 / 36489290
  83     0.1000     0.0219    99.2680     0.3586    92.3200   149.2601
1195801.0 / 36489290
  84     0.1000     0.0243    99.1800     0.3419    92.9400   149.3095
1189011.0 / 36489290
  85     0.1000     0.0244    99.1360     0.4369    90.7900   149.3610
1186799.0 / 36489290
  86     0.1000     0.0280    99.0760     0.3901    91.9600   149.2306
1178967.0 / 36489290
  87     0.1000     0.0257    99.1220     0.3661    92.0700   149.3106
1170639.0 / 36489290
  88     0.1000     0.0231    99.2100     0.4457    91.1000   149.3840
1162490.0 / 36489290
  89     0.1000     0.0219    99.2320     0.3828    92.0400   149.3176
1158325.0 / 36489290
  90     0.1000     0.0276    99.0740     0.4872    90.0600   149.2161
1149036.0 / 36489290
  91     0.1000     0.0217    99.2860     0.3415    92.5500   149.3583
1141841.0 / 36489290
  92     0.1000     0.0223    99.2780     0.6052    88.3800   149.2006
1135992.0 / 36489290
  93     0.1000     0.0244    99.1740     0.3880    91.8800   149.3990
1128576.0 / 36489290
  94     0.1000     0.0211    99.2940     0.4163    91.6200   149.2219
1122427.0 / 36489290
  95     0.1000     0.0215    99.2820     0.4868    90.8600   149.3835
1119633.0 / 36489290
  96     0.1000     0.0243    99.1360     0.4076    91.4700   149.0395
1108829.0 / 36489290
  97     0.1000     0.0182    99.4080     0.3426    92.8400   149.1861
1103563.0 / 36489290
  98     0.1000     0.0219    99.2300     0.4619    90.9900   149.3200
1094193.0 / 36489290
  99     0.1000     0.0188    99.3960     0.3558    92.7300   149.2927
1080904.0 / 36489290
 100     0.1000     0.0154    99.5140     0.3477    92.9700   149.2376
1079217.0 / 36489290
 101     0.0988     0.0231    99.2120     0.4369    90.7000   149.3979
1072784.0 / 36489290
 102     0.0975     0.0190    99.3520     0.3781    92.6300   149.3206
1060760.0 / 36489290
 103     0.0963     0.0151    99.5200     0.3415    93.2400   149.4505
1051614.0 / 36489290
 104     0.0950     0.0165    99.4640     0.3261    93.2300   149.3255
1049289.0 / 36489290
 105     0.0938     0.0206    99.2920     0.3977    91.9600   149.3614
1036003.0 / 36489290
 106     0.0926     0.0127    99.5600     0.3495    93.2800   149.4793
1025476.0 / 36489290
 107     0.0913     0.0134    99.5780     0.4749    91.4900   149.3696
1021839.0 / 36489290
 108     0.0901     0.0194    99.3320     0.3850    92.6300   149.2705
1011636.0 / 36489290
 109     0.0889     0.0128    99.5960     0.4927    91.1300   149.3669
1000846.0 / 36489290
 110     0.0876     0.0119    99.5600     0.3991    92.1900   149.2366
996643.0 / 36489290
 111     0.0864     0.0168    99.4160     0.3911    92.1900   149.4068
989061.0 / 36489290
 112     0.0852     0.0142    99.5400     0.3894    92.4300   149.3145
979428.0 / 36489290
 113     0.0839     0.0116    99.6120     0.3462    93.5300   149.3124
968566.0 / 36489290
 114     0.0827     0.0096    99.6900     0.9497    85.0100   149.2575
967877.0 / 36489290
 115     0.0814     0.0182    99.3640     0.4716    91.4300   149.2743
963612.0 / 36489290
 116     0.0802     0.0145    99.5220     0.3384    93.3900   149.2948
951855.0 / 36489290
 117     0.0790     0.0083    99.7460     0.3677    93.1500   149.2237
942394.0 / 36489290
 118     0.0777     0.0094    99.7060     0.3277    93.5700   149.3773
932494.0 / 36489290
 119     0.0765     0.0091    99.7160     0.3525    93.2100   149.3000
922286.0 / 36489290
 120     0.0753     0.0077    99.7520     0.3345    93.5100   149.6194
913474.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0083    99.7400     0.6515    89.0300   149.4977
907643.0 / 36489290
 122     0.0728     0.0108    99.6620     0.3346    93.5100   149.5664
899328.0 / 36489290
 123     0.0715     0.0077    99.7620     0.3719    92.9900   149.5659
893473.0 / 36489290
 124     0.0703     0.0091    99.6940     0.3372    93.6300   149.5189
887291.0 / 36489290
 125     0.0691     0.0093    99.6760     0.3678    93.2100   149.4559
877676.0 / 36489290
 126     0.0678     0.0059    99.8420     0.4130    92.5100   149.9485
871394.0 / 36489290
 127     0.0666     0.0089    99.7160     0.3516    93.3600   149.5756
865826.0 / 36489290
 128     0.0654     0.0086    99.7400     0.3251    93.5500   149.4797
856241.0 / 36489290
 129     0.0641     0.0050    99.8520     0.3154    93.9700   149.1093
847168.0 / 36489290
 130     0.0629     0.0051    99.8580     0.3295    93.7100   149.0610
840707.0 / 36489290
 131     0.0616     0.0068    99.7800     0.3407    93.3800   149.1848
832491.0 / 36489290
 132     0.0604     0.0048    99.8660     0.3349    93.5300   149.2866
826905.0 / 36489290
 133     0.0592     0.0065    99.7840     0.3826    92.7300   149.3331
821783.0 / 36489290
 134     0.0579     0.0072    99.7780     0.3261    93.6800   149.2540
814648.0 / 36489290
 135     0.0567     0.0046    99.8540     0.3201    93.9700   149.2537
806608.0 / 36489290
 136     0.0554     0.0031    99.9160     0.3305    93.7000   149.1784
797520.0 / 36489290
 137     0.0542     0.0028    99.9120     0.3420    93.6900   149.2727
789531.0 / 36489290
 138     0.0530     0.0031    99.9240     0.3399    93.6900   149.3732
780985.0 / 36489290
 139     0.0517     0.0023    99.9520     0.3333    93.7300   149.2561
773505.0 / 36489290
 140     0.0505     0.0026    99.9260     0.3847    93.2600   149.0872
766829.0 / 36489290
 141     0.0493     0.0032    99.8980     0.3557    93.4700   149.2192
760666.0 / 36489290
 142     0.0480     0.0029    99.9180     0.3527    93.6500   149.2847
753751.0 / 36489290
 143     0.0468     0.0025    99.9400     0.3235    94.1100   149.4964
747552.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 144     0.0456     0.0023    99.9320     0.3793    93.4400   149.1039
741518.0 / 36489290
 145     0.0443     0.0027    99.9280     0.3414    94.1000   144.7163
735541.0 / 36489290
 146     0.0431     0.0018    99.9560     0.3456    93.9600   144.7424
728826.0 / 36489290
 147     0.0418     0.0018    99.9520     0.3419    93.9300   144.8773
723241.0 / 36489290
 148     0.0406     0.0020    99.9440     0.3301    94.0000   144.8423
717397.0 / 36489290
 149     0.0394     0.0018    99.9480     0.3364    93.8300   144.7037
711739.0 / 36489290
 150     0.0381     0.0016    99.9560     0.3389    93.7900   144.7331
706411.0 / 36489290
 151     0.0369     0.0015    99.9680     0.3218    94.0100   144.6700
700794.0 / 36489290
 152     0.0357     0.0009    99.9860     0.3214    94.1000   144.6382
695784.0 / 36489290
 153     0.0344     0.0012    99.9700     0.3284    93.9400   144.6227
690487.0 / 36489290
 154     0.0332     0.0007    99.9900     0.3145    94.3200   144.6750
685774.0 / 36489290
 155     0.0319     0.0011    99.9800     0.3286    93.7700   144.8000
681323.0 / 36489290
 156     0.0307     0.0008    99.9820     0.3240    94.0900   144.7413
676850.0 / 36489290
 157     0.0295     0.0007    99.9840     0.3302    94.1100   144.7067
672610.0 / 36489290
 158     0.0282     0.0006    99.9980     0.3304    94.3500   144.6153
668553.0 / 36489290
 159     0.0270     0.0005    99.9920     0.3261    94.1900   144.7024
664617.0 / 36489290
 160     0.0257     0.0005    99.9900     0.3204    94.3800   144.6321
660837.0 / 36489290
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0004    99.9980     0.3255    94.2300   144.6805
657624.0 / 36489290
 162     0.0233     0.0006    99.9900     0.3156    94.3300   144.6952
654214.0 / 36489290
 163     0.0220     0.0004    99.9960     0.3178    94.2700   144.6779
651135.0 / 36489290
 164     0.0208     0.0004    99.9940     0.3169    94.3700   144.6921
648258.0 / 36489290
 165     0.0196     0.0003   100.0000     0.3138    94.2700   144.6804
645639.0 / 36489290
 166     0.0183     0.0003   100.0000     0.3193    94.3400   144.6246
643427.0 / 36489290
 167     0.0171     0.0005    99.9900     0.3186    94.3100   144.5675
641255.0 / 36489290
 168     0.0159     0.0003    99.9980     0.3220    94.3800   144.6718
639242.0 / 36489290
 169     0.0146     0.0003    99.9960     0.3173    94.2400   144.5559
637265.0 / 36489290
 170     0.0134     0.0003    99.9940     0.3285    94.2900   144.7560
635682.0 / 36489290
 171     0.0121     0.0003    99.9940     0.3190    94.3600   144.7520
634253.0 / 36489290
 172     0.0109     0.0003    99.9940     0.3186    94.3200   144.7177
632904.0 / 36489290
 173     0.0097     0.0002    99.9980     0.3200    94.4200   144.7505
631797.0 / 36489290
 174     0.0084     0.0002   100.0000     0.3198    94.4000   144.7366
630973.0 / 36489290
 175     0.0072     0.0002   100.0000     0.3253    94.3900   144.7546
630305.0 / 36489290
 176     0.0060     0.0003    99.9980     0.3206    94.3600   144.7268
629748.0 / 36489290
 177     0.0047     0.0002   100.0000     0.3254    94.4900   144.6662
629306.0 / 36489290
 178     0.0035     0.0003    99.9940     0.3186    94.3700   144.7252
628970.0 / 36489290
 179     0.0022     0.0003    99.9960     0.3227    94.3500   144.6692
628846.0 / 36489290
 180     0.0010     0.0003    99.9960     0.3189    94.3600   144.7170
628700.0 / 36489290
 181     0.0010     0.0002    99.9960     0.3197    94.3700   144.7351
628536.0 / 36489290
 182     0.0010     0.0003    99.9960     0.3188    94.3000   144.5769
628398.0 / 36489290
 183     0.0010     0.0003    99.9940     0.3157    94.3600   144.5484
628255.0 / 36489290
 184     0.0010     0.0003    99.9960     0.3172    94.3800   144.5636
628103.0 / 36489290
 185     0.0010     0.0003    99.9980     0.3201    94.4400   144.6085
627968.0 / 36489290
 186     0.0010     0.0002    99.9960     0.3234    94.3500   144.6068
627857.0 / 36489290
 187     0.0010     0.0002    99.9980     0.3172    94.3100   144.7239
627713.0 / 36489290
 188     0.0010     0.0002   100.0000     0.3231    94.3100   144.6690
627562.0 / 36489290
 189     0.0010     0.0002    99.9980     0.3191    94.3600   144.6998
627421.0 / 36489290
 190     0.0010     0.0002    99.9980     0.3199    94.3100   144.7028
627264.0 / 36489290
 191     0.0010     0.0002    99.9980     0.3191    94.3200   144.6172
627089.0 / 36489290
 192     0.0010     0.0002    99.9980     0.3248    94.4600   144.3369
626958.0 / 36489290
 193     0.0010     0.0002   100.0000     0.3143    94.3900   144.2923
626801.0 / 36489290
 194     0.0010     0.0002    99.9980     0.3181    94.3700   144.1804
626670.0 / 36489290
 195     0.0010     0.0002    99.9980     0.3213    94.3400   144.4451
626522.0 / 36489290
 196     0.0010     0.0003    99.9980     0.3185    94.4400   144.2311
626364.0 / 36489290
 197     0.0010     0.0002   100.0000     0.3163    94.3200   144.3120
626212.0 / 36489290
 198     0.0010     0.0002   100.0000     0.3185    94.3900   144.4924
626085.0 / 36489290
 199     0.0010     0.0002    99.9980     0.3204    94.4500   144.2958
625933.0 / 36489290
 200     0.0010     0.0002   100.0000     0.3188    94.3100   144.3390

