Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
SGD (
Parameter Group 0
    dampening: 0
    lr: 0.1
    momentum: 0.0
    nesterov: False
    weight_decay: 0.0
)
total epochs: 200
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4310    46.7940     1.9213    41.4300    92.0726
   2     0.1000     0.8993    68.0920     1.2699    60.7000    89.0931
   3     0.1000     0.6803    76.4700     0.8162    73.9400    89.3443
   4     0.1000     0.5551    80.7700     1.4895    64.1900    89.1327
   5     0.1000     0.4697    83.9000     0.7390    75.9700    89.1488
   6     0.1000     0.4118    85.7380     0.5611    80.5900    89.1290
   7     0.1000     0.3654    87.3020     0.7060    79.0800    89.1884
   8     0.1000     0.3299    88.6620     0.8174    75.8800    89.1366
   9     0.1000     0.2933    89.7580     0.4856    84.6200    89.1124
  10     0.1000     0.2673    90.7720     0.4486    85.6000    89.2711
  11     0.1000     0.2456    91.5940     0.4201    86.9300    89.1775
  12     0.1000     0.2221    92.2680     0.5247    85.0600    89.2143
  13     0.1000     0.2032    92.8580     0.4452    86.7100    89.3123
  14     0.1000     0.1883    93.4000     0.4769    85.7800    89.0876
  15     0.1000     0.1740    93.8400     0.4942    86.2000    89.2255
  16     0.1000     0.1596    94.4400     0.4071    87.8500    89.0897
  17     0.1000     0.1438    94.9240     0.3509    89.5000    89.2252
  18     0.1000     0.1308    95.3740     0.5440    86.0300    89.3648
  19     0.1000     0.1275    95.4800     0.4286    87.9300    89.0874
  20     0.1000     0.1105    96.1780     0.7259    83.1600    89.2616
  21     0.1000     0.1075    96.3040     0.5265    86.5800    89.1008
  22     0.1000     0.0958    96.5780     0.8343    82.1600    89.2437
  23     0.1000     0.0885    96.9820     0.4340    88.8400    89.0977
  24     0.1000     0.0812    97.1660     0.4212    89.5300    89.1347
  25     0.1000     0.0765    97.3740     0.6415    85.6800    89.2565
  26     0.1000     0.0708    97.5160     0.4334    89.6300    89.2770
  27     0.1000     0.0630    97.8200     0.4343    89.5200    89.2928
  28     0.1000     0.0636    97.7380     0.4019    90.0300    89.1769
  29     0.1000     0.0559    98.0440     0.4609    89.9400    89.0760
  30     0.1000     0.0521    98.1900     0.3833    90.8200    89.2056
  31     0.1000     0.0516    98.2360     0.6169    87.0900    89.1547
  32     0.1000     0.0470    98.4080     0.3368    91.8600    89.1733
  33     0.1000     0.0427    98.5340     0.3725    91.6100    89.0730
  34     0.1000     0.0410    98.5960     0.3577    91.6800    89.1884
  35     0.1000     0.0391    98.6020     0.3809    91.4600    89.1290
  36     0.1000     0.0375    98.7060     0.3790    91.3500    89.1343
  37     0.1000     0.0340    98.8200     0.3486    91.8300    89.1699
  38     0.1000     0.0337    98.8320     0.3403    91.8900    89.2107
  39     0.1000     0.0263    99.1100     0.3772    91.8000    89.2038
  40     0.1000     0.0310    98.9400     0.4630    90.5900    89.3089
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0339    98.8460     0.4026    91.7700    89.2277
  42     0.1000     0.0257    99.1120     0.5410    89.4200    88.9983
  43     0.1000     0.0255    99.1320     0.4896    90.6500    89.0793
  44     0.1000     0.0215    99.2640     0.6332    88.5100    89.1225
  45     0.1000     0.0159    99.4840     0.3756    92.2600    89.1360
  46     0.1000     0.0220    99.1980     0.3613    92.5000    89.1691
  47     0.1000     0.0155    99.5120     0.3891    92.3000    89.0497
  48     0.1000     0.0182    99.3820     0.4330    91.5700    89.1196
  49     0.1000     0.0208    99.2760     0.4067    91.7000    89.1596
  50     0.1000     0.0178    99.4060     0.3930    91.8600    89.0796
  51     0.1000     0.0185    99.4000     0.4876    90.6600    89.1024
  52     0.1000     0.0155    99.4760     0.3711    92.3000    89.1130
  53     0.1000     0.0149    99.4840     0.3592    92.5400    89.0188
  54     0.1000     0.0142    99.5080     0.6291    89.0500    89.0883
  55     0.1000     0.0150    99.4680     0.5548    89.6500    89.0831
  56     0.1000     0.0151    99.4840     0.4201    91.8400    89.1541
  57     0.1000     0.0140    99.5520     0.3910    92.2400    89.4761
  58     0.1000     0.0149    99.5020     0.3568    92.5200    89.0874
  59     0.1000     0.0125    99.5940     0.4264    92.2600    89.1110
  60     0.1000     0.0129    99.5460     0.4025    92.2300    89.1288
  61     0.1000     0.0091    99.7440     0.3881    92.2900    89.1750
  62     0.1000     0.0097    99.6940     0.4466    91.8000    89.1920
  63     0.1000     0.0113    99.6460     0.3659    92.7500    89.1637
  64     0.1000     0.0072    99.7740     0.6249    90.2300    89.0930
  65     0.1000     0.0075    99.7560     0.4188    92.3200    89.1140
  66     0.1000     0.0087    99.7060     0.4068    92.7600    89.1186
  67     0.1000     0.0093    99.7120     0.3899    92.7700    89.0336
  68     0.1000     0.0090    99.6920     0.4388    92.2700    89.1344
  69     0.1000     0.0124    99.5840     0.4101    92.3000    89.1300
  70     0.1000     0.0087    99.7200     0.3643    93.2400    89.1924
  71     0.1000     0.0095    99.7000     0.4363    92.0300    89.2974
  72     0.1000     0.0145    99.5040     0.4778    91.5800    89.2155
  73     0.1000     0.0093    99.6920     0.3916    92.6100    89.1811
  74     0.1000     0.0073    99.7740     0.4305    92.3700    88.9840
  75     0.1000     0.0073    99.7760     0.6930    89.5500    89.1368
  76     0.1000     0.0096    99.6640     0.3938    92.6600    89.0681
  77     0.1000     0.0072    99.7780     0.4621    91.9800    89.1549
  78     0.1000     0.0062    99.8120     0.3762    93.1000    89.1126
  79     0.1000     0.0064    99.8000     0.3832    92.9600    89.0512
  80     0.1000     0.0067    99.7740     0.5476    90.8100    89.1128
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0080    99.7360     0.3845    92.7500    89.0963
  82     0.1000     0.0070    99.7720     0.4844    90.9300    89.1114
  83     0.1000     0.0058    99.8260     0.3955    93.1000    89.1223
  84     0.1000     0.0072    99.7620     0.4066    92.6500    89.1628
  85     0.1000     0.0048    99.8580     0.4460    92.2500    89.0989
  86     0.1000     0.0052    99.8480     0.3851    93.1500    89.0409
  87     0.1000     0.0073    99.7500     0.4328    92.8100    89.0724
  88     0.1000     0.0077    99.7620     0.4134    92.9100    89.1155
  89     0.1000     0.0058    99.8340     0.3862    93.0400    89.1619
  90     0.1000     0.0048    99.8640     0.3847    93.2100    89.1187
  91     0.1000     0.0063    99.7820     0.3977    93.1000    89.1552
  92     0.1000     0.0073    99.7600     0.4131    92.8300    89.2007
  93     0.1000     0.0045    99.8600     0.3772    93.4000    89.1030
  94     0.1000     0.0072    99.7640     0.4357    92.5200    89.1063
  95     0.1000     0.0045    99.8540     0.3893    93.0500    89.1639
  96     0.1000     0.0061    99.7860     0.4477    92.2000    89.1303
  97     0.1000     0.0070    99.7780     0.4379    92.6800    89.0550
  98     0.1000     0.0059    99.8220     0.4187    92.7400    89.0682
  99     0.1000     0.0037    99.8800     0.4990    92.1100    89.2083
 100     0.1000     0.0044    99.8300     0.3826    93.5600    89.0522
 101     0.0988     0.0028    99.9160     0.4040    93.4800    89.1022
 102     0.0975     0.0027    99.9200     0.4814    92.1300    89.0844
 103     0.0963     0.0019    99.9480     0.3920    93.2800    89.2454
 104     0.0950     0.0027    99.9180     0.3945    93.6200    89.1622
 105     0.0938     0.0022    99.9460     0.3841    93.5000    89.2576
 106     0.0926     0.0009    99.9800     0.3690    93.7600    89.2083
 107     0.0913     0.0009    99.9780     0.3960    93.7400    89.0696
 108     0.0901     0.0017    99.9520     0.3902    93.8400    89.0972
 109     0.0889     0.0012    99.9640     0.4024    93.4700    89.0970
 110     0.0876     0.0016    99.9520     0.3975    93.6500    89.1539
 111     0.0864     0.0012    99.9720     0.3987    93.7000    89.2523
 112     0.0852     0.0009    99.9780     0.3938    93.7700    89.1354
 113     0.0839     0.0008    99.9880     0.3747    93.6000    89.1137
 114     0.0827     0.0005    99.9960     0.3934    93.6300    89.0536
 115     0.0814     0.0006    99.9880     0.3727    93.8100    89.1858
 116     0.0802     0.0004    99.9980     0.3679    93.9300    89.2163
 117     0.0790     0.0005    99.9900     0.3765    93.7800    89.1837
 118     0.0777     0.0006    99.9920     0.3795    93.7300    89.0620
 119     0.0765     0.0004    99.9900     0.3935    93.7100    89.1162
 120     0.0753     0.0004    99.9920     0.3739    94.0300    89.2003
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0003    99.9960     0.3710    94.0400    89.0775
 122     0.0728     0.0005    99.9900     0.3665    94.0000    89.1673
 123     0.0715     0.0002    99.9980     0.3628    94.1000    89.1179
 124     0.0703     0.0002    99.9980     0.3798    93.8500    89.0773
 125     0.0691     0.0003    99.9940     0.3711    94.0900    89.2105
 126     0.0678     0.0002    99.9980     0.3614    94.0900    89.1459
 127     0.0666     0.0002    99.9980     0.3645    94.2500    89.1222
 128     0.0654     0.0002    99.9980     0.3649    94.2600    89.1516
 129     0.0641     0.0002    99.9980     0.3692    94.2700    89.1584
 130     0.0629     0.0002    99.9980     0.3699    94.2800    89.2340
 131     0.0616     0.0001    99.9980     0.3589    94.1100    89.2348
 132     0.0604     0.0001    99.9980     0.3668    93.9800    89.2449
 133     0.0592     0.0002    99.9980     0.3753    94.1800    89.1191
 134     0.0579     0.0001   100.0000     0.3701    94.1700    89.1624
 135     0.0567     0.0002    99.9960     0.3837    93.9400    89.2629
 136     0.0554     0.0002    99.9940     0.3706    94.0900    89.0797
 137     0.0542     0.0002    99.9940     0.3735    94.1200    89.1248
 138     0.0530     0.0002    99.9960     0.3781    94.0100    89.2240
 139     0.0517     0.0001   100.0000     0.3689    94.0900    89.2100
 140     0.0505     0.0001   100.0000     0.3678    94.0100    89.1627
 141     0.0493     0.0002    99.9960     0.3786    93.9500    89.1217
 142     0.0480     0.0001   100.0000     0.3749    94.0600    89.2513
 143     0.0468     0.0001   100.0000     0.3745    93.9200    89.1748
 144     0.0456     0.0001   100.0000     0.3702    94.0400    89.1189
 145     0.0443     0.0001   100.0000     0.3703    94.0300    89.0934
 146     0.0431     0.0001   100.0000     0.3706    94.0700    89.0746
 147     0.0418     0.0001   100.0000     0.3680    94.0600    89.0612
 148     0.0406     0.0001   100.0000     0.3632    94.0200    89.1049
 149     0.0394     0.0001   100.0000     0.3704    94.1500    89.0923
 150     0.0381     0.0001   100.0000     0.3693    94.1000    89.1609
 151     0.0369     0.0001   100.0000     0.3654    94.0800    89.2220
 152     0.0357     0.0001    99.9980     0.3695    94.1200    89.1353
 153     0.0344     0.0001   100.0000     0.3716    94.0500    89.3647
 154     0.0332     0.0001   100.0000     0.3680    94.0300    89.0978
 155     0.0319     0.0001   100.0000     0.3740    94.0600    89.1498
 156     0.0307     0.0001   100.0000     0.3700    94.1400    89.0581
 157     0.0295     0.0001   100.0000     0.3636    94.1700    89.0561
 158     0.0282     0.0001   100.0000     0.3693    94.1100    89.0812
 159     0.0270     0.0001   100.0000     0.3690    94.0900    89.0491
 160     0.0257     0.0001   100.0000     0.3679    94.1700    89.0766
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0001   100.0000     0.3719    94.0900    89.0667
 162     0.0233     0.0001    99.9980     0.3700    94.2000    89.0884
 163     0.0220     0.0001   100.0000     0.3679    94.1800    89.1513
 164     0.0208     0.0001   100.0000     0.3690    94.1300    89.1605
 165     0.0196     0.0001   100.0000     0.3702    94.1900    89.2893
 166     0.0183     0.0001   100.0000     0.3679    94.0500    89.1224
 167     0.0171     0.0001   100.0000     0.3727    94.0800    89.0848
 168     0.0159     0.0001    99.9980     0.3679    94.1900    89.0626
 169     0.0146     0.0001   100.0000     0.3688    94.0700    89.1913
 170     0.0134     0.0001   100.0000     0.3670    94.1300    89.6867
 171     0.0121     0.0001   100.0000     0.3650    94.1000    89.1435
 172     0.0109     0.0001   100.0000     0.3667    94.1000    89.1224
 173     0.0097     0.0001   100.0000     0.3702    94.1100    89.2345
 174     0.0084     0.0001   100.0000     0.3655    94.1700    89.2021
 175     0.0072     0.0001   100.0000     0.3653    94.1600    89.0420
 176     0.0060     0.0001   100.0000     0.3672    94.1000    89.2106
 177     0.0047     0.0001   100.0000     0.3698    94.1200    89.0895
 178     0.0035     0.0001   100.0000     0.3710    94.1300    89.0594
 179     0.0022     0.0001   100.0000     0.3709    94.0400    89.1083
 180     0.0010     0.0001    99.9980     0.3595    94.1100    89.1090
 181     0.0010     0.0001   100.0000     0.3650    94.0300    89.0742
 182     0.0010     0.0001   100.0000     0.3636    94.1800    89.1245
 183     0.0010     0.0001   100.0000     0.3675    94.1000    89.0870
 184     0.0010     0.0001   100.0000     0.3676    94.0700    89.2030
 185     0.0010     0.0001   100.0000     0.3659    94.1500    89.1806
 186     0.0010     0.0001   100.0000     0.3700    94.0700    89.0987
 187     0.0010     0.0000   100.0000     0.3632    94.2400    89.3119
 188     0.0010     0.0001   100.0000     0.3698    93.9900    89.1863
 189     0.0010     0.0001   100.0000     0.3668    94.0400    89.1713
 190     0.0010     0.0001   100.0000     0.3682    94.1000    89.1851
 191     0.0010     0.0001   100.0000     0.3631    94.0300    89.1006
 192     0.0010     0.0001   100.0000     0.3636    94.2000    89.1600
 193     0.0010     0.0001   100.0000     0.3697    94.1500    89.2512
 194     0.0010     0.0001   100.0000     0.3738    94.0300    89.1993
 195     0.0010     0.0001   100.0000     0.3684    94.2400    89.1263
 196     0.0010     0.0001   100.0000     0.3653    94.1800    89.0877
 197     0.0010     0.0001   100.0000     0.3637    94.1400    89.0940
 198     0.0010     0.0001   100.0000     0.3698    94.1100    89.1207
 199     0.0010     0.0001   100.0000     0.3644    94.1300    89.1403
 200     0.0010     0.0001   100.0000     0.3688    94.2000    89.1820
