Files already downloaded and verified
You are going to run models on the test set. Are you sure?
Files already downloaded and verified
SGD (
Parameter Group 0
    dampening: 0
    lr: 0.1
    momentum: 0.0
    nesterov: False
    weight_decay: 0.0
)
total epochs: 200
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
   1     0.1000     1.4286    46.9720     1.6334    46.6100    92.4074
   2     0.1000     0.8996    68.0920     1.2366    61.6400    89.4247
   3     0.1000     0.6811    76.2940     0.8676    72.3900    89.4370
   4     0.1000     0.5559    80.6160     0.9990    70.5800    89.4750
   5     0.1000     0.4701    83.8720     0.9415    71.9700    89.5401
   6     0.1000     0.4112    85.8400     0.6480    78.1700    89.6212
   7     0.1000     0.3650    87.4160     0.7295    78.9200    89.4973
   8     0.1000     0.3283    88.6640     0.9743    72.4800    89.6100
   9     0.1000     0.2950    89.7960     0.4189    86.6200    89.3141
  10     0.1000     0.2680    90.7700     0.4065    86.9200    89.5991
  11     0.1000     0.2459    91.3780     0.4242    86.4800    89.4236
  12     0.1000     0.2232    92.1260     0.4644    86.5500    89.5241
  13     0.1000     0.2033    92.8260     0.5117    85.1400    89.3605
  14     0.1000     0.1898    93.3280     0.5893    83.0300    89.4340
  15     0.1000     0.1728    94.0760     0.3978    87.7500    89.6899
  16     0.1000     0.1581    94.3860     0.5166    85.9100    89.3362
  17     0.1000     0.1442    94.9520     0.4053    88.4600    89.5138
  18     0.1000     0.1321    95.4000     0.9292    78.7800    89.5873
  19     0.1000     0.1263    95.5400     0.4171    88.4400    89.5025
  20     0.1000     0.1128    96.0380     0.5899    84.6700    89.5099
  21     0.1000     0.1049    96.3060     0.4344    88.7600    89.4767
  22     0.1000     0.0949    96.6920     0.5108    86.9600    89.5725
  23     0.1000     0.0867    96.9780     0.4386    89.3000    89.4832
  24     0.1000     0.0806    97.1760     0.4943    87.8200    89.5423
  25     0.1000     0.0766    97.3300     0.5474    87.5600    89.5053
  26     0.1000     0.0719    97.4480     0.4886    88.6300    89.6190
  27     0.1000     0.0682    97.6520     0.4233    89.4900    89.6090
  28     0.1000     0.0638    97.8260     0.3580    90.4400    89.6502
  29     0.1000     0.0554    98.0720     0.3868    91.0200    89.5061
  30     0.1000     0.0512    98.1480     0.4333    89.6600    89.3918
  31     0.1000     0.0548    98.1020     0.4475    89.8700    89.5836
  32     0.1000     0.0479    98.3540     0.4263    89.5900    89.4035
  33     0.1000     0.0384    98.7060     0.3578    91.9300    89.4644
  34     0.1000     0.0413    98.6480     0.4135    90.9100    89.2897
  35     0.1000     0.0426    98.5080     0.3529    91.5300    89.4034
  36     0.1000     0.0348    98.8280     0.3858    91.3000    89.4374
  37     0.1000     0.0312    98.9320     0.4422    90.8000    89.5367
  38     0.1000     0.0296    98.9940     0.3519    92.1000    89.5221
  39     0.1000     0.0308    98.8940     0.3997    91.0800    89.5772
  40     0.1000     0.0221    99.2360     0.3652    92.2200    89.5067
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  41     0.1000     0.0323    98.8860     0.4052    91.7400    89.5190
  42     0.1000     0.0246    99.1660     0.3986    91.2100    89.7814
  43     0.1000     0.0252    99.1100     0.5209    89.5900    89.4653
  44     0.1000     0.0249    99.1500     0.4848    90.3700    89.5740
  45     0.1000     0.0203    99.3040     0.3632    92.4600    89.6088
  46     0.1000     0.0223    99.2400     0.3837    91.9500    89.5566
  47     0.1000     0.0166    99.4500     0.3876    92.3300    89.7001
  48     0.1000     0.0201    99.3160     0.4312    91.4800    89.4275
  49     0.1000     0.0205    99.2800     0.4693    90.6300    89.4205
  50     0.1000     0.0203    99.2900     0.3434    92.3000    89.4900
  51     0.1000     0.0158    99.4600     0.3633    92.2100    89.4353
  52     0.1000     0.0147    99.5580     0.4195    91.9800    89.5140
  53     0.1000     0.0153    99.4640     0.3564    92.6700    89.4385
  54     0.1000     0.0195    99.3100     0.4096    91.8100    89.6378
  55     0.1000     0.0165    99.4260     0.4032    92.2400    89.5851
  56     0.1000     0.0125    99.6160     0.5271    90.5700    89.3581
  57     0.1000     0.0130    99.5380     0.3767    92.6300    89.6572
  58     0.1000     0.0161    99.4540     0.4219    92.0600    89.5002
  59     0.1000     0.0186    99.3880     0.4972    90.7900    89.5226
  60     0.1000     0.0140    99.5440     0.3910    92.4700    89.5249
  61     0.1000     0.0109    99.6440     0.3773    92.6400    89.4057
  62     0.1000     0.0123    99.6180     0.5393    90.6400    89.6082
  63     0.1000     0.0103    99.6620     0.3626    92.9700    89.6090
  64     0.1000     0.0090    99.6920     0.3838    92.9000    89.5645
  65     0.1000     0.0084    99.7220     0.3753    92.7800    89.4765
  66     0.1000     0.0090    99.6980     0.4436    92.3300    89.5162
  67     0.1000     0.0093    99.6940     0.3732    92.7600    89.4397
  68     0.1000     0.0082    99.7440     0.4044    92.8500    89.5950
  69     0.1000     0.0086    99.7100     0.4144    91.9900    89.5041
  70     0.1000     0.0060    99.8380     0.3615    93.0700    89.6119
  71     0.1000     0.0073    99.7380     0.4601    92.2100    89.4657
  72     0.1000     0.0081    99.7060     0.3775    92.9900    89.3428
  73     0.1000     0.0085    99.7160     0.4015    92.4400    89.4180
  74     0.1000     0.0062    99.8000     0.3746    92.9300    89.4158
  75     0.1000     0.0058    99.8100     0.3643    93.1300    89.3809
  76     0.1000     0.0068    99.7600     0.3768    93.0900    89.2645
  77     0.1000     0.0052    99.8280     0.3791    93.4500    89.2987
  78     0.1000     0.0048    99.8660     0.3701    93.2500    89.3410
  79     0.1000     0.0032    99.9040     0.3773    93.0200    89.3412
  80     0.1000     0.0058    99.8280     0.4784    92.0200    89.3246
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
  81     0.1000     0.0093    99.6820     0.4396    92.0800    89.3029
  82     0.1000     0.0073    99.7620     0.4075    92.5200    89.4271
  83     0.1000     0.0069    99.7860     0.4066    92.7800    89.2941
  84     0.1000     0.0056    99.7980     0.3944    92.8900    89.2404
  85     0.1000     0.0050    99.8560     0.3653    93.4700    89.2571
  86     0.1000     0.0081    99.7400     0.5102    91.1300    89.3855
  87     0.1000     0.0069    99.7720     0.3745    93.1100    89.2512
  88     0.1000     0.0048    99.8660     0.3982    92.9800    89.2241
  89     0.1000     0.0038    99.8880     0.4233    92.9100    89.2202
  90     0.1000     0.0066    99.7820     0.3848    92.9700    89.5497
  91     0.1000     0.0085    99.7120     0.3783    93.3000    89.3569
  92     0.1000     0.0051    99.8360     0.4447    92.3100    89.3896
  93     0.1000     0.0054    99.8420     0.4628    92.1800    89.5277
  94     0.1000     0.0050    99.8500     0.3710    93.2200    89.3655
  95     0.1000     0.0050    99.8480     0.4057    93.0300    89.4571
  96     0.1000     0.0047    99.8460     0.4029    93.2200    89.3865
  97     0.1000     0.0039    99.8900     0.4165    92.8400    89.3291
  98     0.1000     0.0033    99.9100     0.3857    93.3300    89.5153
  99     0.1000     0.0028    99.9260     0.4322    93.1400    89.4126
 100     0.1000     0.0045    99.8440     0.4026    93.3200    89.5522
 101     0.0988     0.0050    99.8360     0.3939    93.1200    89.6809
 102     0.0975     0.0030    99.9120     0.4143    93.1800    89.5268
 103     0.0963     0.0031    99.9100     0.3970    93.3300    89.5090
 104     0.0950     0.0038    99.8860     0.3919    93.4300    89.4257
 105     0.0938     0.0020    99.9620     0.3848    93.5500    89.4368
 106     0.0926     0.0008    99.9960     0.3808    93.6600    89.6342
 107     0.0913     0.0011    99.9640     0.4195    93.2400    89.5052
 108     0.0901     0.0009    99.9760     0.3886    93.6500    89.5224
 109     0.0889     0.0008    99.9920     0.3836    93.9200    89.5317
 110     0.0876     0.0006    99.9860     0.3719    93.9600    89.4878
 111     0.0864     0.0005    99.9900     0.3771    93.9500    89.3492
 112     0.0852     0.0006    99.9920     0.3689    93.9600    89.4588
 113     0.0839     0.0004    99.9960     0.3684    94.0200    89.5411
 114     0.0827     0.0005    99.9900     0.3710    93.8900    89.6421
 115     0.0814     0.0005    99.9900     0.3623    93.8700    89.5675
 116     0.0802     0.0007    99.9820     0.3844    93.8400    89.5039
 117     0.0790     0.0004    99.9940     0.3866    93.9500    89.5117
 118     0.0777     0.0005    99.9920     0.3847    93.8800    89.5447
 119     0.0765     0.0003    99.9960     0.3877    94.0100    89.6138
 120     0.0753     0.0003    99.9960     0.3775    93.9600    89.7200
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 121     0.0740     0.0002    99.9980     0.3744    93.9600    89.4662
 122     0.0728     0.0002    99.9980     0.3725    94.0800    89.4077
 123     0.0715     0.0002    99.9960     0.3726    93.9900    89.5144
 124     0.0703     0.0002    99.9960     0.3802    94.0000    89.5251
 125     0.0691     0.0002    99.9940     0.3902    94.0900    89.4663
 126     0.0678     0.0002    99.9960     0.3775    94.0900    89.5200
 127     0.0666     0.0003    99.9920     0.3777    94.0000    89.6734
 128     0.0654     0.0002    99.9980     0.3829    94.1600    89.4547
 129     0.0641     0.0002    99.9980     0.3830    94.2000    89.5341
 130     0.0629     0.0001   100.0000     0.3756    94.3900    89.6083
 131     0.0616     0.0002    99.9960     0.3756    94.1600    89.4710
 132     0.0604     0.0001   100.0000     0.3736    94.2300    89.5544
 133     0.0592     0.0002    99.9980     0.3817    94.0800    89.6510
 134     0.0579     0.0001   100.0000     0.3733    94.0800    89.5261
 135     0.0567     0.0001   100.0000     0.3818    94.0100    89.5303
 136     0.0554     0.0001   100.0000     0.3763    94.0500    89.6704
 137     0.0542     0.0001   100.0000     0.3731    94.1200    89.4592
 138     0.0530     0.0002    99.9980     0.3802    94.1500    89.5255
 139     0.0517     0.0001    99.9980     0.3729    94.1600    89.7122
 140     0.0505     0.0002    99.9960     0.3752    94.0500    89.4502
 141     0.0493     0.0001    99.9960     0.3770    94.0000    89.4071
 142     0.0480     0.0001   100.0000     0.3789    94.0200    89.5384
 143     0.0468     0.0001    99.9980     0.3829    94.0000    89.4512
 144     0.0456     0.0002    99.9980     0.3828    93.7200    89.4266
 145     0.0443     0.0001   100.0000     0.3740    94.1600    89.5142
 146     0.0431     0.0001   100.0000     0.3753    94.0800    89.5663
 147     0.0418     0.0001   100.0000     0.3725    94.0300    89.7512
 148     0.0406     0.0001   100.0000     0.3689    93.9700    89.4690
 149     0.0394     0.0001   100.0000     0.3768    94.0200    89.4422
 150     0.0381     0.0001   100.0000     0.3728    94.1200    89.5629
 151     0.0369     0.0001    99.9980     0.3744    94.2000    89.6561
 152     0.0357     0.0001    99.9980     0.3798    94.2100    89.6334
 153     0.0344     0.0001   100.0000     0.3791    94.1400    89.5003
 154     0.0332     0.0002    99.9960     0.3879    94.0700    89.6749
 155     0.0319     0.0001   100.0000     0.3835    94.1300    89.4845
 156     0.0307     0.0001   100.0000     0.3792    94.1700    89.6876
 157     0.0295     0.0001   100.0000     0.3772    94.2200    89.7716
 158     0.0282     0.0001   100.0000     0.3795    94.0500    89.6090
 159     0.0270     0.0001   100.0000     0.3826    94.1200    89.4869
 160     0.0257     0.0001   100.0000     0.3751    94.0700    89.2790
----  ---------  ---------  ---------  ---------  ---------  ---------
  ep         lr    tr_loss     tr_acc     te_nll     te_acc       time
----  ---------  ---------  ---------  ---------  ---------  ---------
 161     0.0245     0.0001   100.0000     0.3876    94.2400    89.4306
 162     0.0233     0.0001    99.9980     0.3771    94.0800    89.3493
 163     0.0220     0.0001    99.9980     0.3785    94.1500    89.3584
 164     0.0208     0.0001   100.0000     0.3758    94.2500    89.2429
 165     0.0196     0.0001   100.0000     0.3769    94.1600    89.3269
 166     0.0183     0.0001   100.0000     0.3774    94.1600    89.2593
 167     0.0171     0.0001   100.0000     0.3794    94.1400    89.4296
 168     0.0159     0.0001   100.0000     0.3787    94.2700    89.3431
 169     0.0146     0.0001   100.0000     0.3786    94.1500    89.9933
 170     0.0134     0.0001   100.0000     0.3765    94.2200    89.5646
 171     0.0121     0.0001   100.0000     0.3730    94.1500    89.5306
 172     0.0109     0.0001   100.0000     0.3739    94.2400    89.4311
 173     0.0097     0.0001    99.9980     0.3781    94.2200    89.3737
 174     0.0084     0.0001   100.0000     0.3727    94.1300    89.4118
 175     0.0072     0.0001   100.0000     0.3742    94.3300    89.4387
 176     0.0060     0.0001   100.0000     0.3746    94.1600    89.3808
 177     0.0047     0.0001   100.0000     0.3795    94.2500    89.5575
 178     0.0035     0.0001   100.0000     0.3794    94.1000    89.7111
 179     0.0022     0.0001   100.0000     0.3754    94.0700    89.3929
 180     0.0010     0.0001    99.9980     0.3691    94.2700    89.3723
 181     0.0010     0.0001   100.0000     0.3758    94.1100    89.5867
 182     0.0010     0.0001   100.0000     0.3725    94.1500    89.5835
 183     0.0010     0.0001   100.0000     0.3743    94.2600    89.5754
 184     0.0010     0.0001   100.0000     0.3780    94.0900    89.5777
 185     0.0010     0.0001   100.0000     0.3750    94.2300    89.5284
 186     0.0010     0.0001   100.0000     0.3776    94.2500    89.4543
 187     0.0010     0.0001   100.0000     0.3722    94.2400    89.5656
 188     0.0010     0.0001    99.9980     0.3783    94.2000    89.4691
 189     0.0010     0.0001   100.0000     0.3712    94.1900    89.5575
 190     0.0010     0.0001   100.0000     0.3790    94.0800    89.5787
 191     0.0010     0.0001   100.0000     0.3717    94.0800    89.6715
 192     0.0010     0.0001    99.9980     0.3740    94.2300    89.4846
 193     0.0010     0.0001   100.0000     0.3772    94.1700    89.8105
 194     0.0010     0.0001   100.0000     0.3808    94.2200    89.5699
 195     0.0010     0.0001   100.0000     0.3766    94.1500    89.8431
 196     0.0010     0.0001   100.0000     0.3735    94.2000    89.5349
 197     0.0010     0.0001   100.0000     0.3721    94.1600    89.4109
 198     0.0010     0.0001   100.0000     0.3790    94.2900    89.3189
 199     0.0010     0.0001   100.0000     0.3740    94.2100    89.3673
 200     0.0010     0.0001   100.0000     0.3772    94.1700    89.4223
