copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 147.61999999999998
Index size:  406028.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0764316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038705090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1114.77 < 1139.4
  -> Decision False in time 0.0200000000, query time of that 0.0099476840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1193.24 < 1226.22
  -> Decision False in time 0.0100000000, query time of that 0.0094187740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1776.7 < 1865.34
  -> Decision False in time 0.0100000000, query time of that 0.0016118160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1581.18 < 1614.24
  -> Decision False in time 0.0300000000, query time of that 0.0053972400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1626.51 < 1638.26
  -> Decision False in time 0.0200000000, query time of that 0.0054373510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1056.51 < 1065.94
  -> Decision False in time 0.0100000000, query time of that 0.0014393300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
470.238 < 511.236
  -> Decision False in time 0.0300000000, query time of that 0.0024914890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1372.68 < 1383.02
  -> Decision False in time 0.0000000000, query time of that 0.0017253800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 368.34
Index size:  272080.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0404409170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4100000000, query time of that 0.4044958900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.0800000000, query time of that 4.0035378270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0440266670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4298388720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.4000000000, query time of that 4.2252349200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0519554630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.5620584130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7000000000, query time of that 5.8045784410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 389.53999999999996
Index size:  262028.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0142822000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1371613160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5100000000, query time of that 1.4585287290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0155057690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1667821920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8200000000, query time of that 1.6699856830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0187092270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1715210980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8900000000, query time of that 1.7250978400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 392.22
Index size:  211568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0287385790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2794899890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.8100000000, query time of that 2.7502710530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0301305480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2740115120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.0900000000, query time of that 2.9459684000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0309249910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.3528102360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3200000000, query time of that 3.9651576640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 392.35000000000036
Index size:  230476.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0494758130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4619658530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.6400000000, query time of that 4.5830612300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0523858570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5200000000, query time of that 0.5047406340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.0900000000, query time of that 4.9912268140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0538772780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.6680993690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.8600000000, query time of that 6.8677316450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 146.42000000000007
Index size:  196932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0007800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083128160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0760392920, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7690828260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0085795750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0901025970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.8811352710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0096937260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2496.79 < 2545.11
  -> Decision False in time 0.4600000000, query time of that 0.0530425340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1572.87 < 1589.11
  -> Decision False in time 1.3200000000, query time of that 0.1389596470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 388.34000000000015
Index size:  250740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0124959660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1255731430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.2163205140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0146087170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1376164760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5000000000, query time of that 1.3657152480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0148888710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1388990740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0300000000, query time of that 1.3551707910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 367.5199999999995
Index size:  203040.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0273935700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2456294170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3400000000, query time of that 2.2828115930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0233028980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2445996250, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6200000000, query time of that 2.5102608640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0280870340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.3119819830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6200000000, query time of that 3.1795772730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 391.64999999999964
Index size:  264212.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0189738400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1839611350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8200000000, query time of that 1.7671311200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0204499270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1918581770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0800000000, query time of that 1.9175857170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0201787570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2136201890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1400000000, query time of that 2.0832354550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 373.34000000000015
Index size:  215220.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0133782060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1200453450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.2448201810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0149539350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1408285460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5800000000, query time of that 1.4051752190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0147495300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1429222060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 1.4481274020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 372.09000000000015
Index size:  248288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082995940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0682229900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7300000000, query time of that 0.6904442260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0079434160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0800646140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.7806410470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0083638670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0775469800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1869.32 < 1878.6
  -> Decision False in time 7.2200000000, query time of that 0.6649674290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 368.1400000000003
Index size:  241308.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054105300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0444039650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4342277450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0048553270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0498842610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1452.26 < 1457.24
  -> Decision False in time 0.2000000000, query time of that 0.1276643220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0051380960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0503704750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1285.9 < 1297.03
  -> Decision False in time 0.8500000000, query time of that 0.0541454190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 392.53999999999996
Index size:  264312.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0137635900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1314411330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.3201260560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127702480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1492137430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6400000000, query time of that 1.4825415670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0159215400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1573792230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1615.79 < 1622.86
  -> Decision False in time 3.3100000000, query time of that 0.6209080750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 392.3000000000002
Index size:  210036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0203486260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1948252370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9400000000, query time of that 1.8798020180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0213606910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2105030110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2100000000, query time of that 2.1049412490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0212768140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2409225220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5500000000, query time of that 2.5347533410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 389.3600000000006
Index size:  221768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0106220300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0895919590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.9195285580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099824210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1037980290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2300000000, query time of that 1.0265357370, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0102579930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1041619070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1650.13 < 1656.57
  -> Decision False in time 2.3700000000, query time of that 0.2995858180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 371.39999999999964
Index size:  209492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042234130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0356691560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1715.85 < 1742.79
  -> Decision False in time 0.1800000000, query time of that 0.1592560700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035885780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0405606600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1074.75 < 1110.96
  -> Decision False in time 0.0600000000, query time of that 0.0282290040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0041474360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1481.39 < 1487.82
  -> Decision False in time 0.2000000000, query time of that 0.0128088410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1857.84 < 1880.31
  -> Decision False in time 0.5000000000, query time of that 0.0279360320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 146.9499999999989
Index size:  203112.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067066220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0595237830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1821.06 < 1843.73
  -> Decision False in time 0.3000000000, query time of that 0.2736544200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062073190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0677213340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1151.63 < 1436.9
  -> Decision False in time 0.0200000000, query time of that 0.0208795240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1734.54 < 1777.47
  -> Decision False in time 0.0100000000, query time of that 0.0068222170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1487.68 < 1627.11
  -> Decision False in time 0.1900000000, query time of that 0.0198311520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1350.05 < 1364.21
  -> Decision False in time 0.0700000000, query time of that 0.0071107760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 111.7599999999984
Index size:  185580.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0073153310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0665352470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
993.506 < 1208.83
  -> Decision False in time 0.6300000000, query time of that 0.5831967070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070777290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0737750430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1315.54 < 1334.36
  -> Decision False in time 0.2100000000, query time of that 0.1860677100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0078298570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
939.443 < 998.606
  -> Decision False in time 0.0900000000, query time of that 0.0112325430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1320.2 < 1420.48
  -> Decision False in time 0.1000000000, query time of that 0.0149036050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 77.30000000000109
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1446083333
  Testing...
|S| = 20
|T| = 283
Reject!
1827.76 < 1951.01
  -> Decision False in time 0.0000000000, query time of that 0.0028166520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2414.47 < 2509.33
  -> Decision False in time 0.0100000000, query time of that 0.0088351050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1897.45 < 2015.09
  -> Decision False in time 0.0100000000, query time of that 0.0031084730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2370.82 < 2371.43
  -> Decision False in time 0.0000000000, query time of that 0.0020925890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1816.66 < 1899.77
  -> Decision False in time 0.0100000000, query time of that 0.0046859710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1674.01 < 1829.49
  -> Decision False in time 0.0000000000, query time of that 0.0022627850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1432.6 < 1738.3
  -> Decision False in time 0.0100000000, query time of that 0.0022075140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2255.17 < 2448.51
  -> Decision False in time 0.0000000000, query time of that 0.0021763800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1562.21 < 1651.93
  -> Decision False in time 0.0000000000, query time of that 0.0020452910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 146.70000000000073
Index size:  191120.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0086516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043035610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0326691570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1905.38 < 2019.85
  -> Decision False in time 0.3000000000, query time of that 0.2671996830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034854280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1880.82 < 1958.33
  -> Decision False in time 0.0300000000, query time of that 0.0194233260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1458.93 < 1528.63
  -> Decision False in time 0.0800000000, query time of that 0.0395296010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0039446550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1795.89 < 1826.11
  -> Decision False in time 0.5300000000, query time of that 0.0259033770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1645.16 < 1649.35
  -> Decision False in time 0.2300000000, query time of that 0.0119913690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 111.94999999999891
Index size:  188544.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0112538430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0997522270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9751773600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102688200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1086798850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.1038481490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0111776130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1121.27 < 1348.68
  -> Decision False in time 0.7500000000, query time of that 0.1069595360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1339.86 < 1387.11
  -> Decision False in time 0.2400000000, query time of that 0.0357576140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 77.6299999999992
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0485583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040402480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2182.36 < 2267.31
  -> Decision False in time 0.0100000000, query time of that 0.0072311510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1963.11 < 2015.91
  -> Decision False in time 0.0000000000, query time of that 0.0071145680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035814780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1765.31 < 1781.54
  -> Decision False in time 0.0000000000, query time of that 0.0038625350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1700.64 < 1841.23
  -> Decision False in time 0.0100000000, query time of that 0.0075372950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1180.52 < 1512.87
  -> Decision False in time 0.0100000000, query time of that 0.0038110020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1800.08 < 1817.83
  -> Decision False in time 0.0100000000, query time of that 0.0036732720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1698.3 < 1749.78
  -> Decision False in time 0.0800000000, query time of that 0.0056800920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 147.04999999999927
Index size:  190756.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0085542700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0703032740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6948199750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077325300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0793363740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2382.46 < 2448.96
  -> Decision False in time 0.2600000000, query time of that 0.2400408590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0084634570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
972.263 < 1104.24
  -> Decision False in time 0.7200000000, query time of that 0.0697751760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1671.15 < 1750.88
  -> Decision False in time 2.9100000000, query time of that 0.2769315700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 111.54000000000087
Index size:  188520.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0086719210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0794215770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.7931508030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0090446410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0914230990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2035.11 < 2039.36
  -> Decision False in time 0.9100000000, query time of that 0.8313143660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0086820330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1597.05 < 1651.54
  -> Decision False in time 0.3100000000, query time of that 0.0396216200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1281.38 < 1385.09
  -> Decision False in time 0.5600000000, query time of that 0.0631375150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 390.9200000000001
Index size:  257960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0115687930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1057954350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1000000000, query time of that 1.0466791890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0104665990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1157292350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.1824422740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0129430730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1220728550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7800000000, query time of that 1.1844319430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 367.75
Index size:  203280.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0175876730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1579718770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6300000000, query time of that 1.5769947260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0185363600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1783427350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.7824775590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0187151160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2006897200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1700000000, query time of that 1.9398291130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 368.3899999999994
Index size:  246404.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056793120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0489312550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5084543010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0059698200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0582808500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.5793706330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060933850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0587953060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1721.37 < 1773.09
  -> Decision False in time 0.6400000000, query time of that 0.0500379000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 77.25
Index size:  196916.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5962916667
  Testing...
|S| = 20
|T| = 283
Reject!
2245.63 < 2332.63
  -> Decision False in time 0.0000000000, query time of that 0.0019840940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2175.03 < 2223.19
  -> Decision False in time 0.0000000000, query time of that 0.0012958480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1503.05 < 1719.32
  -> Decision False in time 0.0000000000, query time of that 0.0012813000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2598.37 < 2622.2
  -> Decision False in time 0.0000000000, query time of that 0.0012370100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2008.82 < 2061.83
  -> Decision False in time 0.0100000000, query time of that 0.0012233710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1738.81 < 1805.17
  -> Decision False in time 0.0000000000, query time of that 0.0012592820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2419.34 < 2453.99
  -> Decision False in time 0.0000000000, query time of that 0.0012164110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1922.83 < 1939.4
  -> Decision False in time 0.0000000000, query time of that 0.0011594780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2151.02 < 2193.74
  -> Decision False in time 0.0000000000, query time of that 0.0011890270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 112.06999999999971
Index size:  181768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1217550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0025056150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1646.32 < 1693.28
  -> Decision False in time 0.0100000000, query time of that 0.0038384130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1691.53 < 1698.79
  -> Decision False in time 0.0000000000, query time of that 0.0048922030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1173.26 < 1216.76
  -> Decision False in time 0.0000000000, query time of that 0.0017355730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1407.46 < 1414.99
  -> Decision False in time 0.0200000000, query time of that 0.0038179190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1629.35 < 1657.77
  -> Decision False in time 0.0000000000, query time of that 0.0019355780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1879.6 < 1881.29
  -> Decision False in time 0.0000000000, query time of that 0.0019653300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1406.93 < 1417.53
  -> Decision False in time 0.0200000000, query time of that 0.0017909750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1354.43 < 1394.79
  -> Decision False in time 0.0100000000, query time of that 0.0021249810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 389.1800000000003
Index size:  261960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0262916160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2326464780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3300000000, query time of that 2.2884721950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226988150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2417294920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7500000000, query time of that 2.5737065640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0276551980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.3052269040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0000000000, query time of that 3.2890455400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 390.130000000001
Index size:  225764.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066603690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0603572750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5894518480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065787120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0686028330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.6727529480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0071559860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0679453020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1928.87 < 1944.06
  -> Decision False in time 0.7000000000, query time of that 0.0606517530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 390.0799999999999
Index size:  217572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0169550050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1607621070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5800000000, query time of that 1.5380732890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0165032830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1739437820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9300000000, query time of that 1.7424684380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0162713230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.2077560760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6100000000, query time of that 1.9149397250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 77.05000000000109
Index size:  190380.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0156366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066304290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0568747960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1799.48 < 1947.87
  -> Decision False in time 0.0300000000, query time of that 0.0325920290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062084990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2001.67 < 2002.52
  -> Decision False in time 0.0200000000, query time of that 0.0161373680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1744.62 < 1815.42
  -> Decision False in time 0.0200000000, query time of that 0.0120901910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060299320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1301.42 < 1635.43
  -> Decision False in time 0.0900000000, query time of that 0.0131528850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1808.18 < 1912.17
  -> Decision False in time 0.0100000000, query time of that 0.0067361780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 367.6800000000003
Index size:  207648.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083168200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0780592410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7688838890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083769900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0863329350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.8867689900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0093858430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0885242900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7900000000, query time of that 0.8651755990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 146.39999999999964
Index size:  205944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0039833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048168590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0412099610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1492.76 < 1598.44
  -> Decision False in time 0.2900000000, query time of that 0.2678937100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0045706590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1514.58 < 1530.43
  -> Decision False in time 0.0100000000, query time of that 0.0101643990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1765.47 < 1794.34
  -> Decision False in time 0.0100000000, query time of that 0.0096365620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046256970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1491.03 < 1500.22
  -> Decision False in time 0.1900000000, query time of that 0.0149785830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1351.84 < 1354.83
  -> Decision False in time 0.2900000000, query time of that 0.0191029880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 368.27999999999884
Index size:  239796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103139140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0911737630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9101093880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101138690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1071938710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.0350170780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0108115930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1025111840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1692.85 < 1697.92
  -> Decision False in time 7.6600000000, query time of that 0.9359598870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 111.96999999999935
Index size:  199076.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072276680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0569872960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1599.73 < 1696.24
  -> Decision False in time 0.4600000000, query time of that 0.4234515580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0060273970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0636536390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1863.21 < 1896.93
  -> Decision False in time 0.2400000000, query time of that 0.1854277140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0066018040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0623662970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1100.53 < 1147.33
  -> Decision False in time 0.1800000000, query time of that 0.0162673620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 147.26000000000022
Index size:  188200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4503916667
  Testing...
|S| = 20
|T| = 283
Reject!
1800.33 < 2019.08
  -> Decision False in time 0.0000000000, query time of that 0.0022925200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1430.22 < 1468.15
  -> Decision False in time 0.0000000000, query time of that 0.0020626350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1789.39 < 1817.84
  -> Decision False in time 0.0100000000, query time of that 0.0033915880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
503.496 < 509.361
  -> Decision False in time 0.0000000000, query time of that 0.0013245000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1499.29 < 1520.65
  -> Decision False in time 0.0000000000, query time of that 0.0016442090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1709.68 < 1817.18
  -> Decision False in time 0.0000000000, query time of that 0.0014962550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2181.61 < 2226.49
  -> Decision False in time 0.0100000000, query time of that 0.0016120590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1811.89 < 1952.35
  -> Decision False in time 0.0000000000, query time of that 0.0014540000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1254.48 < 1333.76
  -> Decision False in time 0.0000000000, query time of that 0.0015916000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 111.85999999999876
Index size:  188560.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0185000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038028060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0273504770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1778.14 < 1791.37
  -> Decision False in time 0.0100000000, query time of that 0.0090934670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028981740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1420.85 < 1439.27
  -> Decision False in time 0.0000000000, query time of that 0.0032586870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1485 < 1504.09
  -> Decision False in time 0.0700000000, query time of that 0.0284539840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0032585720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1547.7 < 1571.85
  -> Decision False in time 0.0100000000, query time of that 0.0034722520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1812.1 < 1827.8
  -> Decision False in time 0.0400000000, query time of that 0.0033887660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 77.09000000000015
Index size:  183792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0835416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0036265270, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1649.73 < 1656.49
  -> Decision False in time 0.0200000000, query time of that 0.0132046640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1125.05 < 1187.6
  -> Decision False in time 0.0100000000, query time of that 0.0055995470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027450160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1117.18 < 1157.18
  -> Decision False in time 0.0100000000, query time of that 0.0088156990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1980.55 < 2057.48
  -> Decision False in time 0.0100000000, query time of that 0.0027475460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1980.76 < 2001.1
  -> Decision False in time 0.0000000000, query time of that 0.0027127140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1309.24 < 1326.37
  -> Decision False in time 0.0000000000, query time of that 0.0027823430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2093.71 < 2478.1
  -> Decision False in time 0.0000000000, query time of that 0.0026522730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 76.95000000000073
Index size:  186740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4008050000
  Testing...
|S| = 20
|T| = 283
Reject!
1883.76 < 2004.25
  -> Decision False in time 0.0000000000, query time of that 0.0020738960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2016.48 < 2381.67
  -> Decision False in time 0.0000000000, query time of that 0.0014879880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2047.92 < 2153.51
  -> Decision False in time 0.0100000000, query time of that 0.0013859520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2120.63 < 2242.76
  -> Decision False in time 0.0000000000, query time of that 0.0014149050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1364.91 < 2085.23
  -> Decision False in time 0.0000000000, query time of that 0.0014877460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1876.55 < 1884.14
  -> Decision False in time 0.0000000000, query time of that 0.0014282310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2066.48 < 2073.62
  -> Decision False in time 0.0000000000, query time of that 0.0014173030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1410.88 < 1627.75
  -> Decision False in time 0.0100000000, query time of that 0.0015064330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2543.88 < 2638.68
  -> Decision False in time 0.0000000000, query time of that 0.0014283340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 76.81000000000131
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2344983333
  Testing...
|S| = 20
|T| = 283
Reject!
1452.6 < 1512.4
  -> Decision False in time 0.0100000000, query time of that 0.0025572500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1992.55 < 2332.28
  -> Decision False in time 0.0000000000, query time of that 0.0027189630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1673.52 < 2015.84
  -> Decision False in time 0.0000000000, query time of that 0.0034134720, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1857.59 < 2204.35
  -> Decision False in time 0.0100000000, query time of that 0.0015714480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2391.99 < 2458.23
  -> Decision False in time 0.0000000000, query time of that 0.0017119070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1728.56 < 1904.79
  -> Decision False in time 0.0000000000, query time of that 0.0017605320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2123.73 < 2323.46
  -> Decision False in time 0.0000000000, query time of that 0.0017070280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2009.23 < 2118.12
  -> Decision False in time 0.0100000000, query time of that 0.0016499440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1003.42 < 1033.1
  -> Decision False in time 0.0000000000, query time of that 0.0019817270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 112.15000000000146
Index size:  188932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0502950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028772750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2105.69 < 2187.03
  -> Decision False in time 0.0200000000, query time of that 0.0095916210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1500.45 < 1527.17
  -> Decision False in time 0.0000000000, query time of that 0.0038693860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1473.58 < 1494.65
  -> Decision False in time 0.0100000000, query time of that 0.0021268100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1838.44 < 1950.15
  -> Decision False in time 0.0000000000, query time of that 0.0024228490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1710.52 < 1727.16
  -> Decision False in time 0.0200000000, query time of that 0.0070911180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1571.39 < 1576.42
  -> Decision False in time 0.0100000000, query time of that 0.0024630770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1559.45 < 1678.1
  -> Decision False in time 0.0000000000, query time of that 0.0024944380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1262.94 < 1265.21
  -> Decision False in time 0.0500000000, query time of that 0.0022543520, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 368.5099999999984
Index size:  250296.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036368640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0270338940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1096.6 < 1103.15
  -> Decision False in time 0.0900000000, query time of that 0.0798450400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028908050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1277.95 < 1278.91
  -> Decision False in time 0.0100000000, query time of that 0.0063434440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1744.99 < 1752.45
  -> Decision False in time 0.0200000000, query time of that 0.0061530990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
711.414 < 738.63
  -> Decision False in time 0.0000000000, query time of that 0.0031373860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1297.83 < 1318.87
  -> Decision False in time 0.1200000000, query time of that 0.0065574660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1273.32 < 1274.11
  -> Decision False in time 0.0100000000, query time of that 0.0034232850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 112.08999999999651
Index size:  201416.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2786550000
  Testing...
|S| = 20
|T| = 283
Reject!
1454.79 < 1556.51
  -> Decision False in time 0.0000000000, query time of that 0.0022183290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1673.89 < 1735.91
  -> Decision False in time 0.0000000000, query time of that 0.0024547570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2029.53 < 2056.92
  -> Decision False in time 0.0100000000, query time of that 0.0050527200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1815.09 < 1898.65
  -> Decision False in time 0.0000000000, query time of that 0.0014927020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2227.93 < 2283.02
  -> Decision False in time 0.0000000000, query time of that 0.0014277030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2468.78 < 2677.69
  -> Decision False in time 0.0000000000, query time of that 0.0014907740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1317.04 < 1330.44
  -> Decision False in time 0.0100000000, query time of that 0.0014979610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1547.93 < 1643.75
  -> Decision False in time 0.0000000000, query time of that 0.0016317730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1982.27 < 2090.5
  -> Decision False in time 0.0000000000, query time of that 0.0016023750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 111.47999999999956
Index size:  180460.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5677050000
  Testing...
|S| = 20
|T| = 283
Reject!
2094.36 < 2305.93
  -> Decision False in time 0.0000000000, query time of that 0.0022168530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2235.67 < 2508.6
  -> Decision False in time 0.0000000000, query time of that 0.0021717340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1641.07 < 1644.61
  -> Decision False in time 0.0000000000, query time of that 0.0015253080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
450.312 < 489.199
  -> Decision False in time 0.0100000000, query time of that 0.0011797890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1506.2 < 1655.27
  -> Decision False in time 0.0000000000, query time of that 0.0012934750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2072.35 < 2108.04
  -> Decision False in time 0.0000000000, query time of that 0.0012642920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2306.38 < 2328.42
  -> Decision False in time 0.0000000000, query time of that 0.0012868380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2014.35 < 2214.17
  -> Decision False in time 0.0100000000, query time of that 0.0012378730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1656.03 < 2004.25
  -> Decision False in time 0.0000000000, query time of that 0.0012567270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 368.23999999999796
Index size:  253612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0127321940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1167689200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1900000000, query time of that 1.1376320100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0124894970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1308212010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4800000000, query time of that 1.2988602340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0130124660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1320075250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1697.51 < 1728.66
  -> Decision False in time 2.9500000000, query time of that 0.4706355310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 77.11000000000058
Index size:  195964.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0298383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047201060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1933.92 < 1973.41
  -> Decision False in time 0.0300000000, query time of that 0.0311858720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1926.25 < 1975.54
  -> Decision False in time 0.0500000000, query time of that 0.0419753550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042723080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1978.96 < 2009.21
  -> Decision False in time 0.0100000000, query time of that 0.0047530730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1462.17 < 1712.82
  -> Decision False in time 0.0100000000, query time of that 0.0092261640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1736.2 < 1762.54
  -> Decision False in time 0.0100000000, query time of that 0.0044701300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1525.35 < 1582.28
  -> Decision False in time 0.0100000000, query time of that 0.0046699630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1883.95 < 1952.22
  -> Decision False in time 0.1000000000, query time of that 0.0097615830, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 389.5499999999993
Index size:  248828.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0224451400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2120087510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.2000000000, query time of that 2.1508730580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0248832130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2450234840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5800000000, query time of that 2.4463777740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0268421410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2914678750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.9200000000, query time of that 3.0205971380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 146.02000000000044
Index size:  192892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059328960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0487771160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1691.34 < 1729.42
  -> Decision False in time 0.1700000000, query time of that 0.1551239230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052381840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0560958570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2035.11 < 2039.36
  -> Decision False in time 0.8400000000, query time of that 0.5578332070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0055005130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1371.19 < 1374.32
  -> Decision False in time 0.5900000000, query time of that 0.0435291870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1642.83 < 1693.63
  -> Decision False in time 0.2800000000, query time of that 0.0236821690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 146.53000000000247
Index size:  177244.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2118066667
  Testing...
|S| = 20
|T| = 283
Reject!
1976.58 < 2158.28
  -> Decision False in time 0.0100000000, query time of that 0.0023691050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1262.38 < 1338.91
  -> Decision False in time 0.0000000000, query time of that 0.0035675500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1653.05 < 1735.7
  -> Decision False in time 0.0100000000, query time of that 0.0040727310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
594.921 < 731.25
  -> Decision False in time 0.0000000000, query time of that 0.0016704140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1680.21 < 1690.59
  -> Decision False in time 0.0000000000, query time of that 0.0018338040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1593.33 < 1627.82
  -> Decision False in time 0.0100000000, query time of that 0.0018662800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2148.65 < 2204.83
  -> Decision False in time 0.0000000000, query time of that 0.0017682290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1613.32 < 1627.51
  -> Decision False in time 0.0000000000, query time of that 0.0017696340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1504.14 < 1526.49
  -> Decision False in time 0.0000000000, query time of that 0.0017437310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 390.0600000000013
Index size:  257092.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0389136580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3798734380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.7400000000, query time of that 3.6765699480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0423523820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.4067122100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.2600000000, query time of that 4.0322661540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0400667880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.5517892270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.6500000000, query time of that 5.5498025290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 112.31000000000131
Index size:  192180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0035400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052617010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0452042650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4439443780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049333540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1060.39 < 1517.52
  -> Decision False in time 0.0600000000, query time of that 0.0402668310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1523.4 < 1720.89
  -> Decision False in time 0.0400000000, query time of that 0.0248438290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0051378820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1165.73 < 1257.61
  -> Decision False in time 0.3400000000, query time of that 0.0234170520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1679.91 < 1731.99
  -> Decision False in time 0.0600000000, query time of that 0.0054243640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 369.7599999999984
Index size:  238924.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0823150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033511650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1502.3 < 1568.87
  -> Decision False in time 0.0000000000, query time of that 0.0033487250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
528.882 < 557.435
  -> Decision False in time 0.0200000000, query time of that 0.0136537900, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1950.75 < 2199.03
  -> Decision False in time 0.0000000000, query time of that 0.0022057560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1273.83 < 1310.92
  -> Decision False in time 0.0100000000, query time of that 0.0022913080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1491.98 < 1598.24
  -> Decision False in time 0.0000000000, query time of that 0.0025781700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1246.56 < 1282.26
  -> Decision False in time 0.0400000000, query time of that 0.0024279440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1164.77 < 1197.46
  -> Decision False in time 0.0200000000, query time of that 0.0027331590, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1240.54 < 1334.63
  -> Decision False in time 0.0200000000, query time of that 0.0027056530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 389.5400000000009
Index size:  269760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092716860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0789822890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7682928320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0085565730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0869449930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1345.99 < 1347.67
  -> Decision False in time 0.0800000000, query time of that 0.0799328920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0084524870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0883899370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7700000000, query time of that 0.8602397930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 145.83000000000175
Index size:  191240.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0143833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037771770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0286182640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1883.56 < 1891.03
  -> Decision False in time 0.0200000000, query time of that 0.0121998150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0031853350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1772.23 < 1831.83
  -> Decision False in time 0.0300000000, query time of that 0.0154584870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1736.81 < 1820.5
  -> Decision False in time 0.1100000000, query time of that 0.0490750600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1513.48 < 1550
  -> Decision False in time 0.0200000000, query time of that 0.0035185020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1952.09 < 1963.62
  -> Decision False in time 0.0100000000, query time of that 0.0034853180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1326.96 < 1333.38
  -> Decision False in time 0.0600000000, query time of that 0.0033135610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 147.1800000000003
Index size:  177496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0279750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034785750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0239568470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1947.02 < 1963.69
  -> Decision False in time 0.0400000000, query time of that 0.0299799240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025452730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1469.06 < 1470.72
  -> Decision False in time 0.0300000000, query time of that 0.0141080770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1619.08 < 1624.68
  -> Decision False in time 0.0100000000, query time of that 0.0029569920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
901.489 < 905.357
  -> Decision False in time 0.0200000000, query time of that 0.0030017290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1039.33 < 1120.32
  -> Decision False in time 0.0500000000, query time of that 0.0031136060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1526.56 < 1605.98
  -> Decision False in time 0.0100000000, query time of that 0.0031054370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 147.36000000000058
Index size:  190884.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0006583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103963950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.1014507360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0600000000, query time of that 1.0047773290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0107834670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1151044630, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.1583518500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0114129760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1240725840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1170.6 < 1203.95
  -> Decision False in time 2.4900000000, query time of that 0.3518598350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 77.15000000000146
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0211766667
  Testing...
|S| = 20
|T| = 283
Reject!
1942.68 < 2277.58
  -> Decision False in time 0.0100000000, query time of that 0.0055089830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0451709080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1305.83 < 1486.43
  -> Decision False in time 0.0100000000, query time of that 0.0112196150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049970640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1993.39 < 2025.56
  -> Decision False in time 0.0200000000, query time of that 0.0149590200, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2164.7 < 2232.56
  -> Decision False in time 0.0700000000, query time of that 0.0497586690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1794.55 < 1858.5
  -> Decision False in time 0.0300000000, query time of that 0.0052324680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1576.24 < 1724.66
  -> Decision False in time 0.0100000000, query time of that 0.0054211160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1628.83 < 1747.43
  -> Decision False in time 0.0800000000, query time of that 0.0077332090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 76.94999999999709
Index size:  180208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8137400000
  Testing...
|S| = 20
|T| = 283
Reject!
1718.3 < 2010.07
  -> Decision False in time 0.0000000000, query time of that 0.0014984920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1167.21 < 1475.23
  -> Decision False in time 0.0000000000, query time of that 0.0010941580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1772.23 < 2165.93
  -> Decision False in time 0.0000000000, query time of that 0.0010244350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1554.36 < 1556.25
  -> Decision False in time 0.0000000000, query time of that 0.0009320910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1510.77 < 1862.37
  -> Decision False in time 0.0000000000, query time of that 0.0009626760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2149.81 < 2190.05
  -> Decision False in time 0.0100000000, query time of that 0.0009067960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1824.68 < 1890.92
  -> Decision False in time 0.0000000000, query time of that 0.0008301810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2685.19 < 2712.52
  -> Decision False in time 0.0000000000, query time of that 0.0009150310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1798.95 < 2392.8
  -> Decision False in time 0.0000000000, query time of that 0.0009349980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 111.78000000000247
Index size:  185952.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0091933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0040956810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0326346000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1559.3 < 1615.6
  -> Decision False in time 0.0100000000, query time of that 0.0073081060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033926850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1607.81 < 1634.39
  -> Decision False in time 0.0400000000, query time of that 0.0197023340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1441.36 < 1461.32
  -> Decision False in time 0.1400000000, query time of that 0.0717365090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0039730180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
468.897 < 469.89
  -> Decision False in time 0.0000000000, query time of that 0.0040483270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1352.1 < 1374.04
  -> Decision False in time 0.1100000000, query time of that 0.0079592550, with c1=5.0000000000, c2=0.1000000000
