copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 109.1
Index size:  400476.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055875280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0341324850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1277.13 < 1310.9
  -> Decision False in time 0.0800000000, query time of that 0.0654331410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0036482150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0387904670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1009.21 < 1012.38
  -> Decision False in time 0.1600000000, query time of that 0.0819953940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0039071230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
965.009 < 1003.63
  -> Decision False in time 0.2800000000, query time of that 0.0161961000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1088.64 < 1150
  -> Decision False in time 0.0100000000, query time of that 0.0039224020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 302.73
Index size:  280900.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088090490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0805550310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7820523640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0097560440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0941171590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1800000000, query time of that 0.9219410430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0087849450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0889899710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9000000000, query time of that 0.9022758510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 301.16999999999996
Index size:  203816.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0185749910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1487545030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5700000000, query time of that 1.5180160850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0177414930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.1865669960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9500000000, query time of that 1.8043471570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0203084490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1950634010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1500000000, query time of that 2.0041692860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 109.75999999999999
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072672070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0623930690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6700000000, query time of that 0.6225186850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0074427270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2043.02 < 2047.21
  -> Decision False in time 0.0200000000, query time of that 0.0189749670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1506.83 < 1523.88
  -> Decision False in time 0.1000000000, query time of that 0.0831942950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0072970440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
844.361 < 882.723
  -> Decision False in time 0.0200000000, query time of that 0.0073589790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1836.65 < 1839.27
  -> Decision False in time 0.0000000000, query time of that 0.0073959140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 293.8599999999999
Index size:  240656.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0252700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039008560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0252276360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1972.88 < 1996.71
  -> Decision False in time 0.0300000000, query time of that 0.0236751050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026994060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1257.16 < 1292.53
  -> Decision False in time 0.0500000000, query time of that 0.0210423210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1526.32 < 1738.61
  -> Decision False in time 0.0300000000, query time of that 0.0143743110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1142.03 < 1170.01
  -> Decision False in time 0.0100000000, query time of that 0.0028889950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1591.06 < 1612.12
  -> Decision False in time 0.0900000000, query time of that 0.0062296450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1434.2 < 1441.74
  -> Decision False in time 0.0900000000, query time of that 0.0030394650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.58000000000015
Index size:  195468.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2109133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023028420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1664.32 < 1675.05
  -> Decision False in time 0.0000000000, query time of that 0.0037725550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1183.67 < 1365.26
  -> Decision False in time 0.0100000000, query time of that 0.0016146430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2016.42 < 2159.13
  -> Decision False in time 0.0000000000, query time of that 0.0016741380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2314.94 < 2366.98
  -> Decision False in time 0.0000000000, query time of that 0.0018303020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1060.03 < 1081.31
  -> Decision False in time 0.0100000000, query time of that 0.0016940130, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2095 < 2129.32
  -> Decision False in time 0.0000000000, query time of that 0.0017031400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
746.247 < 769.729
  -> Decision False in time 0.0100000000, query time of that 0.0018644260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1737.08 < 1803.22
  -> Decision False in time 0.0000000000, query time of that 0.0020505410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 299.66999999999985
Index size:  251184.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078294820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0683426930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6615286130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0074527690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0787761930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.7582285440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0086396170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0769457830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1418.13 < 1440.95
  -> Decision False in time 1.1600000000, query time of that 0.1106864460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 292.5
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0080283300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0711657620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7800000000, query time of that 0.7270033380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0084914520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0804717410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.7926880590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0081213570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0791331100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1337.13 < 1405.8
  -> Decision False in time 0.2700000000, query time of that 0.0292681930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 78.98999999999978
Index size:  195176.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1138616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029526950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1879.29 < 1898.05
  -> Decision False in time 0.0000000000, query time of that 0.0058994060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1363.64 < 1406.93
  -> Decision False in time 0.0100000000, query time of that 0.0028319370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0021788140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1919.5 < 1994.2
  -> Decision False in time 0.0000000000, query time of that 0.0024556360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1806.27 < 1948.44
  -> Decision False in time 0.0000000000, query time of that 0.0023260270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
895.069 < 924.379
  -> Decision False in time 0.0200000000, query time of that 0.0023828320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1322.5 < 1336.9
  -> Decision False in time 0.0100000000, query time of that 0.0026091050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1952.91 < 1982.22
  -> Decision False in time 0.0000000000, query time of that 0.0025752630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 109.26999999999998
Index size:  177680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3335816667
  Testing...
|S| = 20
|T| = 283
Reject!
2451.79 < 2725.56
  -> Decision False in time 0.0000000000, query time of that 0.0022279810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1321.51 < 1392.3
  -> Decision False in time 0.0100000000, query time of that 0.0058382740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2749.72 < 2799.59
  -> Decision False in time 0.0100000000, query time of that 0.0035017130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1652.68 < 1774.95
  -> Decision False in time 0.0000000000, query time of that 0.0014857130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1291.9 < 1404.42
  -> Decision False in time 0.0000000000, query time of that 0.0015163780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1551.55 < 1553.02
  -> Decision False in time 0.0000000000, query time of that 0.0015380000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
988.761 < 1180.98
  -> Decision False in time 0.0100000000, query time of that 0.0015013470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1438.63 < 1440
  -> Decision False in time 0.0000000000, query time of that 0.0015204050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
888.763 < 892.356
  -> Decision False in time 0.0000000000, query time of that 0.0015991820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 109.40000000000009
Index size:  189252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0065383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056205940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0435368310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4265452050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046528540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1168.46 < 1199.59
  -> Decision False in time 0.0500000000, query time of that 0.0311545260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1338.85 < 1360.94
  -> Decision False in time 0.1300000000, query time of that 0.0810220900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0048376520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1152.4 < 1442.69
  -> Decision False in time 0.2100000000, query time of that 0.0156625900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1325.07 < 1326.37
  -> Decision False in time 0.3000000000, query time of that 0.0207594800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 293.82000000000016
Index size:  240936.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0159499140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1368050070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.3787588730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0167002720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1621812600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7500000000, query time of that 1.5970846750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0181340840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1680116360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2900000000, query time of that 1.6796483490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 293.1700000000001
Index size:  242008.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0323767100, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2898343060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9900000000, query time of that 2.9305452740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0335094460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3482954550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.5800000000, query time of that 3.3666917430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0406358840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0600000000, query time of that 0.4418333740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.3500000000, query time of that 4.6584129410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.72999999999956
Index size:  200696.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059468200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0529314470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5260072010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061994000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0617837980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
989.488 < 1029.8
  -> Decision False in time 0.1100000000, query time of that 0.0789538470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0062368850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2688.16 < 2813.88
  -> Decision False in time 0.0900000000, query time of that 0.0128101210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1427.53 < 1487.94
  -> Decision False in time 1.8900000000, query time of that 0.1683952860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 128.60000000000036
Index size:  191300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2545533333
  Testing...
|S| = 20
|T| = 283
Reject!
822.94 < 831.538
  -> Decision False in time 0.0000000000, query time of that 0.0023917260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1723.47 < 1852.37
  -> Decision False in time 0.0000000000, query time of that 0.0033551790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
686.401 < 718.057
  -> Decision False in time 0.0100000000, query time of that 0.0019444580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
987.081 < 992.483
  -> Decision False in time 0.0000000000, query time of that 0.0016636940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1547.32 < 1561.15
  -> Decision False in time 0.0000000000, query time of that 0.0017303050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1901.93 < 1964.84
  -> Decision False in time 0.0000000000, query time of that 0.0017477830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
824.477 < 826.51
  -> Decision False in time 0.0100000000, query time of that 0.0017430620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1108.86 < 1136.94
  -> Decision False in time 0.0000000000, query time of that 0.0016160690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1197.43 < 1199.91
  -> Decision False in time 0.0000000000, query time of that 0.0016465370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 78.13999999999942
Index size:  183892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0176833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066685590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0533795460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1182.45 < 1222.13
  -> Decision False in time 0.0200000000, query time of that 0.0236995400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057068070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1207.1 < 1207.26
  -> Decision False in time 0.0100000000, query time of that 0.0065130220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
996.813 < 1413.52
  -> Decision False in time 0.0200000000, query time of that 0.0161191740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0066244970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1491.85 < 1492.96
  -> Decision False in time 0.2800000000, query time of that 0.0251885910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1424.34 < 1457.93
  -> Decision False in time 0.0600000000, query time of that 0.0064204090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 128.6300000000001
Index size:  188616.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1051350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028944560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1122.47 < 1134.27
  -> Decision False in time 0.0100000000, query time of that 0.0073619540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1765.53 < 1884.78
  -> Decision False in time 0.0200000000, query time of that 0.0176872990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1181.43 < 1215.6
  -> Decision False in time 0.0100000000, query time of that 0.0019486920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1010.69 < 1021.05
  -> Decision False in time 0.0100000000, query time of that 0.0022730920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1655.98 < 1657.54
  -> Decision False in time 0.0000000000, query time of that 0.0022838100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1220.38 < 1220.78
  -> Decision False in time 0.0100000000, query time of that 0.0022844230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1547.71 < 1569.65
  -> Decision False in time 0.0000000000, query time of that 0.0023783580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
689.484 < 692.973
  -> Decision False in time 0.0100000000, query time of that 0.0021097320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 293.2699999999995
Index size:  238928.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051775290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0399626340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2038.4 < 2066.56
  -> Decision False in time 0.0800000000, query time of that 0.0671109640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044858760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0458905220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1265.17 < 1274.92
  -> Decision False in time 0.5300000000, query time of that 0.3098723970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046683690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1737.46 < 1742.26
  -> Decision False in time 0.3900000000, query time of that 0.0242379850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1412.21 < 1416
  -> Decision False in time 0.3100000000, query time of that 0.0193564980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 129.22999999999956
Index size:  205152.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0412483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031405260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1083.76 < 1087.78
  -> Decision False in time 0.0100000000, query time of that 0.0107307370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1609.67 < 1619.9
  -> Decision False in time 0.0300000000, query time of that 0.0181280230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023669420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1717.77 < 1718.58
  -> Decision False in time 0.0600000000, query time of that 0.0191919130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1076.11 < 1098.83
  -> Decision False in time 0.0300000000, query time of that 0.0135654180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1756.87 < 1765.61
  -> Decision False in time 0.0300000000, query time of that 0.0026262160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1324.13 < 1325.91
  -> Decision False in time 0.0200000000, query time of that 0.0029957030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1160.76 < 1172.81
  -> Decision False in time 0.0100000000, query time of that 0.0029530460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.55999999999949
Index size:  175316.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0317683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049357910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1663.51 < 1674.56
  -> Decision False in time 0.0300000000, query time of that 0.0307012500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2444.51 < 2889.12
  -> Decision False in time 0.0200000000, query time of that 0.0129252880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042400370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1440.53 < 1495.4
  -> Decision False in time 0.0600000000, query time of that 0.0377066050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1382.8 < 1458.86
  -> Decision False in time 0.0000000000, query time of that 0.0042505690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1121.19 < 1131.92
  -> Decision False in time 0.0200000000, query time of that 0.0042322030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2081.48 < 2623.52
  -> Decision False in time 0.0000000000, query time of that 0.0048810180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1222.08 < 1268.38
  -> Decision False in time 0.0200000000, query time of that 0.0044016480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 300.2900000000009
Index size:  258304.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0337868140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.3221333760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.2900000000, query time of that 3.2385576770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0361145550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3391505290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6900000000, query time of that 3.5291326980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0381475770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.4476683990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1300000000, query time of that 4.7848371240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 108.63000000000011
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0024500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108530230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0915808600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9146140150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0098157630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1018813620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1449.97 < 1490.7
  -> Decision False in time 0.7200000000, query time of that 0.6866216690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0109077180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
638.02 < 716.345
  -> Decision False in time 0.2500000000, query time of that 0.0376530720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1687.82 < 1704.91
  -> Decision False in time 0.1200000000, query time of that 0.0212561380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 298.4200000000001
Index size:  245472.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0196297600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1808035800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.8669059060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0230185460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2143926710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2600000000, query time of that 2.1265564490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0219551180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2384400500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6400000000, query time of that 2.5289768230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 290.6099999999997
Index size:  194192.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0118517890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1112460220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1200000000, query time of that 1.0552863590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115174770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1214200700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3500000000, query time of that 1.2046228450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0112851890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1909.49 < 1912.64
  -> Decision False in time 0.1500000000, query time of that 0.0269107050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2105.89 < 2122.87
  -> Decision False in time 0.3500000000, query time of that 0.0541418220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 301.1300000000001
Index size:  256900.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0133768710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1207971850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1887751440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0133505470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1369148790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5000000000, query time of that 1.3450550400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0148440520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1444224170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9800000000, query time of that 1.3654016430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 127.9399999999996
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0067433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047257060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0385905160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2057.2 < 2101.41
  -> Decision False in time 0.3400000000, query time of that 0.3075395260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040913300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1630.31 < 1645.11
  -> Decision False in time 0.0700000000, query time of that 0.0419889790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1793.05 < 1793.18
  -> Decision False in time 0.0600000000, query time of that 0.0331516420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1484.47 < 1488.62
  -> Decision False in time 0.0700000000, query time of that 0.0044266980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1266.14 < 1525.7
  -> Decision False in time 0.0100000000, query time of that 0.0048007560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1363.93 < 1379.45
  -> Decision False in time 0.0100000000, query time of that 0.0047575930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 301.53999999999996
Index size:  230732.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0235100760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2085220160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1100000000, query time of that 2.0692425480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226497570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2234888410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4900000000, query time of that 2.3221726260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0258350650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.2673955650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4900000000, query time of that 2.8467528170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 301.2000000000007
Index size:  202832.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0110093030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1013218400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.9789112040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115726940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1142691780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3600000000, query time of that 1.1447443530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0115628340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1126327840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6700000000, query time of that 1.1302984020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 108.9900000000016
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5936100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0018380480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1312.87 < 1488.76
  -> Decision False in time 0.0000000000, query time of that 0.0010161030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2159.01 < 2224.63
  -> Decision False in time 0.0100000000, query time of that 0.0015387280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1690.51 < 1735.44
  -> Decision False in time 0.0000000000, query time of that 0.0008619180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1111.81 < 1181.45
  -> Decision False in time 0.0100000000, query time of that 0.0008530270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1182.19 < 1284.09
  -> Decision False in time 0.0000000000, query time of that 0.0010408290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1851.53 < 1852.97
  -> Decision False in time 0.0100000000, query time of that 0.0009262300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1967.61 < 1976.73
  -> Decision False in time 0.0000000000, query time of that 0.0009195000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1027.53 < 1085.72
  -> Decision False in time 0.0100000000, query time of that 0.0008871540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 293.3199999999997
Index size:  232668.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0104828210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0948442730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.9645932820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0109644050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1115979180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3000000000, query time of that 1.1147695030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0109251890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.1109501660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 1.0938445340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 128.90999999999985
Index size:  203360.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0137966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042483600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
994.196 < 1108.99
  -> Decision False in time 0.0200000000, query time of that 0.0199873840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1540.83 < 1624.49
  -> Decision False in time 0.0700000000, query time of that 0.0584759480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1773.52 < 1820.07
  -> Decision False in time 0.0000000000, query time of that 0.0034324710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1483.72 < 1489.64
  -> Decision False in time 0.0800000000, query time of that 0.0369229000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1097.76 < 1098.21
  -> Decision False in time 0.0200000000, query time of that 0.0076034650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0038633150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1897.73 < 1911.23
  -> Decision False in time 0.0800000000, query time of that 0.0058311100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1406.81 < 1436.31
  -> Decision False in time 0.0100000000, query time of that 0.0038579310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 300.77000000000044
Index size:  242500.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0179969390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1648629080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.6464847880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0185342210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1870849750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0600000000, query time of that 1.8683221130, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0188961560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2107508870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3500000000, query time of that 2.2479593340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.43999999999869
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0449266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0040413100, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0305759230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2222.56 < 2323.22
  -> Decision False in time 0.0400000000, query time of that 0.0353767100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1673.43 < 1696.23
  -> Decision False in time 0.0100000000, query time of that 0.0032503480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2331.58 < 2550.59
  -> Decision False in time 0.0000000000, query time of that 0.0036259240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1629.96 < 1632.28
  -> Decision False in time 0.0300000000, query time of that 0.0108704770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1617.83 < 1649.63
  -> Decision False in time 0.0000000000, query time of that 0.0036390920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1458.32 < 1511.78
  -> Decision False in time 0.0900000000, query time of that 0.0073571000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1250.44 < 1277.62
  -> Decision False in time 0.0200000000, query time of that 0.0036890420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 298.5500000000011
Index size:  199776.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0273743560, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2728390690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7300000000, query time of that 2.6689012510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0282474520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2844161580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1300000000, query time of that 2.9747189490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0297589730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.3754066550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9700000000, query time of that 3.9086028150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 128.64999999999964
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0218750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0036399220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0266379910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1641.58 < 1643.55
  -> Decision False in time 0.0500000000, query time of that 0.0464502990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1583.4 < 1610.55
  -> Decision False in time 0.0100000000, query time of that 0.0028071930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1399.72 < 1454.38
  -> Decision False in time 0.0100000000, query time of that 0.0033514320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1286.77 < 1349.26
  -> Decision False in time 0.0400000000, query time of that 0.0192656690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
859.279 < 881.318
  -> Decision False in time 0.0500000000, query time of that 0.0032834400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
990.189 < 996.112
  -> Decision False in time 0.0100000000, query time of that 0.0034539030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1619.47 < 1620.12
  -> Decision False in time 0.0100000000, query time of that 0.0033069240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 108.26000000000022
Index size:  173728.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0032400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0093165450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0765987220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7585644580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0078131590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0856258270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.8770545820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0089063070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0957914880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1488.03 < 1568.1
  -> Decision False in time 0.4200000000, query time of that 0.0484953330, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 128.1800000000003
Index size:  190028.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0013700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0105104740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0935604240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9129807960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0098004060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1033138000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.0492402800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0105335010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1049801360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
648.854 < 741.761
  -> Decision False in time 2.7700000000, query time of that 0.3520851450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.38999999999942
Index size:  183832.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5664416667
  Testing...
|S| = 20
|T| = 283
Reject!
1589.72 < 1610.95
  -> Decision False in time 0.0000000000, query time of that 0.0020888520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
958.178 < 1000.61
  -> Decision False in time 0.0000000000, query time of that 0.0013755710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1777.66 < 1823.25
  -> Decision False in time 0.0100000000, query time of that 0.0016074790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1168.24 < 1390.36
  -> Decision False in time 0.0000000000, query time of that 0.0012772770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1514.21 < 1559.15
  -> Decision False in time 0.0000000000, query time of that 0.0011706060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1021.84 < 1105.93
  -> Decision False in time 0.0000000000, query time of that 0.0011831200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1614.56 < 1616.95
  -> Decision False in time 0.0000000000, query time of that 0.0012048460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1199.88 < 1275.19
  -> Decision False in time 0.0100000000, query time of that 0.0011711170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1272.59 < 1315.16
  -> Decision False in time 0.0000000000, query time of that 0.0012532020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 107.16000000000167
Index size:  188600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0274350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035631620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0266011550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1867.39 < 2186.03
  -> Decision False in time 0.1700000000, query time of that 0.1551142000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028367840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1336.75 < 1391.51
  -> Decision False in time 0.0200000000, query time of that 0.0065125710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1762.85 < 1782.87
  -> Decision False in time 0.0000000000, query time of that 0.0031824930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
943.802 < 943.961
  -> Decision False in time 0.0200000000, query time of that 0.0032097750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1164.43 < 1194.12
  -> Decision False in time 0.0600000000, query time of that 0.0035169570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1068.53 < 1151.91
  -> Decision False in time 0.0100000000, query time of that 0.0034236450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 301.6800000000003
Index size:  258568.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0139366890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1287233020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.2851183990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0160388580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1564623740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.5047166400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0161585510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1523778180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1615.45 < 1630.05
  -> Decision False in time 1.5900000000, query time of that 0.3074502160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 300.8099999999995
Index size:  203300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0100488650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0898094630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.8988329890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117340380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1086910330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1319.44 < 1321.36
  -> Decision False in time 0.8100000000, query time of that 0.7655354460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0104058970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1034888870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7600000000, query time of that 1.0165306000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 292.3899999999994
Index size:  197372.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057433880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0480330210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4579562060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051697560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0525839640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1122.16 < 1134.47
  -> Decision False in time 0.2900000000, query time of that 0.1966697300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2048.56 < 2067.95
  -> Decision False in time 0.0500000000, query time of that 0.0054047710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1627.51 < 1635.6
  -> Decision False in time 0.1800000000, query time of that 0.0164912770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1600.69 < 1612.65
  -> Decision False in time 0.1900000000, query time of that 0.0165375730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 108.55999999999949
Index size:  199104.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0709250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0026756220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1223.11 < 1225.98
  -> Decision False in time 0.0200000000, query time of that 0.0184490270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2813.65 < 2856.89
  -> Decision False in time 0.0200000000, query time of that 0.0113274590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020665380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1046.95 < 1061.78
  -> Decision False in time 0.0000000000, query time of that 0.0025242540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1346.83 < 1379.71
  -> Decision False in time 0.0200000000, query time of that 0.0073734760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1174.85 < 1184.66
  -> Decision False in time 0.0100000000, query time of that 0.0024446370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1383.06 < 1554.93
  -> Decision False in time 0.0100000000, query time of that 0.0024992110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1143.16 < 1148.44
  -> Decision False in time 0.0100000000, query time of that 0.0024085810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 293.3199999999997
Index size:  241812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0093125960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0783441900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7843647290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0085982840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0911895500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.9065544880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0093175500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0889754700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1666.57 < 1697.57
  -> Decision False in time 4.3200000000, query time of that 0.4629750420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 128.76000000000022
Index size:  204424.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0064281300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0533770880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5800000000, query time of that 0.5150118860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057738330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0584834960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1106.16 < 1115.88
  -> Decision False in time 0.1800000000, query time of that 0.1387694090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060403930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2452 < 2472.02
  -> Decision False in time 0.6400000000, query time of that 0.0493670300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1039.71 < 1087.58
  -> Decision False in time 0.4200000000, query time of that 0.0302225140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 302.10999999999876
Index size:  245728.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0120332110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1111783230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1600000000, query time of that 1.1093435160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0124643520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1308252330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4700000000, query time of that 1.2966327340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0145826500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1339261240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1503.4 < 1524.31
  -> Decision False in time 0.9800000000, query time of that 0.1616776640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 294.3899999999994
Index size:  194184.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0207890360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1936370890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9700000000, query time of that 1.9168383210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226266460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2307025740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3200000000, query time of that 2.1815635400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0273513960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.2428392190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7000000000, query time of that 2.5997638580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.72999999999956
Index size:  196208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8194800000
  Testing...
|S| = 20
|T| = 283
Reject!
1778.14 < 2037.47
  -> Decision False in time 0.0100000000, query time of that 0.0011967780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2097.84 < 2827.61
  -> Decision False in time 0.0000000000, query time of that 0.0007809430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2242.84 < 2755.8
  -> Decision False in time 0.0000000000, query time of that 0.0008265560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2352.75 < 2387.82
  -> Decision False in time 0.0100000000, query time of that 0.0007870270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1194.65 < 1319.4
  -> Decision False in time 0.0000000000, query time of that 0.0006779950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1756.24 < 2760.73
  -> Decision False in time 0.0100000000, query time of that 0.0007083390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1872.16 < 2213.08
  -> Decision False in time 0.0000000000, query time of that 0.0007302510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2378.9 < 2565.03
  -> Decision False in time 0.0100000000, query time of that 0.0006833750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1664.9 < 1680.53
  -> Decision False in time 0.0000000000, query time of that 0.0006829160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 78.46999999999935
Index size:  184136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3675600000
  Testing...
|S| = 20
|T| = 283
Reject!
1733.51 < 1799.97
  -> Decision False in time 0.0100000000, query time of that 0.0016245810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2263.85 < 2714.62
  -> Decision False in time 0.0100000000, query time of that 0.0012641020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
897.894 < 916.336
  -> Decision False in time 0.0000000000, query time of that 0.0020953250, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1457.26 < 2181.55
  -> Decision False in time 0.0100000000, query time of that 0.0011104040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1459.05 < 1469.22
  -> Decision False in time 0.0000000000, query time of that 0.0010667610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1709.29 < 1723.47
  -> Decision False in time 0.0100000000, query time of that 0.0010924610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2710.63 < 2776.4
  -> Decision False in time 0.0000000000, query time of that 0.0010346270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
760.675 < 816.7
  -> Decision False in time 0.0100000000, query time of that 0.0011673980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1835.08 < 2060.33
  -> Decision False in time 0.0000000000, query time of that 0.0011404810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 129.42000000000007
Index size:  192068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079905810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0632355390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6491998340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077026840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0756661960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1844.87 < 1848.66
  -> Decision False in time 0.3700000000, query time of that 0.3228840320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0073230270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1060.2 < 1063.85
  -> Decision False in time 0.1900000000, query time of that 0.0235645610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
558.001 < 615.157
  -> Decision False in time 0.0200000000, query time of that 0.0077022130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 79.27999999999884
Index size:  183692.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1019616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0038788490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2183.16 < 2683.72
  -> Decision False in time 0.0100000000, query time of that 0.0049102360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2473.32 < 2642.89
  -> Decision False in time 0.0100000000, query time of that 0.0096718430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029908870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1547.76 < 1574.26
  -> Decision False in time 0.0000000000, query time of that 0.0030061140, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1098.66 < 1100.19
  -> Decision False in time 0.0100000000, query time of that 0.0030057560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2164.15 < 2365.31
  -> Decision False in time 0.0000000000, query time of that 0.0029755540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2128.31 < 2481.59
  -> Decision False in time 0.0100000000, query time of that 0.0028362680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1015.6 < 1079.65
  -> Decision False in time 0.0100000000, query time of that 0.0030951190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 128.70000000000073
Index size:  191768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0038683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0058562450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0460308160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4521162580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0049519710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0537009600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1585.5 < 1740.28
  -> Decision False in time 0.3000000000, query time of that 0.1921389770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1713.76 < 1724.99
  -> Decision False in time 0.0400000000, query time of that 0.0054387410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1209.27 < 1211.39
  -> Decision False in time 0.0000000000, query time of that 0.0052086830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1615.56 < 1625.66
  -> Decision False in time 0.8500000000, query time of that 0.0562722310, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 128.89999999999964
Index size:  190816.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088817010, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0719177520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.6991803450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0082025840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0821496150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1699.84 < 1711.94
  -> Decision False in time 0.0800000000, query time of that 0.0795343240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1644.44 < 1669.14
  -> Decision False in time 0.0200000000, query time of that 0.0081518590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0818072740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1665.9 < 1719.82
  -> Decision False in time 1.8400000000, query time of that 0.1809011010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 293.2400000000016
Index size:  239844.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0061150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044290110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331928790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2195.67 < 2230.27
  -> Decision False in time 0.1400000000, query time of that 0.1262206920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036494360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0385235990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1541.85 < 1581.85
  -> Decision False in time 0.0700000000, query time of that 0.0365147300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0038081380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1164.56 < 1178.3
  -> Decision False in time 0.0300000000, query time of that 0.0041116150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1164.56 < 1176.11
  -> Decision False in time 0.1300000000, query time of that 0.0081611920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 110.05999999999949
Index size:  200964.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1571950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026269990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1462.63 < 1487.74
  -> Decision False in time 0.0000000000, query time of that 0.0045441510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1296.67 < 1297.82
  -> Decision False in time 0.0100000000, query time of that 0.0045895550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1142.53 < 1151.66
  -> Decision False in time 0.0000000000, query time of that 0.0016819180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1235.08 < 1240.18
  -> Decision False in time 0.0100000000, query time of that 0.0019336910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1354.42 < 1410.9
  -> Decision False in time 0.0000000000, query time of that 0.0018455250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1423.62 < 1505.02
  -> Decision False in time 0.0000000000, query time of that 0.0018442350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
917.145 < 1010.17
  -> Decision False in time 0.0100000000, query time of that 0.0018510960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1371.99 < 1388.39
  -> Decision False in time 0.0000000000, query time of that 0.0018633530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 301.7099999999991
Index size:  249792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0067601810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0538744190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5220908400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057211040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0613645810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.6008530420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0066376410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0618139680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1259.44 < 1276.16
  -> Decision False in time 0.2900000000, query time of that 0.0264301380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 300.8899999999994
Index size:  204404.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0151488830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1402311470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.3799629010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0152921660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1616860720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8000000000, query time of that 1.6037806080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1435.2 < 1473.39
  -> Decision False in time 0.0400000000, query time of that 0.0194059700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1742839720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9600000000, query time of that 1.7064711710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 292.7099999999991
Index size:  203136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0073401510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0574730620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6300000000, query time of that 0.5790454210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0068937810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0657859040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1503.4 < 1524.31
  -> Decision False in time 0.3000000000, query time of that 0.2539899770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0064015360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1679.52 < 1693.03
  -> Decision False in time 0.1900000000, query time of that 0.0210010120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1714.26 < 1731.64
  -> Decision False in time 1.7200000000, query time of that 0.1392061430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 78.20999999999913
Index size:  195480.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0257833333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0052738900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1936.55 < 2444.37
  -> Decision False in time 0.0200000000, query time of that 0.0269370790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2220.47 < 2251.89
  -> Decision False in time 0.1500000000, query time of that 0.1310470810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047374760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1182.41 < 1242.11
  -> Decision False in time 0.0100000000, query time of that 0.0056789340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1484.04 < 1493.13
  -> Decision False in time 0.0000000000, query time of that 0.0051079810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1382.99 < 1392.07
  -> Decision False in time 0.0100000000, query time of that 0.0051110720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1049.97 < 1122.17
  -> Decision False in time 0.1000000000, query time of that 0.0106063620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1449.09 < 1515.88
  -> Decision False in time 0.0900000000, query time of that 0.0074692480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 292.39000000000306
Index size:  239912.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1073816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030303310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0198728650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1020.18 < 1027.66
  -> Decision False in time 0.0100000000, query time of that 0.0062359660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1347.92 < 1367.15
  -> Decision False in time 0.0000000000, query time of that 0.0019885990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1514.35 < 1525.35
  -> Decision False in time 0.0100000000, query time of that 0.0023127540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
702.15 < 711.673
  -> Decision False in time 0.0200000000, query time of that 0.0047435510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1024.85 < 1061.7
  -> Decision False in time 0.0000000000, query time of that 0.0024244820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
959.305 < 994.485
  -> Decision False in time 0.0100000000, query time of that 0.0023201410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1053.49 < 1085.92
  -> Decision False in time 0.0100000000, query time of that 0.0025151670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 129.47999999999956
Index size:  205324.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4988433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020450640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1466.27 < 1485.39
  -> Decision False in time 0.0000000000, query time of that 0.0028177130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1634.34 < 1887.91
  -> Decision False in time 0.0000000000, query time of that 0.0042956160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
851.886 < 895.642
  -> Decision False in time 0.0100000000, query time of that 0.0014189400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1000.13 < 1031.11
  -> Decision False in time 0.0000000000, query time of that 0.0014714190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1078.52 < 1102.04
  -> Decision False in time 0.0000000000, query time of that 0.0014037440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
818.857 < 839.653
  -> Decision False in time 0.0000000000, query time of that 0.0013893730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
946.707 < 954.424
  -> Decision False in time 0.0100000000, query time of that 0.0016010630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1110.71 < 1229.32
  -> Decision False in time 0.0000000000, query time of that 0.0014330810, with c1=5.0000000000, c2=0.1000000000
