copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 340.46000000000004
Index size:  474992.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0127373470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0911606080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.8088478100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102663500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0902135800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.8659209580, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.0138062080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.0954360850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7200000000, query time of that 0.9798579600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 71.94999999999993
Index size:  201676.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3731783333
  Testing...
|S| = 20
|T| = 283
Reject!
2153.58 < 2192.41
  -> Decision False in time 0.0200000000, query time of that 0.0200582800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1655.9 < 1667
  -> Decision False in time 0.0000000000, query time of that 0.0033523200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1322.5 < 1359.08
  -> Decision False in time 0.0100000000, query time of that 0.0030657700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1747.41 < 1893
  -> Decision False in time 0.0000000000, query time of that 0.0019926730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1873.27 < 1924.12
  -> Decision False in time 0.0000000000, query time of that 0.0019536070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1855.39 < 1922.35
  -> Decision False in time 0.0100000000, query time of that 0.0020089530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2039.67 < 2152.06
  -> Decision False in time 0.0000000000, query time of that 0.0019660460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1789.62 < 1914.38
  -> Decision False in time 0.0000000000, query time of that 0.0018337150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1505.05 < 1563.54
  -> Decision False in time 0.0100000000, query time of that 0.0018490250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 319.11
Index size:  254376.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0828116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089301040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1360.1 < 1368.74
  -> Decision False in time 0.0400000000, query time of that 0.0251492640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1845.82 < 1931.22
  -> Decision False in time 0.0100000000, query time of that 0.0074492530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1344.15 < 1348.56
  -> Decision False in time 0.0200000000, query time of that 0.0027395450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1755.05 < 1797.26
  -> Decision False in time 0.0000000000, query time of that 0.0033040350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1387.87 < 1443.96
  -> Decision False in time 0.0400000000, query time of that 0.0114557700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1266.61 < 1323.58
  -> Decision False in time 0.0000000000, query time of that 0.0028440270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1629.21 < 1693.26
  -> Decision False in time 0.0100000000, query time of that 0.0027897000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1687.88 < 1696.63
  -> Decision False in time 0.0100000000, query time of that 0.0029803820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 317.53
Index size:  251588.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0226265020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1845283120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7700000000, query time of that 1.7113318700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0214457790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1910303870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0200000000, query time of that 1.8156654300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0230227340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1986874390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2000000000, query time of that 1.9361637120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 98.1099999999999
Index size:  200872.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0013633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112191320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0772237620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6584518630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0090825450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0755195510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.6999774140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0098759080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0695407870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1631.64 < 1632.51
  -> Decision False in time 0.5300000000, query time of that 0.0462777410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 71.73000000000002
Index size:  183924.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0344350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0096390110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1873.45 < 1899.28
  -> Decision False in time 0.0100000000, query time of that 0.0069643100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1856.29 < 1927.38
  -> Decision False in time 0.0300000000, query time of that 0.0309344780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1445.72 < 1528.2
  -> Decision False in time 0.0100000000, query time of that 0.0051375910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1855.78 < 2048.75
  -> Decision False in time 0.0300000000, query time of that 0.0155977930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1934.57 < 1955.79
  -> Decision False in time 0.0000000000, query time of that 0.0052498070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1552.45 < 1557.4
  -> Decision False in time 0.0600000000, query time of that 0.0047587100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1534.7 < 1554.34
  -> Decision False in time 0.2600000000, query time of that 0.0163671230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1760.33 < 1821.99
  -> Decision False in time 0.0100000000, query time of that 0.0046406950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 97.21000000000004
Index size:  183188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0121288160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0926652440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.8199872530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0111824600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0924972360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1247.02 < 1479.19
  -> Decision False in time 0.1500000000, query time of that 0.1422058060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0088123090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.0861045650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2009.39 < 2024.71
  -> Decision False in time 2.3100000000, query time of that 0.2483781950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 126.42999999999984
Index size:  193600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0140049630, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0525438030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4289303810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0062841760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0505587970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1471.68 < 1491.2
  -> Decision False in time 0.0200000000, query time of that 0.0097868910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0043668650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1601.98 < 1606.36
  -> Decision False in time 0.1400000000, query time of that 0.0099114450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1524.35 < 1535.55
  -> Decision False in time 1.0500000000, query time of that 0.0653960410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 311.00999999999976
Index size:  250748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0128905350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0611456750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5460626000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076653630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0603499530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.5531843040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0077970710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0542443550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1156.79 < 1165.22
  -> Decision False in time 0.5800000000, query time of that 0.0422133060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 68.77999999999975
Index size:  193680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0198283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079227520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1886.21 < 1953.01
  -> Decision False in time 0.0300000000, query time of that 0.0232567960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1870.68 < 1897.31
  -> Decision False in time 0.0200000000, query time of that 0.0189670950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058177170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1730.76 < 1740.89
  -> Decision False in time 0.0500000000, query time of that 0.0295119670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1728.64 < 1881.55
  -> Decision False in time 0.0100000000, query time of that 0.0054165670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1905.19 < 1910.12
  -> Decision False in time 0.0300000000, query time of that 0.0055255830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1517.98 < 1529.91
  -> Decision False in time 0.4400000000, query time of that 0.0287331660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1777.29 < 1870.16
  -> Decision False in time 0.0400000000, query time of that 0.0053128540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 125.17999999999984
Index size:  169116.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0267983333
  Testing...
|S| = 20
|T| = 283
Reject!
1630.48 < 1641.01
  -> Decision False in time 0.0100000000, query time of that 0.0068819290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0308600800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1960.79 < 2014.69
  -> Decision False in time 0.0200000000, query time of that 0.0135789300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028861190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1781.3 < 1806.64
  -> Decision False in time 0.0100000000, query time of that 0.0031524750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1550.3 < 1560.86
  -> Decision False in time 0.0000000000, query time of that 0.0030653080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1287.09 < 1316.3
  -> Decision False in time 0.0900000000, query time of that 0.0031180400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1556.59 < 1565.48
  -> Decision False in time 0.0100000000, query time of that 0.0030929710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1083.86 < 1166.15
  -> Decision False in time 0.0100000000, query time of that 0.0034588510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 96.56999999999971
Index size:  188672.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1257500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057622460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1775.79 < 1830.4
  -> Decision False in time 0.0000000000, query time of that 0.0038653480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2383.77 < 2438.98
  -> Decision False in time 0.0000000000, query time of that 0.0029256910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1339.73 < 1537.94
  -> Decision False in time 0.0100000000, query time of that 0.0023932990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1738.22 < 1874.24
  -> Decision False in time 0.0100000000, query time of that 0.0025753760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
593.243 < 620.46
  -> Decision False in time 0.0100000000, query time of that 0.0047557020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1891.44 < 1911.59
  -> Decision False in time 0.0100000000, query time of that 0.0022935480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1790.93 < 1979.52
  -> Decision False in time 0.0000000000, query time of that 0.0020489750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2056.2 < 2060.95
  -> Decision False in time 0.0000000000, query time of that 0.0021180490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 323.03999999999996
Index size:  259356.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0226604190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1825688200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7300000000, query time of that 1.6703221910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0201507970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1783278700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.7533078050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0217452090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1911904450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0700000000, query time of that 1.8113879250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 68.63999999999987
Index size:  186596.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0486466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057779210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2087.66 < 2314.32
  -> Decision False in time 0.0400000000, query time of that 0.0308203320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1578.2 < 1784.97
  -> Decision False in time 0.0200000000, query time of that 0.0245898760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0040728260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1597.22 < 1654.56
  -> Decision False in time 0.0000000000, query time of that 0.0041924780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1307.36 < 1391.83
  -> Decision False in time 0.0100000000, query time of that 0.0040227820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2520.38 < 2578.23
  -> Decision False in time 0.0100000000, query time of that 0.0041554150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2190.46 < 2375.57
  -> Decision False in time 0.0000000000, query time of that 0.0037424880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1849.08 < 1863.12
  -> Decision False in time 0.0100000000, query time of that 0.0036097620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 322.8600000000001
Index size:  199900.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0199818080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1379901010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2000000000, query time of that 1.1366564410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0144090060, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1254110570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.1497667710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0132973250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.1096891800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 1.1029208110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 325.59000000000015
Index size:  212440.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0276645690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2348375680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.0400000000, query time of that 1.9743169780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0245324570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2128239680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1700000000, query time of that 2.0238886470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.0263164260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.2107789280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6700000000, query time of that 2.2730871100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 67.72000000000025
Index size:  189812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1175433333
  Testing...
|S| = 20
|T| = 283
Reject!
1783.5 < 1802.09
  -> Decision False in time 0.0100000000, query time of that 0.0042222710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2413.72 < 2414.71
  -> Decision False in time 0.0100000000, query time of that 0.0058503520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1630.58 < 1714.53
  -> Decision False in time 0.0100000000, query time of that 0.0065833990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2316.9 < 2370.31
  -> Decision False in time 0.0000000000, query time of that 0.0029076360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1935.16 < 2387.74
  -> Decision False in time 0.0100000000, query time of that 0.0029918820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2164.18 < 2173.61
  -> Decision False in time 0.0000000000, query time of that 0.0027074820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1457.74 < 1604.18
  -> Decision False in time 0.0100000000, query time of that 0.0028434440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2141 < 2316.44
  -> Decision False in time 0.0000000000, query time of that 0.0027031050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1859.62 < 1910.74
  -> Decision False in time 0.0100000000, query time of that 0.0025592040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 155.71000000000004
Index size:  146852.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2089200000
  Testing...
|S| = 20
|T| = 283
Reject!
1368.38 < 1479.49
  -> Decision False in time 0.0000000000, query time of that 0.0036933950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1601.27 < 1636.4
  -> Decision False in time 0.0100000000, query time of that 0.0085316180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1388.64 < 1445.18
  -> Decision False in time 0.0100000000, query time of that 0.0066082390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1712.9 < 1730.66
  -> Decision False in time 0.0100000000, query time of that 0.0021934840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1925.78 < 1965.32
  -> Decision False in time 0.0000000000, query time of that 0.0021807650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1196.63 < 1244.84
  -> Decision False in time 0.0000000000, query time of that 0.0020843890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1313.69 < 1337.23
  -> Decision False in time 0.0100000000, query time of that 0.0022586700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1209.48 < 1260.23
  -> Decision False in time 0.0000000000, query time of that 0.0022168260, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1403.04 < 1469.71
  -> Decision False in time 0.0000000000, query time of that 0.0022275380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 144.53999999999996
Index size:  191608.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0110027030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0787172640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7274459850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0100340660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0877033220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1265.37 < 1277.69
  -> Decision False in time 0.1100000000, query time of that 0.0919526670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0078666100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.0756670130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1448.69 < 1510.45
  -> Decision False in time 2.7700000000, query time of that 0.2485111740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 345.60000000000036
Index size:  259752.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0151293870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1341027660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.2725739150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0164977820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1380228020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6000000000, query time of that 1.3753690350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.0178812000, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1273228340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4700000000, query time of that 1.3935988640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 75.42000000000007
Index size:  187512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0091129920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1970.75 < 2068.36
  -> Decision False in time 0.0400000000, query time of that 0.0315482110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1954.59 < 2002.54
  -> Decision False in time 0.0400000000, query time of that 0.0385951500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066565270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0647208260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1922.08 < 1935.88
  -> Decision False in time 0.0300000000, query time of that 0.0253545850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0060091430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1787.31 < 1793.24
  -> Decision False in time 0.0000000000, query time of that 0.0064733110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1462.48 < 1466.47
  -> Decision False in time 0.1300000000, query time of that 0.0126849960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 328.6100000000006
Index size:  202160.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0348438430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4200000000, query time of that 0.4070235470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.1600000000, query time of that 4.0668047180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0373434790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3500951860, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6100000000, query time of that 3.4515142830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.0390205800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.3759411330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.5600000000, query time of that 3.8245759340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 99.46000000000004
Index size:  188672.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0007183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0150478700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1175609030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1500000000, query time of that 1.0933680560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0139326530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1175047130, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1642.81 < 1651.24
  -> Decision False in time 1.1700000000, query time of that 1.0702717960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0123039830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1158459940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1325.39 < 1326.19
  -> Decision False in time 0.3400000000, query time of that 0.0519939210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 337.8699999999999
Index size:  246504.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0287746740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2859924680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.8600000000, query time of that 2.7875132840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0312011680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2710992280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5000000000, query time of that 2.3473862150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.0320225680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.2588807870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1900000000, query time of that 2.4040874980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 309.6999999999998
Index size:  194748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0300102240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3351316210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.4400000000, query time of that 3.3475449420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0296717280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2737090360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7300000000, query time of that 2.5679589200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0325278510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.3126404250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7500000000, query time of that 2.9862540460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 330.329999999999
Index size:  252048.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0597623340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6944599630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 7.2200000000, query time of that 7.0997812730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0621076370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.7600000000, query time of that 0.7208279820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 7.4900000000, query time of that 7.2017576540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.0851642890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.2100000000, query time of that 0.5811669520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6500000000, query time of that 5.4327458540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 100.80999999999949
Index size:  190440.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0096850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059138200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0410347480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1736.17 < 1866.34
  -> Decision False in time 0.1000000000, query time of that 0.0814824650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038973610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0391754680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1420.13 < 1469.84
  -> Decision False in time 0.0500000000, query time of that 0.0271099960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1468.69 < 1484.31
  -> Decision False in time 0.0100000000, query time of that 0.0039203430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1889.1 < 1900.24
  -> Decision False in time 0.5100000000, query time of that 0.0251958090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1199.39 < 1206.3
  -> Decision False in time 0.0700000000, query time of that 0.0037572640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 69.88999999999942
Index size:  186652.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.6051683333
  Testing...
|S| = 20
|T| = 283
Reject!
1607.97 < 1810.35
  -> Decision False in time 0.0100000000, query time of that 0.0028087900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2550.45 < 2624.63
  -> Decision False in time 0.0000000000, query time of that 0.0020906050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2487.85 < 2566.61
  -> Decision False in time 0.0000000000, query time of that 0.0017914580, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2121.2 < 2190.79
  -> Decision False in time 0.0100000000, query time of that 0.0017596270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1589.39 < 1632.68
  -> Decision False in time 0.0000000000, query time of that 0.0016880880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1515.94 < 1560
  -> Decision False in time 0.0000000000, query time of that 0.0015561040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2088.57 < 2110.73
  -> Decision False in time 0.0100000000, query time of that 0.0015429020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2153.79 < 2189.94
  -> Decision False in time 0.0000000000, query time of that 0.0015297900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1588.7 < 1606.43
  -> Decision False in time 0.0000000000, query time of that 0.0016357260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 311.8000000000011
Index size:  245552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0149050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048926570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0341539490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1250.8 < 1253.39
  -> Decision False in time 0.0200000000, query time of that 0.0164603430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031652710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1142.03 < 1185.68
  -> Decision False in time 0.0300000000, query time of that 0.0104437360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1037.07 < 1044.11
  -> Decision False in time 0.0700000000, query time of that 0.0271967570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1560.53 < 1574
  -> Decision False in time 0.0100000000, query time of that 0.0030762220, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1731.82 < 1785.72
  -> Decision False in time 0.0300000000, query time of that 0.0031688650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1630.43 < 1670.23
  -> Decision False in time 0.0300000000, query time of that 0.0034357540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 155.75
Index size:  203356.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0085335490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0652696930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6200000000, query time of that 0.5728555810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0080548100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0647259840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1521.3 < 1573.31
  -> Decision False in time 0.4200000000, query time of that 0.2920584730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0064447770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0604407320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1691.34 < 1729.42
  -> Decision False in time 0.4100000000, query time of that 0.0335343620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 108.70000000000073
Index size:  173600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5636766667
  Testing...
|S| = 20
|T| = 283
Reject!
1499.64 < 1522.93
  -> Decision False in time 0.0100000000, query time of that 0.0030765830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1648.9 < 1706.75
  -> Decision False in time 0.0100000000, query time of that 0.0065810450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1293.51 < 1369.27
  -> Decision False in time 0.0000000000, query time of that 0.0017511270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1118.54 < 1295.18
  -> Decision False in time 0.0000000000, query time of that 0.0016957030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2107.12 < 2110.39
  -> Decision False in time 0.0000000000, query time of that 0.0017421830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2026.39 < 2221.08
  -> Decision False in time 0.0100000000, query time of that 0.0015831790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2179.15 < 2253.38
  -> Decision False in time 0.0000000000, query time of that 0.0015140050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2126.19 < 2210.98
  -> Decision False in time 0.0000000000, query time of that 0.0016200450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1392.66 < 1964.1
  -> Decision False in time 0.0000000000, query time of that 0.0017264040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 72.31999999999971
Index size:  180524.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0851433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0046699800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2143.17 < 2185.44
  -> Decision False in time 0.0100000000, query time of that 0.0037958000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2175.41 < 2215.75
  -> Decision False in time 0.0200000000, query time of that 0.0148004470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032242210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2038.81 < 2057.34
  -> Decision False in time 0.0200000000, query time of that 0.0069863720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1959.41 < 1993.2
  -> Decision False in time 0.0000000000, query time of that 0.0031977660, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1121.45 < 1136.14
  -> Decision False in time 0.0100000000, query time of that 0.0031566040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1702 < 1960.49
  -> Decision False in time 0.0000000000, query time of that 0.0030882080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1904.13 < 1913.27
  -> Decision False in time 0.0100000000, query time of that 0.0028960290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 327.53999999999905
Index size:  259836.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0128956450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1046015490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.9531701280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0121815880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1048099720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1200000000, query time of that 0.9858080570, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0123284200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0967397080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0400000000, query time of that 0.9765724550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 308.83000000000175
Index size:  194712.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074559830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0516434860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4433084480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065908500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0527144520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.4762478260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0061153140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1702.79 < 1735.63
  -> Decision False in time 0.6300000000, query time of that 0.0365851610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1936.08 < 1970.29
  -> Decision False in time 0.4600000000, query time of that 0.0264077790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 68.39999999999964
Index size:  195696.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7982683333
  Testing...
|S| = 20
|T| = 283
Reject!
1917.39 < 1957.55
  -> Decision False in time 0.0000000000, query time of that 0.0023249260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2371.48 < 2375.12
  -> Decision False in time 0.0000000000, query time of that 0.0016619860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1588.99 < 1593.81
  -> Decision False in time 0.0100000000, query time of that 0.0014963500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1805.9 < 1816.12
  -> Decision False in time 0.0000000000, query time of that 0.0015167710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1526.81 < 1926.23
  -> Decision False in time 0.0000000000, query time of that 0.0014512160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1887.44 < 1922.31
  -> Decision False in time 0.0000000000, query time of that 0.0014883480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2231.4 < 2295.78
  -> Decision False in time 0.0100000000, query time of that 0.0013234760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1563.32 < 1904.9
  -> Decision False in time 0.0000000000, query time of that 0.0014288320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1217.01 < 1564.24
  -> Decision False in time 0.0000000000, query time of that 0.0013365230, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 324.27000000000044
Index size:  245584.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0246244990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2027106510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8200000000, query time of that 1.7708516490, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0223954390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.1946542030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0300000000, query time of that 1.8726114550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0235719010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2045386860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1607.41 < 1611.8
  -> Decision False in time 1.0400000000, query time of that 0.2610262320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 95.14999999999964
Index size:  188640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0020950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088891290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0668024120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1877.23 < 1939.36
  -> Decision False in time 0.4200000000, query time of that 0.3826353800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064844700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0607511210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1791.42 < 1808.39
  -> Decision False in time 0.8100000000, query time of that 0.5759001310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061210760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0597666620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1257.58 < 1294.92
  -> Decision False in time 0.5900000000, query time of that 0.0478007900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 310.9599999999991
Index size:  252428.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0020866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065100050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0439362000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4100000000, query time of that 0.3590097830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0051275970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1395.93 < 1427.19
  -> Decision False in time 0.0400000000, query time of that 0.0210038530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1325.56 < 1343.65
  -> Decision False in time 0.1200000000, query time of that 0.0573437930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0040686100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1066.19 < 1091.38
  -> Decision False in time 0.2500000000, query time of that 0.0151721520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1902.94 < 1910.25
  -> Decision False in time 0.5600000000, query time of that 0.0265910160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 98.25
Index size:  199148.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2817616667
  Testing...
|S| = 20
|T| = 283
Reject!
1532.4 < 1617.3
  -> Decision False in time 0.0000000000, query time of that 0.0033550060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1669.27 < 1765.47
  -> Decision False in time 0.0100000000, query time of that 0.0036054650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1290.36 < 1405.51
  -> Decision False in time 0.0100000000, query time of that 0.0076212500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2305.85 < 2454.99
  -> Decision False in time 0.0000000000, query time of that 0.0019547980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1787.41 < 1878.45
  -> Decision False in time 0.0000000000, query time of that 0.0020021120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1432.58 < 1466.87
  -> Decision False in time 0.0100000000, query time of that 0.0020156630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1219.94 < 1307.83
  -> Decision False in time 0.0100000000, query time of that 0.0020853790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1812.17 < 1862.14
  -> Decision False in time 0.0000000000, query time of that 0.0021020330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1940.68 < 1967.02
  -> Decision False in time 0.0000000000, query time of that 0.0019447530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 125.03000000000065
Index size:  181988.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0145300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051931140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1150.39 < 1163.39
  -> Decision False in time 0.0200000000, query time of that 0.0158238330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1837.73 < 1838.46
  -> Decision False in time 0.0900000000, query time of that 0.0786668290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031631440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1491.21 < 1531.16
  -> Decision False in time 0.0700000000, query time of that 0.0277739390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1970.63 < 2012.63
  -> Decision False in time 0.0700000000, query time of that 0.0283566350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1517 < 1519.93
  -> Decision False in time 0.0500000000, query time of that 0.0033928920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1483.17 < 1484.94
  -> Decision False in time 0.0600000000, query time of that 0.0033268830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1601.32 < 1616.74
  -> Decision False in time 0.1800000000, query time of that 0.0084208990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 124.88999999999942
Index size:  190640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078420110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0583495740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1689.97 < 1694.63
  -> Decision False in time 0.1300000000, query time of that 0.1199884780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055854110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1935.32 < 1935.35
  -> Decision False in time 0.0300000000, query time of that 0.0233348040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1709.07 < 1725.44
  -> Decision False in time 0.2400000000, query time of that 0.1515327950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0054077130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1904.3 < 1918.75
  -> Decision False in time 0.0500000000, query time of that 0.0057314380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1807.52 < 1940.19
  -> Decision False in time 1.1800000000, query time of that 0.0743941280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 319.7399999999998
Index size:  256316.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0506509420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5588219190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 5.6400000000, query time of that 5.5358188280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0587312950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5585927580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.7700000000, query time of that 5.5169293560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.0668921170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.2400000000, query time of that 0.4767500750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.2700000000, query time of that 4.5773508200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 327.0599999999995
Index size:  200604.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0182868150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1683527670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5900000000, query time of that 1.5357183850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0203077240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1656832920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7500000000, query time of that 1.6168777260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0187476460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.1739535490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0200000000, query time of that 1.5944704970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 322.1999999999989
Index size:  223824.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0177725900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1503130550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4900000000, query time of that 1.4330072950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0179172000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1576279020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.4935529440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0173717710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1443532980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1119.07 < 1147.89
  -> Decision False in time 6.0700000000, query time of that 1.0849494010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 123.65999999999985
Index size:  197636.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0764050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040160830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0251368690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1693.91 < 1715.46
  -> Decision False in time 0.0200000000, query time of that 0.0158853520, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1441.13 < 1446.72
  -> Decision False in time 0.0100000000, query time of that 0.0023397300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
712.927 < 713.013
  -> Decision False in time 0.0000000000, query time of that 0.0026112030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1545.59 < 1557.93
  -> Decision False in time 0.0000000000, query time of that 0.0024564410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1086.74 < 1125.63
  -> Decision False in time 0.0100000000, query time of that 0.0023387660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1788.32 < 1845.32
  -> Decision False in time 0.0000000000, query time of that 0.0024195980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1305.68 < 1356.57
  -> Decision False in time 0.0300000000, query time of that 0.0024055580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 306.6399999999994
Index size:  223204.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0134843830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1038040560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.9202616750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0119218160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1068948780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1600000000, query time of that 0.9921569270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0124155530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0972155830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 5.5100000000, query time of that 0.6216680120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 95.25
Index size:  200032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0513083333
  Testing...
|S| = 20
|T| = 283
Reject!
2072.56 < 2163.11
  -> Decision False in time 0.0000000000, query time of that 0.0040178020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2417.58 < 2528.29
  -> Decision False in time 0.0300000000, query time of that 0.0177104250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1736.36 < 1770.01
  -> Decision False in time 0.0000000000, query time of that 0.0037600750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1757.58 < 1991.34
  -> Decision False in time 0.0000000000, query time of that 0.0025686890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1860.87 < 1935.34
  -> Decision False in time 0.0100000000, query time of that 0.0025479320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1223.51 < 1255.02
  -> Decision False in time 0.0100000000, query time of that 0.0025779300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1516.47 < 1608.37
  -> Decision False in time 0.0400000000, query time of that 0.0027279800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1620.84 < 1644.39
  -> Decision False in time 0.1700000000, query time of that 0.0051863300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1842.22 < 1859.22
  -> Decision False in time 0.0000000000, query time of that 0.0026128740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 308.9300000000003
Index size:  245080.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0100765530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0762536290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6684592090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0091027820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1868.64 < 1891.37
  -> Decision False in time 0.0900000000, query time of that 0.0693237600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.7001227010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0083686390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.0739886380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1844.2 < 1850.69
  -> Decision False in time 0.9000000000, query time of that 0.0869076080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 96.97999999999956
Index size:  199196.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0038350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072068160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0530736870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4540691910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0064077720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0525541170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1493.9 < 1546
  -> Decision False in time 0.2400000000, query time of that 0.1546528980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052884080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1305.42 < 1333.05
  -> Decision False in time 0.0300000000, query time of that 0.0054129840, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1301.36 < 1365.17
  -> Decision False in time 1.3500000000, query time of that 0.0778996480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 328.1100000000006
Index size:  243748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0350779220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3232420780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.3800000000, query time of that 3.3045104220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0317706240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2733326360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6200000000, query time of that 2.5169911830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0292534210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.3152977880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1900000000, query time of that 3.0737597460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 95.88000000000102
Index size:  188672.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0197266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051594280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1635.83 < 1649.32
  -> Decision False in time 0.0100000000, query time of that 0.0066022630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2151.85 < 2183.91
  -> Decision False in time 0.0900000000, query time of that 0.0778581640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1659.91 < 1712.12
  -> Decision False in time 0.0000000000, query time of that 0.0030319870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0309566560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1820.85 < 1824.89
  -> Decision False in time 0.0700000000, query time of that 0.0286206170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1089.92 < 1120.98
  -> Decision False in time 0.0300000000, query time of that 0.0032753150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1700.82 < 1743.51
  -> Decision False in time 0.1000000000, query time of that 0.0064765500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1145.27 < 1291.37
  -> Decision False in time 0.0400000000, query time of that 0.0034603820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 308.369999999999
Index size:  243772.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0532600740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5719383080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 6.1600000000, query time of that 6.0628415360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0640927750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.6300000000, query time of that 0.6045695290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 6.0900000000, query time of that 5.9137720620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.0525891800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.5289133780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3800000000, query time of that 5.0686337130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 69.29000000000087
Index size:  195176.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2512750000
  Testing...
|S| = 20
|T| = 283
Reject!
2047.6 < 2117.78
  -> Decision False in time 0.0000000000, query time of that 0.0033840650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1326.22 < 1997.3
  -> Decision False in time 0.0100000000, query time of that 0.0031588630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2031.27 < 2035.3
  -> Decision False in time 0.0000000000, query time of that 0.0031353780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1751.93 < 1827.36
  -> Decision False in time 0.0000000000, query time of that 0.0023031610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1428.83 < 1633.59
  -> Decision False in time 0.0100000000, query time of that 0.0022406510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1069.52 < 1106.33
  -> Decision False in time 0.0000000000, query time of that 0.0023212160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2064.05 < 2068.96
  -> Decision False in time 0.0000000000, query time of that 0.0022060790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2230.42 < 2255.58
  -> Decision False in time 0.0100000000, query time of that 0.0021429020, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1973.36 < 2004.08
  -> Decision False in time 0.0000000000, query time of that 0.0022491350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 130.65999999999985
Index size:  175228.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4475200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038751620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1437.42 < 1477.97
  -> Decision False in time 0.0000000000, query time of that 0.0036426710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2031.16 < 2062.24
  -> Decision False in time 0.0100000000, query time of that 0.0051632910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1771.34 < 1913.43
  -> Decision False in time 0.0000000000, query time of that 0.0021052260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1842.01 < 1899.47
  -> Decision False in time 0.0100000000, query time of that 0.0020247600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1386.05 < 1405.2
  -> Decision False in time 0.0000000000, query time of that 0.0019932880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1820.2 < 2241.4
  -> Decision False in time 0.0000000000, query time of that 0.0018517270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1248.24 < 1283.67
  -> Decision False in time 0.0100000000, query time of that 0.0018431700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1569.86 < 1699.33
  -> Decision False in time 0.0000000000, query time of that 0.0021393600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 317.65999999999985
Index size:  250628.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0120056340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0928771320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.8154488120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0098746720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0887845310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.8491729100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0113991030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0853218090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7100000000, query time of that 0.8497103610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 322.09999999999854
Index size:  244980.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0094013850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0708337930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6500000000, query time of that 0.6040885030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0093362950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0699129750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.6444790530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1307.59 < 1332.28
  -> Decision False in time 0.0500000000, query time of that 0.0092492300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0629325000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1619.69 < 1638.93
  -> Decision False in time 1.9100000000, query time of that 0.1462154540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 315.8299999999981
Index size:  194304.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0164002060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1284828120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.2001458930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0147773830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1293414750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4500000000, query time of that 1.2778024320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0158818580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.1349935720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 1.2121755990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 316.880000000001
Index size:  240024.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0162146640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1428370170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3600000000, query time of that 1.3068928190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0159747040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1449061910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.3757621350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0165616180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1467586280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9300000000, query time of that 1.3863030840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 126.88999999999942
Index size:  203680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0118003730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0918480660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.7921043680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0102766110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0914541100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1729.02 < 1745.07
  -> Decision False in time 0.0400000000, query time of that 0.0437548530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1216.4 < 1269.04
  -> Decision False in time 0.0700000000, query time of that 0.0089633470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1903.61 < 1918.76
  -> Decision False in time 0.6200000000, query time of that 0.0627413190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1527.2 < 1554.36
  -> Decision False in time 0.8300000000, query time of that 0.0857406820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 124.97999999999956
Index size:  176424.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0006300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0146529260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1150438380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.1637360040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0168341600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1217733820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4100000000, query time of that 1.1687996270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.0163957820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1450.3 < 1626.3
  -> Decision False in time 0.5300000000, query time of that 0.0695662030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2024.66 < 2079.55
  -> Decision False in time 0.2900000000, query time of that 0.0453243360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 127.35000000000218
Index size:  190720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0087100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057125440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0416789760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2114.56 < 2138.34
  -> Decision False in time 0.3200000000, query time of that 0.2859730200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0043847130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1888.02 < 1958.31
  -> Decision False in time 0.0400000000, query time of that 0.0159662750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
980.894 < 1102.91
  -> Decision False in time 0.0300000000, query time of that 0.0136067820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1665.92 < 1694.03
  -> Decision False in time 0.0700000000, query time of that 0.0038151410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1508.34 < 1692.71
  -> Decision False in time 0.1300000000, query time of that 0.0080940500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1835.14 < 1838.49
  -> Decision False in time 0.0000000000, query time of that 0.0039473530, with c1=5.0000000000, c2=0.1000000000
