copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 129.58
Index size:  405988.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0011916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0117540230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1009460490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
613.445 < 624.4
  -> Decision False in time 0.3700000000, query time of that 0.3441433920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0103840210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1079970320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
754.004 < 841.27
  -> Decision False in time 0.4000000000, query time of that 0.3861122830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0109917140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1429.01 < 1449.03
  -> Decision False in time 0.4400000000, query time of that 0.0629907130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2031.82 < 2037.49
  -> Decision False in time 0.7100000000, query time of that 0.0936292940, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 301.78
Index size:  280948.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0180212390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1699482550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7600000000, query time of that 1.7059846380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0195003420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2075526090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1000000000, query time of that 1.9747416690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0242373640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2207102660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4400000000, query time of that 2.3346592870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 290.55000000000007
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0077127290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0612223840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6300000000, query time of that 0.5886451460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0062047440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0663053940, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.6670339740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0069224450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0671410550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1338.58 < 1359.1
  -> Decision False in time 1.6800000000, query time of that 0.1352616540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 129.36000000000013
Index size:  205640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0067133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049048530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0386365420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1538.65 < 1546.67
  -> Decision False in time 0.0900000000, query time of that 0.0831418540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0041770620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0447453150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1295.09 < 1337.79
  -> Decision False in time 0.1300000000, query time of that 0.0794690000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0045940670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1718.95 < 1890.77
  -> Decision False in time 0.4600000000, query time of that 0.0287470960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1209.65 < 1214.84
  -> Decision False in time 0.0500000000, query time of that 0.0045959170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 129.52999999999997
Index size:  190852.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0020533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072303640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0659726250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6800000000, query time of that 0.6408802770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072029500, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0738882170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.7393286780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0080749580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1465.77 < 1486.49
  -> Decision False in time 0.1300000000, query time of that 0.0151526390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1777.97 < 1911.46
  -> Decision False in time 0.3700000000, query time of that 0.0384486720, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 302.5999999999999
Index size:  256032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0182940580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1859195700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8600000000, query time of that 1.8109983940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0204143910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2110020250, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1800000000, query time of that 2.0565664120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0219687970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2281902690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5100000000, query time of that 2.4303324320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 108.5300000000002
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0724183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0026896850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1812.03 < 1838.36
  -> Decision False in time 0.0200000000, query time of that 0.0115235180, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1866.36 < 2409
  -> Decision False in time 0.0100000000, query time of that 0.0125241950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1132.99 < 1144.8
  -> Decision False in time 0.0100000000, query time of that 0.0020007860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1622.14 < 1734.13
  -> Decision False in time 0.0200000000, query time of that 0.0046866410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
979.056 < 982.392
  -> Decision False in time 0.0000000000, query time of that 0.0023051260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1423.25 < 1428.32
  -> Decision False in time 0.0100000000, query time of that 0.0023869710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1387.38 < 1391.86
  -> Decision False in time 0.0000000000, query time of that 0.0024363190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1509.78 < 1540.27
  -> Decision False in time 0.0100000000, query time of that 0.0022530380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 109.02999999999975
Index size:  182696.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0034800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076189700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0635166530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6600000000, query time of that 0.6214378440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0067985240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0720879310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.7093855650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0077439650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1422.86 < 1831.48
  -> Decision False in time 0.3000000000, query time of that 0.0288100610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1227.36 < 1234.02
  -> Decision False in time 1.0100000000, query time of that 0.0918436800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.67000000000007
Index size:  180712.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7946200000
  Testing...
|S| = 20
|T| = 283
Reject!
1137.48 < 1228.37
  -> Decision False in time 0.0000000000, query time of that 0.0015522620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1954.4 < 2556.16
  -> Decision False in time 0.0000000000, query time of that 0.0024089300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1876.05 < 1877.19
  -> Decision False in time 0.0000000000, query time of that 0.0011894010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2672.74 < 2787.84
  -> Decision False in time 0.0000000000, query time of that 0.0010564720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2685.75 < 2715.17
  -> Decision False in time 0.0100000000, query time of that 0.0009760350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1647.84 < 2089.62
  -> Decision False in time 0.0000000000, query time of that 0.0010882250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1240.41 < 1409.26
  -> Decision False in time 0.0000000000, query time of that 0.0010605310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2617.82 < 2876.42
  -> Decision False in time 0.0000000000, query time of that 0.0009641900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
695.17 < 783.966
  -> Decision False in time 0.0000000000, query time of that 0.0010123150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 128.67999999999984
Index size:  193268.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0412550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031643250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0228124470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2665.85 < 2666.36
  -> Decision False in time 0.1800000000, query time of that 0.1514556850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1354.37 < 1393.92
  -> Decision False in time 0.0000000000, query time of that 0.0024771350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1303.51 < 1309.25
  -> Decision False in time 0.0200000000, query time of that 0.0051025170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1892.18 < 1917.38
  -> Decision False in time 0.0200000000, query time of that 0.0108594840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1217.37 < 1225.4
  -> Decision False in time 0.0300000000, query time of that 0.0028188690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1411.24 < 1426.56
  -> Decision False in time 0.0000000000, query time of that 0.0027971360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1071.32 < 1080.33
  -> Decision False in time 0.0300000000, query time of that 0.0026217620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 292.28999999999996
Index size:  233840.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092705280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0798218900, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7911691960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0085988650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0921810260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.9090794940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0092657600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0899616550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2071.18 < 2084.86
  -> Decision False in time 4.1400000000, query time of that 0.4447724150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 291.8600000000001
Index size:  238952.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0196980410, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1900530990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9000000000, query time of that 1.8493755510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0198067760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2005952040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2000000000, query time of that 2.0742481350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0221755330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.2466495190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3800000000, query time of that 2.5243833950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 126.5300000000002
Index size:  202720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0039400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0053156690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0459844840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4536476400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0054720850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1021.96 < 1030.54
  -> Decision False in time 0.0700000000, query time of that 0.0468317490, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8500000000, query time of that 0.5222846470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
909.615 < 1086.85
  -> Decision False in time 0.0900000000, query time of that 0.0053099070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1120.45 < 1122.69
  -> Decision False in time 0.1300000000, query time of that 0.0110700410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1149.93 < 1152.67
  -> Decision False in time 0.0500000000, query time of that 0.0054601150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 300.1399999999999
Index size:  242844.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0162072380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1570615380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5700000000, query time of that 1.5223657030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0152640570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1735380720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8800000000, query time of that 1.7427702730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0168745070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1878549480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6600000000, query time of that 1.8594488820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 292.3600000000006
Index size:  193612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055405950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0456587360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4611951770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0053398900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0532058470, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.5271118810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0054410520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1344.96 < 1346.77
  -> Decision False in time 0.1300000000, query time of that 0.0110228620, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1856.86 < 1897.25
  -> Decision False in time 1.2100000000, query time of that 0.0787276980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 78.33999999999924
Index size:  195468.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0250483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0057815190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0455197690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2845.73 < 2944.01
  -> Decision False in time 0.0400000000, query time of that 0.0356021540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1342.7 < 1452.1
  -> Decision False in time 0.0100000000, query time of that 0.0055380920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1371.43 < 2400.45
  -> Decision False in time 0.0600000000, query time of that 0.0433614510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1226.87 < 1265.01
  -> Decision False in time 0.0100000000, query time of that 0.0052893310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1895.72 < 1900.44
  -> Decision False in time 0.0100000000, query time of that 0.0050618660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1822.84 < 1868.31
  -> Decision False in time 0.0100000000, query time of that 0.0054880420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2076.61 < 2819.13
  -> Decision False in time 0.0900000000, query time of that 0.0110659250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 301.5599999999995
Index size:  252136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0130114370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1104607770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1200000000, query time of that 1.0840991920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0123913630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1234336980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.2424124040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0122947400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1226118250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6200000000, query time of that 1.2642187790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 301.4300000000003
Index size:  202720.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0264192720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2681221670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7400000000, query time of that 2.6860614980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0291057780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.2939371480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1900000000, query time of that 2.9713097960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0351103630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.3582980330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9700000000, query time of that 3.8820718660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 294.0500000000002
Index size:  193476.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0126662570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1091486290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1300000000, query time of that 1.0791331220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0125210140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1237262160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4400000000, query time of that 1.2364460990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0125447470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1270998650, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 1.2394304260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.77000000000044
Index size:  194352.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0428983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036583290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2505.96 < 2761.26
  -> Decision False in time 0.0200000000, query time of that 0.0199281990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1163.65 < 1184.52
  -> Decision False in time 0.1500000000, query time of that 0.1270541590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0031631140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1620.84 < 1740.55
  -> Decision False in time 0.0400000000, query time of that 0.0239869600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1203.28 < 1226.36
  -> Decision False in time 0.0100000000, query time of that 0.0060265870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0036496380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1352.02 < 1387.04
  -> Decision False in time 0.0400000000, query time of that 0.0037489420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1093.09 < 1094.08
  -> Decision False in time 0.0300000000, query time of that 0.0039586100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 128.5699999999997
Index size:  188288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0226333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037043960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0275234030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2112.58 < 2186.12
  -> Decision False in time 0.0500000000, query time of that 0.0435502690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028553100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1215.69 < 1255.85
  -> Decision False in time 0.0200000000, query time of that 0.0129952190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1575.47 < 1579.89
  -> Decision False in time 0.0400000000, query time of that 0.0166912020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1483.75 < 1494.77
  -> Decision False in time 0.0200000000, query time of that 0.0033260980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1418.43 < 1433.78
  -> Decision False in time 0.1500000000, query time of that 0.0068354490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
994.024 < 1132.73
  -> Decision False in time 0.0200000000, query time of that 0.0035906130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 293.2399999999998
Index size:  236960.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0150547950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1402139830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.3414133700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0164276370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1547272650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6500000000, query time of that 1.5386175640, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0149384910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.1560879320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7200000000, query time of that 1.5679516600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 108.78999999999996
Index size:  199644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0031233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090351090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0794819310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7717086020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0085156320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0885430340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
649.281 < 668.337
  -> Decision False in time 0.3500000000, query time of that 0.3323155390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0090510700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1358.09 < 1627.92
  -> Decision False in time 0.6500000000, query time of that 0.0780314010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1538.13 < 1562.86
  -> Decision False in time 1.5000000000, query time of that 0.1609390700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.21000000000004
Index size:  178148.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2141366667
  Testing...
|S| = 20
|T| = 283
Reject!
2581.73 < 2699.27
  -> Decision False in time 0.0000000000, query time of that 0.0025074990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2129.37 < 2185.11
  -> Decision False in time 0.0100000000, query time of that 0.0068843120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1404.4 < 1424.68
  -> Decision False in time 0.0100000000, query time of that 0.0076274410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1430.79 < 1469.14
  -> Decision False in time 0.0000000000, query time of that 0.0016127000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1770.06 < 1890.7
  -> Decision False in time 0.0000000000, query time of that 0.0017260090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2062.82 < 2069.43
  -> Decision False in time 0.0100000000, query time of that 0.0016746890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1386.07 < 1428.91
  -> Decision False in time 0.0000000000, query time of that 0.0016247150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1253.24 < 1268.13
  -> Decision False in time 0.0000000000, query time of that 0.0017782360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1469.52 < 1550.04
  -> Decision False in time 0.0100000000, query time of that 0.0018147560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 301.22999999999956
Index size:  256512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0323276480, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3275083930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.2900000000, query time of that 3.2401285870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0399261850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3477527900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6900000000, query time of that 3.5439373560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0381699730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.4526071680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1500000000, query time of that 4.8682030890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 300.1800000000003
Index size:  202500.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0148948200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1273628380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2600000000, query time of that 1.2139522700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0140046030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1450988800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1625.61 < 1627.94
  -> Decision False in time 1.2600000000, query time of that 1.2085695700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0145721590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1385657090, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0200000000, query time of that 1.4328428570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.77000000000044
Index size:  189436.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0044600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0060047500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0521265670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5900000000, query time of that 0.5304320810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057620140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0606991520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
966.63 < 973.837
  -> Decision False in time 0.3600000000, query time of that 0.2715342880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061699790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0623914770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1370.36 < 1487.94
  -> Decision False in time 0.1700000000, query time of that 0.0156245350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 108.51000000000022
Index size:  182992.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0147900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042940340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0319218220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1647.48 < 1658.6
  -> Decision False in time 0.1100000000, query time of that 0.0984606210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033728950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1340.87 < 1387.42
  -> Decision False in time 0.0000000000, query time of that 0.0038045510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1110.79 < 1129.31
  -> Decision False in time 0.0400000000, query time of that 0.0186668430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
821.802 < 859.868
  -> Decision False in time 0.0100000000, query time of that 0.0037151270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1717.87 < 1794.33
  -> Decision False in time 0.1800000000, query time of that 0.0098002920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1893.43 < 1896.71
  -> Decision False in time 0.0300000000, query time of that 0.0038238970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 292.5699999999997
Index size:  240760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084468280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0715099080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.7017174310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076593250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0804850100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1637.48 < 1662.66
  -> Decision False in time 0.1400000000, query time of that 0.1316811170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0081205760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0821585480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2105.89 < 2122.87
  -> Decision False in time 1.3300000000, query time of that 0.1307570150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 302.9200000000001
Index size:  262200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0094893240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0800510140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7838111320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0091530430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0931924530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1600000000, query time of that 0.9289089730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0092409380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0899015340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1939.74 < 1958.57
  -> Decision False in time 1.3600000000, query time of that 0.1502985640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 296.0599999999995
Index size:  197688.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0106450170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0998283700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9783868960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0123565280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1139100930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3600000000, query time of that 1.1489416690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0122462530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1849.08 < 1849.86
  -> Decision False in time 0.1300000000, query time of that 0.0253364820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 1.1439439670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 301.1100000000006
Index size:  252612.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078960130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0637801850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6551116350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076327130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0775109820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.7545559940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0081767530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0748379370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1580.62 < 1608.53
  -> Decision False in time 0.0600000000, query time of that 0.0077188860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 299.40999999999985
Index size:  211056.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0067764790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0539730670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5243470210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057720590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0588087060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1250.94 < 1277.77
  -> Decision False in time 0.4700000000, query time of that 0.3660593780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0055953930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1449.9 < 1456.33
  -> Decision False in time 0.3300000000, query time of that 0.0276882350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1617.63 < 1674.65
  -> Decision False in time 1.8900000000, query time of that 0.1372431000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 301.1299999999992
Index size:  205400.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0099112780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0890870960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9010350930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112077990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1054302650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.0473868440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0117541920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1021635380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9300000000, query time of that 1.0435016380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 108.27999999999884
Index size:  189228.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5966966667
  Testing...
|S| = 20
|T| = 283
Reject!
1289.86 < 1321.96
  -> Decision False in time 0.0100000000, query time of that 0.0015863230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
662.789 < 671.867
  -> Decision False in time 0.0000000000, query time of that 0.0019246660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
997.399 < 1100.34
  -> Decision False in time 0.0100000000, query time of that 0.0023175150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1421.85 < 1505.3
  -> Decision False in time 0.0100000000, query time of that 0.0013288380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
957.499 < 1044.99
  -> Decision False in time 0.0100000000, query time of that 0.0010418370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1246.78 < 1279.74
  -> Decision False in time 0.0000000000, query time of that 0.0010457260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1235.5 < 1492.77
  -> Decision False in time 0.0100000000, query time of that 0.0009520740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1140.28 < 1190.26
  -> Decision False in time 0.0000000000, query time of that 0.0010309120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1533.15 < 1836.63
  -> Decision False in time 0.0000000000, query time of that 0.0010444030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 108.76000000000022
Index size:  186164.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1548600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024238500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1345.59 < 1346.7
  -> Decision False in time 0.0100000000, query time of that 0.0049575250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1346.64 < 1352.28
  -> Decision False in time 0.0000000000, query time of that 0.0042304410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1253.3 < 1314.57
  -> Decision False in time 0.0100000000, query time of that 0.0017097620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2617.27 < 2667.77
  -> Decision False in time 0.0000000000, query time of that 0.0020125870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
874.299 < 875.493
  -> Decision False in time 0.0100000000, query time of that 0.0015779780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
791.853 < 814.921
  -> Decision False in time 0.0100000000, query time of that 0.0017423890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1491.59 < 1518.9
  -> Decision False in time 0.0000000000, query time of that 0.0017152050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
928.128 < 942.316
  -> Decision False in time 0.0100000000, query time of that 0.0017084520, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 292.96999999999935
Index size:  243088.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1071566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029353360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1183.88 < 1220.47
  -> Decision False in time 0.0000000000, query time of that 0.0047064200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1452.53 < 1529.74
  -> Decision False in time 0.0100000000, query time of that 0.0092156410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1314.19 < 1344.09
  -> Decision False in time 0.0000000000, query time of that 0.0021473140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
842.619 < 852.266
  -> Decision False in time 0.0100000000, query time of that 0.0025521680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1254.01 < 1272.59
  -> Decision False in time 0.0000000000, query time of that 0.0023662190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1523.85 < 1544.53
  -> Decision False in time 0.0000000000, query time of that 0.0022569510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
854.011 < 875.685
  -> Decision False in time 0.0100000000, query time of that 0.0024351500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
758.591 < 762.818
  -> Decision False in time 0.0200000000, query time of that 0.0024861490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 108.5
Index size:  200640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0028000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0105470380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0932406790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9184523810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099672150, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1376.82 < 1424.62
  -> Decision False in time 0.0300000000, query time of that 0.0301595710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2003.12 < 2170.58
  -> Decision False in time 0.1000000000, query time of that 0.0853706970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1496.05 < 1608.73
  -> Decision False in time 0.0200000000, query time of that 0.0113654280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1059481460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
890.821 < 933.845
  -> Decision False in time 0.2700000000, query time of that 0.0437755320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.60999999999876
Index size:  178068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5996500000
  Testing...
|S| = 20
|T| = 283
Reject!
1450.53 < 1456.93
  -> Decision False in time 0.0100000000, query time of that 0.0020312850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1890.18 < 1948.5
  -> Decision False in time 0.0000000000, query time of that 0.0013872790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1426 < 1524.46
  -> Decision False in time 0.0000000000, query time of that 0.0013542630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1987.55 < 2135.4
  -> Decision False in time 0.0000000000, query time of that 0.0012174090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1243.86 < 1347.09
  -> Decision False in time 0.0000000000, query time of that 0.0012879150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
900.699 < 1096.38
  -> Decision False in time 0.0100000000, query time of that 0.0012420770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2541.54 < 2563.3
  -> Decision False in time 0.0000000000, query time of that 0.0012424370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1499.53 < 1754.1
  -> Decision False in time 0.0000000000, query time of that 0.0012294580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1457.81 < 1464.4
  -> Decision False in time 0.0000000000, query time of that 0.0012352110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 293.77000000000044
Index size:  240752.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0028183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056374190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0401480150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1792.94 < 1793.35
  -> Decision False in time 0.2200000000, query time of that 0.2025672940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0042506400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0449329930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1910.82 < 1918.95
  -> Decision False in time 0.2100000000, query time of that 0.1260416070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0048963920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1196.55 < 1233.21
  -> Decision False in time 0.1300000000, query time of that 0.0098925150, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1469.81 < 1480.99
  -> Decision False in time 0.2200000000, query time of that 0.0145704680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 128.4300000000003
Index size:  205980.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064335960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0521502160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5144152050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0053798760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0594411450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2326.01 < 2443.06
  -> Decision False in time 0.6000000000, query time of that 0.4596847380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1428.45 < 1724.77
  -> Decision False in time 0.0300000000, query time of that 0.0060816610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0603334520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1265.45 < 1275.74
  -> Decision False in time 0.0400000000, query time of that 0.0063789450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 108.10000000000036
Index size:  182892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0279083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034354200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0264013740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2337.38 < 2359.15
  -> Decision False in time 0.0400000000, query time of that 0.0310711810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027625890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2143.37 < 2535.34
  -> Decision False in time 0.0000000000, query time of that 0.0033028580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1758.96 < 1828.74
  -> Decision False in time 0.0400000000, query time of that 0.0154377210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0030074670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1230.18 < 1241.63
  -> Decision False in time 0.0200000000, query time of that 0.0032311990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1058.75 < 1059.62
  -> Decision False in time 0.0400000000, query time of that 0.0033327450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 78.18000000000029
Index size:  183776.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3727166667
  Testing...
|S| = 20
|T| = 283
Reject!
1785.66 < 1847.31
  -> Decision False in time 0.0100000000, query time of that 0.0021999290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1577.6 < 1597.93
  -> Decision False in time 0.0000000000, query time of that 0.0036401970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1938.12 < 1945.3
  -> Decision False in time 0.0000000000, query time of that 0.0017585280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1188.85 < 1259.04
  -> Decision False in time 0.0100000000, query time of that 0.0014930880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2217.58 < 2357.46
  -> Decision False in time 0.0000000000, query time of that 0.0015309170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1061.29 < 1143.78
  -> Decision False in time 0.0000000000, query time of that 0.0014439820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2459.8 < 2537.13
  -> Decision False in time 0.0000000000, query time of that 0.0015054460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1994.8 < 2035.03
  -> Decision False in time 0.0100000000, query time of that 0.0015925670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1684.99 < 1710.71
  -> Decision False in time 0.0000000000, query time of that 0.0015091580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 77.94000000000051
Index size:  186788.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0762266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031094090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1440.57 < 1445.01
  -> Decision False in time 0.0100000000, query time of that 0.0090558930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1812.02 < 2070.69
  -> Decision False in time 0.0100000000, query time of that 0.0107556650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1353.58 < 1389.07
  -> Decision False in time 0.0100000000, query time of that 0.0025179000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1176.32 < 1194.49
  -> Decision False in time 0.0000000000, query time of that 0.0025186660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
899.784 < 922.379
  -> Decision False in time 0.0000000000, query time of that 0.0026005120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2210.76 < 2331.54
  -> Decision False in time 0.0100000000, query time of that 0.0026658270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1230.81 < 1242.86
  -> Decision False in time 0.0000000000, query time of that 0.0026890580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1809.25 < 1809.66
  -> Decision False in time 0.0100000000, query time of that 0.0028002350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 77.60999999999876
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1150300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029777140, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1080.33 < 1154.35
  -> Decision False in time 0.0100000000, query time of that 0.0074703940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1839.24 < 1916.26
  -> Decision False in time 0.0100000000, query time of that 0.0105373950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
959.879 < 998.618
  -> Decision False in time 0.0000000000, query time of that 0.0021269490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2408.63 < 2619.93
  -> Decision False in time 0.0100000000, query time of that 0.0048390830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2738.62 < 2758.02
  -> Decision False in time 0.0100000000, query time of that 0.0021809080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1718.65 < 1972.01
  -> Decision False in time 0.0000000000, query time of that 0.0022260740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1362.9 < 1490.99
  -> Decision False in time 0.0100000000, query time of that 0.0022831710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
937.772 < 956.435
  -> Decision False in time 0.0000000000, query time of that 0.0025541480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 292.7300000000014
Index size:  240528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0060616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044072090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0340644570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1155.58 < 1192.37
  -> Decision False in time 0.2800000000, query time of that 0.2484233360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034672990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1535.61 < 1582.13
  -> Decision False in time 0.0500000000, query time of that 0.0295119290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1271.93 < 1280.49
  -> Decision False in time 0.2700000000, query time of that 0.1315800460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0037247520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1984.76 < 1999.51
  -> Decision False in time 0.2900000000, query time of that 0.0162440640, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1316.7 < 1326.63
  -> Decision False in time 0.1100000000, query time of that 0.0081025960, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 293.1299999999992
Index size:  248980.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0325864040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2946900780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.0200000000, query time of that 2.9643216730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0354795750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3316604690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.4300000000, query time of that 3.2973045080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.0436589530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.4475807530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.3700000000, query time of that 4.6250554840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 128.5699999999997
Index size:  203956.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1056883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025766420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1097.58 < 1106.88
  -> Decision False in time 0.0200000000, query time of that 0.0171050330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1753.9 < 1784.7
  -> Decision False in time 0.0400000000, query time of that 0.0256265740, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0020012160, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1276.08 < 1292.05
  -> Decision False in time 0.0100000000, query time of that 0.0021040050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1129.56 < 1140.83
  -> Decision False in time 0.0100000000, query time of that 0.0021411500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1517.41 < 1586.27
  -> Decision False in time 0.0000000000, query time of that 0.0021397410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1395.33 < 1461.78
  -> Decision False in time 0.0200000000, query time of that 0.0020860820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
594.839 < 599.307
  -> Decision False in time 0.0100000000, query time of that 0.0023647670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 300.0
Index size:  244440.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0139298790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1306538880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.2914723510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0143992100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1523245870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6500000000, query time of that 1.4989112140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0170511700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1620760370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1466.25 < 1585.91
  -> Decision False in time 2.4900000000, query time of that 0.4774042140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 127.53000000000065
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2552100000
  Testing...
|S| = 20
|T| = 283
Reject!
2125.61 < 2130.93
  -> Decision False in time 0.0000000000, query time of that 0.0024160110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1150.91 < 1177.51
  -> Decision False in time 0.0100000000, query time of that 0.0059506400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
964.96 < 1093.34
  -> Decision False in time 0.0100000000, query time of that 0.0063428670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1139.54 < 1139.68
  -> Decision False in time 0.0000000000, query time of that 0.0017440180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1564.48 < 1638.16
  -> Decision False in time 0.0000000000, query time of that 0.0016837870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1206.85 < 1209.37
  -> Decision False in time 0.0000000000, query time of that 0.0017223760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
982.726 < 996.808
  -> Decision False in time 0.0100000000, query time of that 0.0017870630, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1354.73 < 1358.65
  -> Decision False in time 0.0000000000, query time of that 0.0017648800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2055.59 < 2088.79
  -> Decision False in time 0.0100000000, query time of that 0.0017387010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 127.68000000000029
Index size:  174120.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4958666667
  Testing...
|S| = 20
|T| = 283
Reject!
1101.04 < 1101.51
  -> Decision False in time 0.0100000000, query time of that 0.0020380660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1440.49 < 1497.07
  -> Decision False in time 0.0000000000, query time of that 0.0038657400, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1631.46 < 1993.68
  -> Decision False in time 0.0000000000, query time of that 0.0022450040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1243.81 < 1259.8
  -> Decision False in time 0.0100000000, query time of that 0.0014958260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1760.9 < 1767.04
  -> Decision False in time 0.0000000000, query time of that 0.0015470270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2068.02 < 2408.78
  -> Decision False in time 0.0000000000, query time of that 0.0014615710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2264.06 < 2265.31
  -> Decision False in time 0.0000000000, query time of that 0.0014871640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
811.261 < 872.353
  -> Decision False in time 0.0100000000, query time of that 0.0016975820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
980.988 < 1006.22
  -> Decision False in time 0.0000000000, query time of that 0.0015973600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 299.89999999999964
Index size:  244948.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0230954200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2117927990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1200000000, query time of that 2.0760961290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0210003940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2217640240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5600000000, query time of that 2.3761407480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0238863440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2822545220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6200000000, query time of that 2.8702236190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.35999999999876
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0309416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0050701970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0411176080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1037.07 < 1040.21
  -> Decision False in time 0.0700000000, query time of that 0.0639523410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041870650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1773.27 < 1834.57
  -> Decision False in time 0.0400000000, query time of that 0.0294169780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1400.67 < 1419.71
  -> Decision False in time 0.0300000000, query time of that 0.0182662940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0044165990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2039.57 < 2105.6
  -> Decision False in time 0.0100000000, query time of that 0.0049205730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1217.11 < 1231.66
  -> Decision False in time 0.0100000000, query time of that 0.0049374690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 108.0
Index size:  144228.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0067500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056120850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2395.54 < 2509.61
  -> Decision False in time 0.0200000000, query time of that 0.0192332460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1153.59 < 1153.84
  -> Decision False in time 0.0600000000, query time of that 0.0493505310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048870740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1707.43 < 1721.5
  -> Decision False in time 0.0100000000, query time of that 0.0052317650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1060.76 < 1321.61
  -> Decision False in time 0.0800000000, query time of that 0.0530752370, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0048880590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1055.76 < 1069.81
  -> Decision False in time 0.3800000000, query time of that 0.0259752980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1271.21 < 1277.91
  -> Decision False in time 0.1000000000, query time of that 0.0108053630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 128.52000000000044
Index size:  187700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0133666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0039977740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1999.09 < 2031.53
  -> Decision False in time 0.0300000000, query time of that 0.0189222700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1361.59 < 1373.06
  -> Decision False in time 0.2600000000, query time of that 0.2321154610, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032016630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0366197160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1395.11 < 1424.49
  -> Decision False in time 0.0600000000, query time of that 0.0273216180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1289.43 < 1291.42
  -> Decision False in time 0.0000000000, query time of that 0.0038297080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1641.97 < 1660.97
  -> Decision False in time 0.0500000000, query time of that 0.0038271440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1739.8 < 1749.49
  -> Decision False in time 0.0100000000, query time of that 0.0039048300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 127.95999999999913
Index size:  188188.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0086903430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0724744320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2242.41 < 2366.51
  -> Decision False in time 0.7600000000, query time of that 0.7195853300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0081813310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0812056990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.8220834940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0084017450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0813969760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1793.75 < 1796.3
  -> Decision False in time 0.2400000000, query time of that 0.0246699840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 108.5099999999984
Index size:  183196.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3297433333
  Testing...
|S| = 20
|T| = 283
Reject!
806.226 < 831.23
  -> Decision False in time 0.0000000000, query time of that 0.0021877030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1470.71 < 1547.21
  -> Decision False in time 0.0000000000, query time of that 0.0027587940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1040.64 < 1051.04
  -> Decision False in time 0.0000000000, query time of that 0.0017636290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1195.4 < 1200.73
  -> Decision False in time 0.0100000000, query time of that 0.0015417430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1096.26 < 1207.52
  -> Decision False in time 0.0000000000, query time of that 0.0015785710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1428.79 < 1481.38
  -> Decision False in time 0.0000000000, query time of that 0.0015247000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
994.584 < 998.987
  -> Decision False in time 0.0000000000, query time of that 0.0016107190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1228.43 < 1323.37
  -> Decision False in time 0.0100000000, query time of that 0.0015550220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1288.42 < 1351.46
  -> Decision False in time 0.0000000000, query time of that 0.0016197270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 300.5400000000009
Index size:  253988.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0109802090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0999984650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.9972481890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112159100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1160361560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3000000000, query time of that 1.1411849230, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0121060870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1207230930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6800000000, query time of that 1.1361232000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 301.3500000000022
Index size:  202584.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0157468080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1353695710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.3295651430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0142861580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1529492420, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.5338334110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0163326670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1585387480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1984.84 < 2049.49
  -> Decision False in time 7.3300000000, query time of that 1.4285459770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 293.0
Index size:  197824.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0254566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0034882670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0249365940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1469.81 < 1481.7
  -> Decision False in time 0.0400000000, query time of that 0.0284419800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026635360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
711.139 < 734.452
  -> Decision False in time 0.0200000000, query time of that 0.0093526420, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1787.77 < 1814.98
  -> Decision False in time 0.0100000000, query time of that 0.0057326850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1715.61 < 1734.09
  -> Decision False in time 0.0200000000, query time of that 0.0031018810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1127.55 < 1143.94
  -> Decision False in time 0.0100000000, query time of that 0.0032620830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1585.2 < 1622.93
  -> Decision False in time 0.0200000000, query time of that 0.0032511170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 79.0099999999984
Index size:  195668.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0194550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065515850, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0534372010, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1478.54 < 1480.74
  -> Decision False in time 0.0800000000, query time of that 0.0702864430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055252340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0617214230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1269.46 < 1271.53
  -> Decision False in time 0.0100000000, query time of that 0.0124664020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061535150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1363.99 < 1429.91
  -> Decision False in time 0.0300000000, query time of that 0.0061963170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1279.43 < 1302.03
  -> Decision False in time 0.0400000000, query time of that 0.0064843120, with c1=5.0000000000, c2=0.1000000000
