copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 301.20000000000005
Index size:  474896.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0338531720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3363946690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.4800000000, query time of that 3.4156530160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0374671380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3870648990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.8900000000, query time of that 3.7529923790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0422156140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0900000000, query time of that 0.4813685930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.4300000000, query time of that 5.1125169560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 302.4799999999999
Index size:  277888.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0301106330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1626914460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.6528492470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0186811100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2009175650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1100000000, query time of that 1.9569736270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0229649250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.2093256270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1939.74 < 1958.57
  -> Decision False in time 3.5800000000, query time of that 0.9191504610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 129.67999999999984
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075512660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0662159690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1976.56 < 2064.44
  -> Decision False in time 0.1700000000, query time of that 0.1626187200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0073797800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0758013030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.7398033990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0076147040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1519.76 < 1545.41
  -> Decision False in time 0.4000000000, query time of that 0.0384023080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1168.06 < 1203.46
  -> Decision False in time 2.9200000000, query time of that 0.2615465010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 129.8699999999999
Index size:  176796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1049250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0027315910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2309.82 < 2345.79
  -> Decision False in time 0.0200000000, query time of that 0.0147148280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1830.71 < 1941.17
  -> Decision False in time 0.0100000000, query time of that 0.0080462860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0018601980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1774.04 < 1874.83
  -> Decision False in time 0.0000000000, query time of that 0.0022323050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1377.37 < 1414.26
  -> Decision False in time 0.0100000000, query time of that 0.0020137820, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
947.872 < 999.779
  -> Decision False in time 0.0100000000, query time of that 0.0022741460, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1075.61 < 1108.36
  -> Decision False in time 0.0100000000, query time of that 0.0023177900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1335.43 < 1340.62
  -> Decision False in time 0.0200000000, query time of that 0.0024678730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 293.73
Index size:  233276.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0320392770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3000000000, query time of that 0.2982513780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.0300000000, query time of that 2.9692768590, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0357734350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3505207780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.4600000000, query time of that 3.3386651910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0403902160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0500000000, query time of that 0.4329601460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.6100000000, query time of that 4.7124388510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 291.1999999999998
Index size:  248428.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0054938760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0465660550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1883.56 < 1916.89
  -> Decision False in time 0.2000000000, query time of that 0.1822239270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0050326750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0529157260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.5288342290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056207860, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0539325850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1830.73 < 1862.43
  -> Decision False in time 0.7800000000, query time of that 0.0515740680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 77.7800000000002
Index size:  195352.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0819450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032210590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2531.91 < 2710.68
  -> Decision False in time 0.0100000000, query time of that 0.0061868380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1184.59 < 1280.18
  -> Decision False in time 0.0100000000, query time of that 0.0045713930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024678920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1101.4 < 1104.4
  -> Decision False in time 0.0000000000, query time of that 0.0028165570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1097.57 < 1170.19
  -> Decision False in time 0.0100000000, query time of that 0.0030833530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1153.37 < 1204.03
  -> Decision False in time 0.0100000000, query time of that 0.0028545040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1286.27 < 1297.32
  -> Decision False in time 0.0500000000, query time of that 0.0029780420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1258.75 < 1349.78
  -> Decision False in time 0.0100000000, query time of that 0.0029613910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 298.2399999999998
Index size:  250736.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0120194550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1067097190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1200000000, query time of that 1.0722541020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0124069330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1266731000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.2431848010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0145489930, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1281105080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6000000000, query time of that 1.2588134370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 127.92000000000007
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0065500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048083910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0388560740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1046.09 < 1076.71
  -> Decision False in time 0.0800000000, query time of that 0.0768958080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0042596800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1354.9 < 1359.59
  -> Decision False in time 0.0800000000, query time of that 0.0438438500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1282.04 < 1297.52
  -> Decision False in time 0.1900000000, query time of that 0.1104513730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1322.18 < 1353.22
  -> Decision False in time 0.0700000000, query time of that 0.0042498590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1294.03 < 1317.3
  -> Decision False in time 0.1200000000, query time of that 0.0094022250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1826.42 < 1841.49
  -> Decision False in time 0.2500000000, query time of that 0.0159855290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.94000000000005
Index size:  170848.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065023200, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0532670170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2356.07 < 2691.34
  -> Decision False in time 0.0800000000, query time of that 0.0813565250, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0060169670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0602832270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1771.38 < 2182.84
  -> Decision False in time 0.0900000000, query time of that 0.0743169040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1506.78 < 1513.11
  -> Decision False in time 0.0800000000, query time of that 0.0062076830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1013.44 < 1347.82
  -> Decision False in time 0.1000000000, query time of that 0.0127653860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1232.71 < 1270.28
  -> Decision False in time 0.1800000000, query time of that 0.0184356900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 293.48
Index size:  238420.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092046610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0813893350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7849915880, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0084521960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0913943750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.9091523990, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0098362520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.0872090860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2071.18 < 2084.86
  -> Decision False in time 5.8300000000, query time of that 0.6250134880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 302.4199999999996
Index size:  258648.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0186983440, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1859704040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.8666832660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0201268320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2153628080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2500000000, query time of that 2.1269721100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0237517680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2462919780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4600000000, query time of that 2.4356525470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 301.8899999999994
Index size:  203492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090456760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0780488260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7737951530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0084794220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0888933410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.8949881390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0096955420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0883347570, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6800000000, query time of that 0.8750200850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.32999999999993
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.6051133333
  Testing...
|S| = 20
|T| = 283
Reject!
1083.28 < 1166.86
  -> Decision False in time 0.0100000000, query time of that 0.0014596650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2307.02 < 2993.26
  -> Decision False in time 0.0000000000, query time of that 0.0010021340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1344.75 < 1436.43
  -> Decision False in time 0.0100000000, query time of that 0.0009800440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1166.84 < 1181.37
  -> Decision False in time 0.0000000000, query time of that 0.0009467050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1225.97 < 1313.85
  -> Decision False in time 0.0100000000, query time of that 0.0009317890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1619.74 < 2224.76
  -> Decision False in time 0.0000000000, query time of that 0.0009670860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1712.55 < 1818.59
  -> Decision False in time 0.0100000000, query time of that 0.0010005600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1388.62 < 1417.51
  -> Decision False in time 0.0000000000, query time of that 0.0009767500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
996.093 < 1051.6
  -> Decision False in time 0.0100000000, query time of that 0.0009363990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 108.44000000000051
Index size:  124784.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3356566667
  Testing...
|S| = 20
|T| = 283
Reject!
1704.39 < 2547.57
  -> Decision False in time 0.0000000000, query time of that 0.0017674770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
684.199 < 797.952
  -> Decision False in time 0.0100000000, query time of that 0.0020099060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1049.45 < 1074.1
  -> Decision False in time 0.0100000000, query time of that 0.0022789540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1934.67 < 1982.35
  -> Decision False in time 0.0000000000, query time of that 0.0012901210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1345.88 < 1386.49
  -> Decision False in time 0.0100000000, query time of that 0.0013362300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2581.97 < 2863.51
  -> Decision False in time 0.0000000000, query time of that 0.0013315330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1584.88 < 1633.49
  -> Decision False in time 0.0100000000, query time of that 0.0012863250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
902.865 < 1045.74
  -> Decision False in time 0.0000000000, query time of that 0.0013048180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
972.139 < 1007.49
  -> Decision False in time 0.0100000000, query time of that 0.0012925570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 108.67000000000007
Index size:  186440.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0715700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028610540, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1667.23 < 1973.73
  -> Decision False in time 0.0200000000, query time of that 0.0186414860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1032.71 < 1066.89
  -> Decision False in time 0.0100000000, query time of that 0.0034383290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0023543170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1152.06 < 1182.63
  -> Decision False in time 0.0200000000, query time of that 0.0053366910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1061.51 < 1080.83
  -> Decision False in time 0.0100000000, query time of that 0.0028464800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1245.53 < 1251.54
  -> Decision False in time 0.0100000000, query time of that 0.0023999880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
749.449 < 778.974
  -> Decision False in time 0.0100000000, query time of that 0.0024882050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
937.734 < 975.131
  -> Decision False in time 0.0200000000, query time of that 0.0025264290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 301.1400000000003
Index size:  261872.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0153591320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1349294790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4100000000, query time of that 1.3687015770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0170208400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1591439640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7600000000, query time of that 1.5956425190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0166052120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1692642490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9100000000, query time of that 1.6759729740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 300.3100000000004
Index size:  203060.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0263725580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2223823600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1400000000, query time of that 2.0991844130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0213962890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2229500780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5100000000, query time of that 2.3518996120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0232741770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.2647338300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 2.9043860710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 78.41000000000076
Index size:  182812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0512916667
  Testing...
|S| = 20
|T| = 283
Reject!
1900.85 < 2248.26
  -> Decision False in time 0.0000000000, query time of that 0.0040765120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1703.48 < 2826.87
  -> Decision False in time 0.0200000000, query time of that 0.0089050360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1874.02 < 1930.08
  -> Decision False in time 0.0200000000, query time of that 0.0217163310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2491.95 < 2705.46
  -> Decision False in time 0.0100000000, query time of that 0.0029405770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2018.99 < 2232.14
  -> Decision False in time 0.0700000000, query time of that 0.0304407880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2544.6 < 2592.08
  -> Decision False in time 0.0400000000, query time of that 0.0164944310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1275.12 < 1283.15
  -> Decision False in time 0.0600000000, query time of that 0.0037706900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1111.85 < 1147.34
  -> Decision False in time 0.0100000000, query time of that 0.0039935830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2420.48 < 2719.03
  -> Decision False in time 0.0900000000, query time of that 0.0077773870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 300.1099999999997
Index size:  200456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0290970710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2722146440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.6900000000, query time of that 2.6508643640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0295866580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.2809201440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.2000000000, query time of that 2.9925709180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0321468880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.3801958180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1787.35 < 1981.44
  -> Decision False in time 5.1000000000, query time of that 2.3452429660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 292.35000000000036
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0080137160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0702285020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7300000000, query time of that 0.6892335150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083863250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0809252910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1546.71 < 1546.89
  -> Decision False in time 0.2300000000, query time of that 0.2148086360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0080011300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0795266760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1860.92 < 1862.79
  -> Decision False in time 3.7200000000, query time of that 0.3585487930, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.39000000000033
Index size:  195516.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7959566667
  Testing...
|S| = 20
|T| = 283
Reject!
1523.06 < 1588.44
  -> Decision False in time 0.0000000000, query time of that 0.0015388730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1583.57 < 1621.18
  -> Decision False in time 0.0000000000, query time of that 0.0013343080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2124.85 < 2196.01
  -> Decision False in time 0.0000000000, query time of that 0.0009447280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2130.89 < 2140.89
  -> Decision False in time 0.0000000000, query time of that 0.0009645840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1908.05 < 2236.29
  -> Decision False in time 0.0100000000, query time of that 0.0009341570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1751.35 < 1843.93
  -> Decision False in time 0.0000000000, query time of that 0.0008988950, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1221.25 < 1240.21
  -> Decision False in time 0.0000000000, query time of that 0.0009058010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1165.29 < 1283.68
  -> Decision False in time 0.0000000000, query time of that 0.0009242340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1761.62 < 1860.04
  -> Decision False in time 0.0000000000, query time of that 0.0008684120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 128.6800000000003
Index size:  182876.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0038266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056306450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0455017980, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4520091760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0050174860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1596.81 < 1669.14
  -> Decision False in time 0.0200000000, query time of that 0.0105023540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2221.22 < 2259.09
  -> Decision False in time 0.1500000000, query time of that 0.0939822450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052952750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1258.7 < 1274.83
  -> Decision False in time 0.5400000000, query time of that 0.0350964180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
892.205 < 921.87
  -> Decision False in time 0.6200000000, query time of that 0.0403776680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 108.93000000000029
Index size:  182828.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0031616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075174920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0634353260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1390.43 < 1432.52
  -> Decision False in time 0.0600000000, query time of that 0.0542176460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0073817300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1877.06 < 1974.91
  -> Decision False in time 0.0800000000, query time of that 0.0704456500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1920 < 1973.91
  -> Decision False in time 0.1300000000, query time of that 0.1097636520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0074425100, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1262.71 < 1399.93
  -> Decision False in time 0.2700000000, query time of that 0.0256801770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1813.78 < 2034.23
  -> Decision False in time 1.5700000000, query time of that 0.1404364860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 78.71999999999935
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1166600000
  Testing...
|S| = 20
|T| = 283
Reject!
2355.81 < 2451.68
  -> Decision False in time 0.0000000000, query time of that 0.0028507980, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1908.77 < 2158.09
  -> Decision False in time 0.0100000000, query time of that 0.0022169140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1071.21 < 1105.14
  -> Decision False in time 0.0000000000, query time of that 0.0061779870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0021159030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1869.1 < 1904.05
  -> Decision False in time 0.0100000000, query time of that 0.0025172850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1765.24 < 1806.74
  -> Decision False in time 0.0000000000, query time of that 0.0024924680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
796.968 < 815.762
  -> Decision False in time 0.0100000000, query time of that 0.0024195980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
766.422 < 772.959
  -> Decision False in time 0.0000000000, query time of that 0.0022184850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1978.47 < 2386.38
  -> Decision False in time 0.0000000000, query time of that 0.0020776900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 108.60999999999876
Index size:  188532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1563233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0024371680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
968.576 < 988.901
  -> Decision False in time 0.0200000000, query time of that 0.0091436940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
884.957 < 910.847
  -> Decision False in time 0.0000000000, query time of that 0.0050160300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1521.66 < 1571.07
  -> Decision False in time 0.0000000000, query time of that 0.0017120510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1779.43 < 1829.64
  -> Decision False in time 0.0100000000, query time of that 0.0017552540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1630.98 < 1636.28
  -> Decision False in time 0.0000000000, query time of that 0.0018781270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1150.52 < 1185.15
  -> Decision False in time 0.0000000000, query time of that 0.0019678380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1058.76 < 1086.29
  -> Decision False in time 0.0100000000, query time of that 0.0019259530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1064.25 < 1078.61
  -> Decision False in time 0.0000000000, query time of that 0.0020213730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 301.02000000000044
Index size:  259684.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0179967680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1530663490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5500000000, query time of that 1.5030904160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0146064320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1699019330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.8600000000, query time of that 1.6919701310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0168082880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1787559900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2600000000, query time of that 1.8232569120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 78.5
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3734883333
  Testing...
|S| = 20
|T| = 283
Reject!
1849.64 < 1911.43
  -> Decision False in time 0.0000000000, query time of that 0.0017322740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1135.83 < 1302.73
  -> Decision False in time 0.0100000000, query time of that 0.0019701490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1997.25 < 2486.59
  -> Decision False in time 0.0000000000, query time of that 0.0012143360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1806.97 < 1841.78
  -> Decision False in time 0.0100000000, query time of that 0.0012172430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1859.93 < 2094.83
  -> Decision False in time 0.0000000000, query time of that 0.0012189010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1266.03 < 1266.76
  -> Decision False in time 0.0100000000, query time of that 0.0011457260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
986.637 < 995.468
  -> Decision False in time 0.0000000000, query time of that 0.0011816290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1380.23 < 1417.42
  -> Decision False in time 0.0100000000, query time of that 0.0012071830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1739.6 < 1816.04
  -> Decision False in time 0.0000000000, query time of that 0.0011736870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 128.90999999999985
Index size:  140676.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2554050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023632450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
765.794 < 856.315
  -> Decision False in time 0.0200000000, query time of that 0.0099833040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
930.818 < 944.911
  -> Decision False in time 0.0000000000, query time of that 0.0044403770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
847.696 < 866.29
  -> Decision False in time 0.0100000000, query time of that 0.0016147560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1736.46 < 1774.62
  -> Decision False in time 0.0000000000, query time of that 0.0016163540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1244.09 < 1273.59
  -> Decision False in time 0.0000000000, query time of that 0.0015898040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1798.87 < 1838.6
  -> Decision False in time 0.0000000000, query time of that 0.0016657430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1152.79 < 1213.45
  -> Decision False in time 0.0100000000, query time of that 0.0016222470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1600.01 < 1636.07
  -> Decision False in time 0.0000000000, query time of that 0.0016678920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 108.65999999999985
Index size:  177716.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0148400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0044779420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1841.68 < 2207.29
  -> Decision False in time 0.0300000000, query time of that 0.0229176430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1713.11 < 1723.52
  -> Decision False in time 0.0100000000, query time of that 0.0106173910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033027800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1590.93 < 1619.96
  -> Decision False in time 0.0300000000, query time of that 0.0167074530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
856.851 < 857.304
  -> Decision False in time 0.0600000000, query time of that 0.0307334360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1092.43 < 1097.38
  -> Decision False in time 0.0100000000, query time of that 0.0037109210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1621.03 < 1624.37
  -> Decision False in time 0.5100000000, query time of that 0.0251226740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
933.851 < 966.162
  -> Decision False in time 0.2500000000, query time of that 0.0135464350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 108.51000000000022
Index size:  188556.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0106728510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0943633610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.9225352410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0108736510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1083480170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.0798274040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1535.08 < 1695.89
  -> Decision False in time 0.0800000000, query time of that 0.0122844340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1126872750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1692.34 < 1769.91
  -> Decision False in time 2.0900000000, query time of that 0.2758197320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 128.0699999999997
Index size:  191740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0138816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0040462190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2020.08 < 2021.9
  -> Decision False in time 0.0200000000, query time of that 0.0189670350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1678.74 < 2123.01
  -> Decision False in time 0.0800000000, query time of that 0.0689008140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033059210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1068.16 < 1149.46
  -> Decision False in time 0.0200000000, query time of that 0.0080489590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1999.35 < 2008.43
  -> Decision False in time 0.0400000000, query time of that 0.0204401070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1251.83 < 1260.03
  -> Decision False in time 0.0200000000, query time of that 0.0037562480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1623.62 < 1625.66
  -> Decision False in time 0.0700000000, query time of that 0.0038551230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1283.39 < 1323.55
  -> Decision False in time 0.1000000000, query time of that 0.0076553100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 128.23999999999978
Index size:  191120.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0066078790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0529332250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1998.16 < 2038.19
  -> Decision False in time 0.1800000000, query time of that 0.1749704820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0056429180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0603334880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1175.64 < 1179.11
  -> Decision False in time 0.7500000000, query time of that 0.5380682100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0058570700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1617.28 < 1636.88
  -> Decision False in time 0.4600000000, query time of that 0.0363211110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1295.62 < 1298.83
  -> Decision False in time 0.0500000000, query time of that 0.0062406460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 300.2399999999998
Index size:  257936.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065511240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0537493520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5233016670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0060284930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0606632760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.5958230200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0063782920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1820.39 < 1874.47
  -> Decision False in time 0.4900000000, query time of that 0.0396656720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1360.32 < 1387.63
  -> Decision False in time 0.0900000000, query time of that 0.0086640100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 293.2999999999993
Index size:  194208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0252716667
  Testing...
|S| = 20
|T| = 283
Reject!
734.174 < 757.683
  -> Decision False in time 0.0000000000, query time of that 0.0034242810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0248692060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1060.9 < 1062.69
  -> Decision False in time 0.0700000000, query time of that 0.0587714070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025813930, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1119.11 < 1143.13
  -> Decision False in time 0.0100000000, query time of that 0.0058333940, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1509.26 < 1537.41
  -> Decision False in time 0.0000000000, query time of that 0.0028822470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1221.99 < 1222.7
  -> Decision False in time 0.0100000000, query time of that 0.0028846370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1758.14 < 1790.55
  -> Decision False in time 0.0100000000, query time of that 0.0031335440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
651.425 < 654.985
  -> Decision False in time 0.0100000000, query time of that 0.0030570250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 109.10000000000036
Index size:  200908.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0070650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056233190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0434529430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2315.15 < 2847.09
  -> Decision False in time 0.0700000000, query time of that 0.0675477000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046321080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0498264730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1284.38 < 1315.99
  -> Decision False in time 0.3100000000, query time of that 0.1956916280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2218.79 < 2221.74
  -> Decision False in time 0.0100000000, query time of that 0.0050626480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1700.93 < 1728.02
  -> Decision False in time 0.5300000000, query time of that 0.0322345690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1852.37 < 1859.36
  -> Decision False in time 0.9800000000, query time of that 0.0620931410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 293.6999999999989
Index size:  241252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0060500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044062320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0330520310, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1646.2 < 1658.75
  -> Decision False in time 0.3100000000, query time of that 0.2784007400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034753790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0384703830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1212.29 < 1214.11
  -> Decision False in time 0.2000000000, query time of that 0.0994167290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0037284810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1208.32 < 1233.51
  -> Decision False in time 0.1000000000, query time of that 0.0077905190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2105.89 < 2128.38
  -> Decision False in time 0.1900000000, query time of that 0.0119475890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 130.3099999999995
Index size:  203556.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4910316667
  Testing...
|S| = 20
|T| = 283
Reject!
1298.72 < 1375.65
  -> Decision False in time 0.0000000000, query time of that 0.0021408950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1357.9 < 1877.87
  -> Decision False in time 0.0100000000, query time of that 0.0032242670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1341.88 < 1420.73
  -> Decision False in time 0.0000000000, query time of that 0.0012851410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1067.68 < 1191.3
  -> Decision False in time 0.0000000000, query time of that 0.0013156680, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1376.61 < 1788.12
  -> Decision False in time 0.0000000000, query time of that 0.0014331040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1392.22 < 1454.02
  -> Decision False in time 0.0000000000, query time of that 0.0014501740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
939.972 < 990.628
  -> Decision False in time 0.0100000000, query time of that 0.0014451560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1737.62 < 1775.57
  -> Decision False in time 0.0000000000, query time of that 0.0013722870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1329.38 < 1396.16
  -> Decision False in time 0.0000000000, query time of that 0.0016138600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 295.0700000000015
Index size:  224824.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0071257350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0595019460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6200000000, query time of that 0.5798722430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065635620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0678374820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1681.97 < 1689.71
  -> Decision False in time 0.2500000000, query time of that 0.1986583250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0069302500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0662827490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1432.83 < 1440.46
  -> Decision False in time 0.5200000000, query time of that 0.0432091580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 108.68999999999869
Index size:  201180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0277366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038400450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0259775630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1546.34 < 1556.47
  -> Decision False in time 0.0100000000, query time of that 0.0103171310, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029478440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1251.91 < 1281.02
  -> Decision False in time 0.0300000000, query time of that 0.0124206520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1014.95 < 1031.77
  -> Decision False in time 0.0600000000, query time of that 0.0273041120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1208.72 < 1255.34
  -> Decision False in time 0.0400000000, query time of that 0.0029359680, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1193.26 < 1214.68
  -> Decision False in time 0.0100000000, query time of that 0.0032791210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2483.67 < 2487.08
  -> Decision False in time 0.0100000000, query time of that 0.0032453070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 128.6899999999987
Index size:  190968.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0112523290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0912762800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9110805060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0097720120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1051134610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1667.99 < 1773.05
  -> Decision False in time 0.0300000000, query time of that 0.0246053600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0102968090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
643.068 < 647.823
  -> Decision False in time 0.7400000000, query time of that 0.0960745300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1432.21 < 1448.57
  -> Decision False in time 1.0200000000, query time of that 0.1276620240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 299.22999999999956
Index size:  252660.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0133658330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1228340380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2300000000, query time of that 1.1831781800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0140404120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1345851730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.3683949930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0139481580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1344563210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1922.46 < 1933.54
  -> Decision False in time 7.7000000000, query time of that 1.2765979020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 293.65999999999985
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053057870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0399538210, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1154.38 < 1173.67
  -> Decision False in time 0.1600000000, query time of that 0.1442794130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041973840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2150.99 < 2167.49
  -> Decision False in time 0.0200000000, query time of that 0.0092116190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1232.01 < 1236.71
  -> Decision False in time 0.1400000000, query time of that 0.0852189410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046717340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1430.21 < 1436.57
  -> Decision False in time 0.0600000000, query time of that 0.0048968990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1229.28 < 1243.01
  -> Decision False in time 0.7100000000, query time of that 0.0399961580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 78.38999999999942
Index size:  196864.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0233050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056281720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0432329470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1759.35 < 1875.73
  -> Decision False in time 0.0500000000, query time of that 0.0403402150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1081.36 < 1209.01
  -> Decision False in time 0.0000000000, query time of that 0.0047556660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1960.66 < 2032.87
  -> Decision False in time 0.0300000000, query time of that 0.0195448820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1328.93 < 1348.52
  -> Decision False in time 0.0300000000, query time of that 0.0203552330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1419.59 < 1469.41
  -> Decision False in time 0.0800000000, query time of that 0.0052845510, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1940.85 < 2003.09
  -> Decision False in time 0.1700000000, query time of that 0.0126855670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2221.22 < 2261.3
  -> Decision False in time 0.0100000000, query time of that 0.0052460450, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 292.85000000000036
Index size:  236396.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0152355580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1443052940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4500000000, query time of that 1.4046607710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0157038910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1602441520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7400000000, query time of that 1.6078669830, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0180424300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1653482780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6300000000, query time of that 1.7075548030, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 109.53999999999905
Index size:  201532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0028600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079804660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0716491230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7900000000, query time of that 0.7492817200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080902320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0880837450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.8662796630, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0087633970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1773.19 < 1787.22
  -> Decision False in time 0.2900000000, query time of that 0.0348277870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1305.65 < 1313.37
  -> Decision False in time 1.5000000000, query time of that 0.1541088720, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 129.23000000000138
Index size:  188452.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0411766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032473110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1440.9 < 1445.17
  -> Decision False in time 0.0200000000, query time of that 0.0151249850, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1028.34 < 1045.92
  -> Decision False in time 0.0300000000, query time of that 0.0258492820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0023992340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1017.46 < 1073.9
  -> Decision False in time 0.0100000000, query time of that 0.0028294610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1181.83 < 1194.38
  -> Decision False in time 0.0000000000, query time of that 0.0027628930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1279.41 < 1314.99
  -> Decision False in time 0.0200000000, query time of that 0.0026080390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1363.8 < 1366.46
  -> Decision False in time 0.0000000000, query time of that 0.0028784700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1753.82 < 1765.01
  -> Decision False in time 0.0100000000, query time of that 0.0028105790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 292.85000000000036
Index size:  237540.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0123120090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0978137630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.9695918990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115850730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1122296910, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1366869430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0127842370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1107700720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1728.8 < 1782.48
  -> Decision False in time 3.9400000000, query time of that 0.5315115500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 292.52000000000044
Index size:  241884.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0186938130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1940024570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.8557187990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0191478320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2056327410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2700000000, query time of that 2.1013378540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0228708810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.2289319710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9500000000, query time of that 2.4942206240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 77.73000000000138
Index size:  194524.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0190200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0062940340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0532708840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2085.05 < 2470.31
  -> Decision False in time 0.0300000000, query time of that 0.0263421360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0060767920, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
973.526 < 1000.91
  -> Decision False in time 0.0200000000, query time of that 0.0194045760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1815.42 < 1848.76
  -> Decision False in time 0.1300000000, query time of that 0.0996900220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2097.84 < 2207.52
  -> Decision False in time 0.0100000000, query time of that 0.0062637250, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1150.23 < 1172.18
  -> Decision False in time 0.0200000000, query time of that 0.0060753760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1489.29 < 1497.73
  -> Decision False in time 0.2000000000, query time of that 0.0191074850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 300.09000000000015
Index size:  247860.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0143771650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1276047140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.2508778910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0133079860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1460687780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5800000000, query time of that 1.4544616050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0149640540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.1474157240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.4700000000, query time of that 1.5319638240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 299.78000000000065
Index size:  202444.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108297990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1017091720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0600000000, query time of that 1.0127218180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0113766670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1156352830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.1777196530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0121376500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1173534410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9000000000, query time of that 1.1592749460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 127.89999999999964
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0224750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0036124660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0266306360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2227.24 < 2602.59
  -> Decision False in time 0.0100000000, query time of that 0.0101713670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028974300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0324676650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2397.22 < 2411.4
  -> Decision False in time 0.0300000000, query time of that 0.0098666340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1351.16 < 1403.83
  -> Decision False in time 0.0100000000, query time of that 0.0033430560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1949.97 < 2046.71
  -> Decision False in time 0.0500000000, query time of that 0.0033977270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
709.647 < 732.829
  -> Decision False in time 0.0000000000, query time of that 0.0034011640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.21000000000095
Index size:  176504.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0315600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049029000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2520.56 < 2641.33
  -> Decision False in time 0.0300000000, query time of that 0.0270902630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1159.8 < 1168.46
  -> Decision False in time 0.0500000000, query time of that 0.0486961820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041629270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1291.72 < 1448.03
  -> Decision False in time 0.0400000000, query time of that 0.0234409230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1349.6 < 1418.26
  -> Decision False in time 0.0100000000, query time of that 0.0045049680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
846.81 < 851.179
  -> Decision False in time 0.0100000000, query time of that 0.0044010960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2246.84 < 2380.95
  -> Decision False in time 0.0100000000, query time of that 0.0044256330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1193.98 < 1206.8
  -> Decision False in time 0.0800000000, query time of that 0.0043002060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 107.76999999999862
Index size:  179700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5963433333
  Testing...
|S| = 20
|T| = 283
Reject!
1749.02 < 1788.06
  -> Decision False in time 0.0000000000, query time of that 0.0020956310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1840.44 < 1842.96
  -> Decision False in time 0.0000000000, query time of that 0.0016285450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1738.1 < 1746.05
  -> Decision False in time 0.0100000000, query time of that 0.0068480360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1800.74 < 1826.82
  -> Decision False in time 0.0000000000, query time of that 0.0012255120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1821.56 < 1867.09
  -> Decision False in time 0.0100000000, query time of that 0.0013201070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1582.94 < 1671.99
  -> Decision False in time 0.0000000000, query time of that 0.0011936970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1376.51 < 1480.75
  -> Decision False in time 0.0000000000, query time of that 0.0013676600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1317.4 < 1376.8
  -> Decision False in time 0.0000000000, query time of that 0.0012954050, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1822.94 < 1870.73
  -> Decision False in time 0.0100000000, query time of that 0.0013284770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 300.25
Index size:  257368.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0104778470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0912169290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.8940495090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112594290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1047550240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3300000000, query time of that 1.0701634670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0113763330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1010031300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1824.18 < 1852.95
  -> Decision False in time 5.2200000000, query time of that 0.6315747420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 127.93999999999869
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082710710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0697022160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7300000000, query time of that 0.6904113690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077996140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0802176270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.8026265840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0083339940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0791564270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1588.91 < 1599.04
  -> Decision False in time 1.9100000000, query time of that 0.1858493100, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 293.1499999999978
Index size:  215860.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000883333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0114364020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1080738700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0800000000, query time of that 1.0352114970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115167360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1205438180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.1990322110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0120032890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1191829030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6700000000, query time of that 1.1949229530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.55999999999767
Index size:  196344.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2174300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0023242730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2124.67 < 2368
  -> Decision False in time 0.0100000000, query time of that 0.0049168000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
938.011 < 956.802
  -> Decision False in time 0.0100000000, query time of that 0.0021048100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1218.81 < 1233.43
  -> Decision False in time 0.0100000000, query time of that 0.0013116080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1760.9 < 1838.88
  -> Decision False in time 0.0100000000, query time of that 0.0029188480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1892.86 < 2015.5
  -> Decision False in time 0.0000000000, query time of that 0.0015658650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2675.66 < 2707.62
  -> Decision False in time 0.0100000000, query time of that 0.0015627800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2243.99 < 2382.87
  -> Decision False in time 0.0000000000, query time of that 0.0014633240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1544.94 < 1650.88
  -> Decision False in time 0.0100000000, query time of that 0.0014659950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 300.60999999999694
Index size:  253016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0083781580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0687871780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6639672730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0074295100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0766976950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1923.84 < 1932.82
  -> Decision False in time 0.8500000000, query time of that 0.7493361540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0079078610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1625.61 < 1627.94
  -> Decision False in time 0.6500000000, query time of that 0.0660055970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1580.82 < 1584.3
  -> Decision False in time 3.2800000000, query time of that 0.2942076140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 291.6999999999971
Index size:  194216.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1084033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0029296590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1591.67 < 1741.45
  -> Decision False in time 0.0200000000, query time of that 0.0113657330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
987.18 < 1009.11
  -> Decision False in time 0.0200000000, query time of that 0.0183835220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020602610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1295.39 < 1325.31
  -> Decision False in time 0.0000000000, query time of that 0.0026639070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1147.35 < 1240.4
  -> Decision False in time 0.0000000000, query time of that 0.0022608280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
626.89 < 674.541
  -> Decision False in time 0.0100000000, query time of that 0.0023046490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1551.54 < 1558.19
  -> Decision False in time 0.0100000000, query time of that 0.0022844350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2088.1 < 2187.94
  -> Decision False in time 0.0000000000, query time of that 0.0024754230, with c1=5.0000000000, c2=0.1000000000
