copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 119.22
Index size:  400476.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5611583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0023386590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1906.85 < 2151.6
  -> Decision False in time 0.0000000000, query time of that 0.0023024380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1529.5 < 1756.43
  -> Decision False in time 0.0100000000, query time of that 0.0007914040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
993.11 < 1181.02
  -> Decision False in time 0.0000000000, query time of that 0.0008480770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1726.09 < 1811.61
  -> Decision False in time 0.0100000000, query time of that 0.0012546290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1642.07 < 1698.89
  -> Decision False in time 0.0100000000, query time of that 0.0012668010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1871.8 < 2058.71
  -> Decision False in time 0.0000000000, query time of that 0.0007611540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1166.97 < 1189.92
  -> Decision False in time 0.0100000000, query time of that 0.0007454470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1869.79 < 2020.57
  -> Decision False in time 0.0100000000, query time of that 0.0010770400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 136.92999999999998
Index size:  212016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0087083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043695900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0358671770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1204.06 < 1221.46
  -> Decision False in time 0.2800000000, query time of that 0.2549740980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0038530600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1618.1 < 1622.03
  -> Decision False in time 0.0200000000, query time of that 0.0111825840, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1436.92 < 1452.55
  -> Decision False in time 0.1400000000, query time of that 0.0744229410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0039861920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1496.49 < 1604.15
  -> Decision False in time 0.0600000000, query time of that 0.0043111880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1642.82 < 1695.6
  -> Decision False in time 0.1000000000, query time of that 0.0083752290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 72.88999999999999
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0154283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067306950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0580164570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1668.84 < 1679.56
  -> Decision False in time 0.1800000000, query time of that 0.1652288810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061849290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1296.93 < 1984.11
  -> Decision False in time 0.0100000000, query time of that 0.0066070720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1695.55 < 1735.44
  -> Decision False in time 0.0800000000, query time of that 0.0692971140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0068246140, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1398.32 < 1437.2
  -> Decision False in time 0.1500000000, query time of that 0.0140578990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1461.13 < 1672.98
  -> Decision False in time 0.0100000000, query time of that 0.0068607020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 136.69999999999993
Index size:  191344.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0265333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035100880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1682.18 < 1756.59
  -> Decision False in time 0.0100000000, query time of that 0.0147162920, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2105.73 < 2119.19
  -> Decision False in time 0.0700000000, query time of that 0.0590433760, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1832.17 < 1999.32
  -> Decision False in time 0.0100000000, query time of that 0.0028094520, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1491.51 < 1515.81
  -> Decision False in time 0.0700000000, query time of that 0.0295713320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1809.15 < 1843.02
  -> Decision False in time 0.0300000000, query time of that 0.0123481340, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1368.8 < 1403.85
  -> Decision False in time 0.0100000000, query time of that 0.0031210090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1622.82 < 1653.77
  -> Decision False in time 0.0400000000, query time of that 0.0029971490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1875.19 < 1886.52
  -> Decision False in time 0.0300000000, query time of that 0.0032235920, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 104.39999999999998
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2960100000
  Testing...
|S| = 20
|T| = 283
Reject!
1582.4 < 1674.74
  -> Decision False in time 0.0100000000, query time of that 0.0024795990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2043.92 < 2220.26
  -> Decision False in time 0.0000000000, query time of that 0.0029710880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1231.43 < 1239.67
  -> Decision False in time 0.0100000000, query time of that 0.0050459710, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1716.92 < 1727.03
  -> Decision False in time 0.0000000000, query time of that 0.0015879900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1509.88 < 1539.95
  -> Decision False in time 0.0000000000, query time of that 0.0016402830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1526.09 < 1528.56
  -> Decision False in time 0.0000000000, query time of that 0.0017163190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2102.12 < 2190.14
  -> Decision False in time 0.0100000000, query time of that 0.0017094380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1863.83 < 1915.07
  -> Decision False in time 0.0000000000, query time of that 0.0016845410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2467.49 < 2529.73
  -> Decision False in time 0.0000000000, query time of that 0.0016581650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 356.42999999999995
Index size:  258652.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0510314860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4600000000, query time of that 0.4523440930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.5700000000, query time of that 4.5002248240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0418273400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4900000000, query time of that 0.4817913950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.9900000000, query time of that 4.8494481530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0551570700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0900000000, query time of that 0.5308983900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.7100000000, query time of that 5.4017985500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 337.0
Index size:  198180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0148747390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1294490970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.2414208970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0138209810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1408177290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6000000000, query time of that 1.4140926420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0152097180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1445405230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7500000000, query time of that 1.4278436150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 72.72999999999979
Index size:  195600.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8002483333
  Testing...
|S| = 20
|T| = 283
Reject!
1652.9 < 1867.52
  -> Decision False in time 0.0000000000, query time of that 0.0016305870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1243.34 < 1504.7
  -> Decision False in time 0.0100000000, query time of that 0.0014222820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2447.95 < 2506.87
  -> Decision False in time 0.0000000000, query time of that 0.0010129180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1937.1 < 2169.47
  -> Decision False in time 0.0100000000, query time of that 0.0009940780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2132.18 < 2214.16
  -> Decision False in time 0.0000000000, query time of that 0.0010421590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1467.7 < 1528.86
  -> Decision False in time 0.0100000000, query time of that 0.0010683210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2461.43 < 2488.01
  -> Decision False in time 0.0000000000, query time of that 0.0010310220, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1187.41 < 1392.29
  -> Decision False in time 0.0000000000, query time of that 0.0009929900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1771.44 < 1809.58
  -> Decision False in time 0.0100000000, query time of that 0.0010446170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 355.1800000000003
Index size:  246424.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0172549380, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1770941810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7700000000, query time of that 1.7112769160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0194040700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1953088420, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2200000000, query time of that 2.0274340510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0241611470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.2210380370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5600000000, query time of that 2.4316370200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 103.76999999999998
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0098751820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0970991100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0500000000, query time of that 1.0032794790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0123861950, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1195844520, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4000000000, query time of that 1.1737381560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0137134890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1822.19 < 1859.01
  -> Decision False in time 0.4900000000, query time of that 0.0749575960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1281.38 < 1519.93
  -> Decision False in time 1.0700000000, query time of that 0.1500547220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 104.46000000000004
Index size:  177016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0188716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037917400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2039.13 < 2114.95
  -> Decision False in time 0.0200000000, query time of that 0.0161618100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1744.43 < 2096.13
  -> Decision False in time 0.2300000000, query time of that 0.2031592330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030206110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1493.2 < 1676.65
  -> Decision False in time 0.0000000000, query time of that 0.0034132050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1376.82 < 1404.1
  -> Decision False in time 0.0300000000, query time of that 0.0135471040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0033197560, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1790.23 < 1801.55
  -> Decision False in time 0.0700000000, query time of that 0.0036542410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1026.88 < 1043.42
  -> Decision False in time 0.0700000000, query time of that 0.0034513910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 338.23
Index size:  246488.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0180312030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1576468160, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6500000000, query time of that 1.5966116940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0177655700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1859415240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9700000000, query time of that 1.8406663930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0200335830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.2069015890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1300000000, query time of that 1.9981017600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 338.96000000000004
Index size:  252096.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001700000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0083860460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0677983370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7200000000, query time of that 0.6727809940, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076925210, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0774117740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.7675298560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0084509590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0747218370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1649.54 < 1688.88
  -> Decision False in time 2.5600000000, query time of that 0.2346075140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 104.47999999999956
Index size:  198804.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0091467760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0851164340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.8228388220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0096031750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0970838680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1700000000, query time of that 0.9561357720, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0100202320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1917.94 < 1932.49
  -> Decision False in time 0.5300000000, query time of that 0.0613233240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1282.15 < 1350.31
  -> Decision False in time 0.5800000000, query time of that 0.0714760730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 137.02999999999975
Index size:  187792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0114544900, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1043724770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0900000000, query time of that 1.0295555980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112627770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1209935290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.1816583550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0122681280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1199756130, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1607.41 < 1611.8
  -> Decision False in time 2.1800000000, query time of that 0.3078768900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 136.98999999999978
Index size:  190980.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084948570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0724821710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7600000000, query time of that 0.7098201130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077313220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0813363990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1463.81 < 1470.06
  -> Decision False in time 0.6300000000, query time of that 0.5857712190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0080754080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
370.05 < 377.841
  -> Decision False in time 0.5200000000, query time of that 0.0550675450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1302.73 < 1307.47
  -> Decision False in time 0.2600000000, query time of that 0.0288191130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 137.21000000000004
Index size:  185300.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2085066667
  Testing...
|S| = 20
|T| = 283
Reject!
1283.7 < 1342.6
  -> Decision False in time 0.0000000000, query time of that 0.0030025300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1510.77 < 1592.09
  -> Decision False in time 0.0000000000, query time of that 0.0033434380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1520.03 < 1531.91
  -> Decision False in time 0.0100000000, query time of that 0.0030140420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
956.572 < 958.901
  -> Decision False in time 0.0000000000, query time of that 0.0017953170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1624.47 < 1910.18
  -> Decision False in time 0.0000000000, query time of that 0.0018010230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1449.05 < 1476.88
  -> Decision False in time 0.0100000000, query time of that 0.0018341220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1458.64 < 1495.02
  -> Decision False in time 0.0000000000, query time of that 0.0018955600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1159.26 < 1222.87
  -> Decision False in time 0.0100000000, query time of that 0.0020238980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1441.59 < 1465.17
  -> Decision False in time 0.0000000000, query time of that 0.0020395360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 104.9399999999996
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079104110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0674398300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7200000000, query time of that 0.6693419170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0077100700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1273.76 < 1307.64
  -> Decision False in time 0.0700000000, query time of that 0.0584956900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1208.72 < 1226.43
  -> Decision False in time 0.1700000000, query time of that 0.1603066310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0076869570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0756121660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
841.932 < 1045.18
  -> Decision False in time 0.1500000000, query time of that 0.0157050770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 73.88999999999942
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1515283333
  Testing...
|S| = 20
|T| = 283
Reject!
2175.12 < 2349.57
  -> Decision False in time 0.0000000000, query time of that 0.0034988580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1706.56 < 1768.62
  -> Decision False in time 0.0100000000, query time of that 0.0053584630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2307.25 < 2379.68
  -> Decision False in time 0.0000000000, query time of that 0.0039457930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2536.49 < 2635.11
  -> Decision False in time 0.0100000000, query time of that 0.0025447410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2547.16 < 2646.78
  -> Decision False in time 0.0000000000, query time of that 0.0024211350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1164.62 < 1171.42
  -> Decision False in time 0.0000000000, query time of that 0.0023544260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2153.91 < 2209.12
  -> Decision False in time 0.0100000000, query time of that 0.0025050980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1042.63 < 1628.56
  -> Decision False in time 0.0000000000, query time of that 0.0024492230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2439.59 < 2457.5
  -> Decision False in time 0.0000000000, query time of that 0.0025718870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 356.84000000000015
Index size:  258432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0126035720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1104020190, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1100000000, query time of that 1.0735800000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0115575550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1236140440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.2277627880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0125426130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1254877490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6500000000, query time of that 1.2045573280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 355.8299999999999
Index size:  209076.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0146452810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1192431880, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.1997818080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0127238180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1389447970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5100000000, query time of that 1.3688718750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0140755160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8700000000, query time of that 0.1471500830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.5000000000, query time of that 1.4111070810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 73.71999999999935
Index size:  188656.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0367700000
  Testing...
|S| = 20
|T| = 283
Reject!
2325.53 < 2334.02
  -> Decision False in time 0.0100000000, query time of that 0.0055375680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2147.64 < 2261.7
  -> Decision False in time 0.0100000000, query time of that 0.0064662780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1979.32 < 1996.89
  -> Decision False in time 0.0700000000, query time of that 0.0686000630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0044760170, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1603.59 < 1645.36
  -> Decision False in time 0.0500000000, query time of that 0.0274672610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1705.16 < 2095.99
  -> Decision False in time 0.0100000000, query time of that 0.0097197320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2129.58 < 2144.11
  -> Decision False in time 0.0100000000, query time of that 0.0049768660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1697.88 < 1700.7
  -> Decision False in time 0.1000000000, query time of that 0.0100697380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2018.4 < 2095.41
  -> Decision False in time 0.0900000000, query time of that 0.0109943320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 73.30000000000018
Index size:  130332.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.6110750000
  Testing...
|S| = 20
|T| = 283
Reject!
1535.72 < 1540.65
  -> Decision False in time 0.0000000000, query time of that 0.0020287120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2198.91 < 2438.18
  -> Decision False in time 0.0100000000, query time of that 0.0016929700, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1447.7 < 1451.05
  -> Decision False in time 0.0000000000, query time of that 0.0016100860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1639.99 < 1645.56
  -> Decision False in time 0.0000000000, query time of that 0.0013681000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2172.75 < 2270.91
  -> Decision False in time 0.0000000000, query time of that 0.0012685770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2300.74 < 2404.29
  -> Decision False in time 0.0000000000, query time of that 0.0012039330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1997.58 < 2045.55
  -> Decision False in time 0.0100000000, query time of that 0.0012146550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2102.06 < 2200.3
  -> Decision False in time 0.0000000000, query time of that 0.0012562760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1426.52 < 1852.68
  -> Decision False in time 0.0000000000, query time of that 0.0012359420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 357.0699999999997
Index size:  264968.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0177695070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1628314240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6900000000, query time of that 1.6403984560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0176514530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1875629790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9800000000, query time of that 1.8485149260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0207898050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.2007990700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3600000000, query time of that 2.1849163010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 355.59999999999945
Index size:  202644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0208307470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.2069496520, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.2100000000, query time of that 2.1560943110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0253326470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2589647070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5800000000, query time of that 2.4500181490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0306456640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.3016799820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.0200000000, query time of that 3.0923723880, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 73.14999999999964
Index size:  191272.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2596900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026575500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1922.93 < 1926.55
  -> Decision False in time 0.0000000000, query time of that 0.0029034740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2159.25 < 2295.74
  -> Decision False in time 0.0100000000, query time of that 0.0038166470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2199.45 < 2231.78
  -> Decision False in time 0.0100000000, query time of that 0.0018347320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2122.53 < 2132.23
  -> Decision False in time 0.0100000000, query time of that 0.0042267020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1876.98 < 1893.65
  -> Decision False in time 0.0000000000, query time of that 0.0018366080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1617.52 < 1916.9
  -> Decision False in time 0.0100000000, query time of that 0.0018321960, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2048.85 < 2078.1
  -> Decision False in time 0.0000000000, query time of that 0.0019030750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2153.49 < 2228.69
  -> Decision False in time 0.0100000000, query time of that 0.0019501350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 339.0199999999995
Index size:  211432.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047994720, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0367596530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4100000000, query time of that 0.3643629830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0042563300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0423859770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.4226428980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046424130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1444.13 < 1446.49
  -> Decision False in time 0.1200000000, query time of that 0.0089913780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1574.97 < 1616.04
  -> Decision False in time 0.7300000000, query time of that 0.0401942150, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 355.84999999999854
Index size:  253660.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0295482160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2760016350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7600000000, query time of that 2.7040715910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0276966140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.2931053070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1000000000, query time of that 2.9770231980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0354244880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.3737453790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 8.1900000000, query time of that 3.7098649870, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 136.27000000000044
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0040450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056543280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0439977260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1516.02 < 1573.99
  -> Decision False in time 0.2000000000, query time of that 0.1764939340, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048507510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1209.24 < 1247.78
  -> Decision False in time 0.0500000000, query time of that 0.0316480720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1425.15 < 1432.72
  -> Decision False in time 0.3500000000, query time of that 0.2242369620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0049564730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1837.54 < 1851.86
  -> Decision False in time 0.8000000000, query time of that 0.0476179800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1296.58 < 1308.89
  -> Decision False in time 0.0100000000, query time of that 0.0052841950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 72.81000000000131
Index size:  167288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0464100000
  Testing...
|S| = 20
|T| = 283
Reject!
1684.92 < 2200.57
  -> Decision False in time 0.0100000000, query time of that 0.0045985610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1638.75 < 1640.96
  -> Decision False in time 0.0100000000, query time of that 0.0101356240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2160.12 < 2237.96
  -> Decision False in time 0.0100000000, query time of that 0.0082420950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037685130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1294.8 < 1640.39
  -> Decision False in time 0.0000000000, query time of that 0.0042209150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1982.04 < 2020.4
  -> Decision False in time 0.0100000000, query time of that 0.0037256970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0039356260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1959.06 < 1985.45
  -> Decision False in time 0.0000000000, query time of that 0.0042486460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
993.557 < 1107.9
  -> Decision False in time 0.0600000000, query time of that 0.0038722000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 103.93999999999869
Index size:  186536.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1212350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0026235160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1492.43 < 1624.38
  -> Decision False in time 0.0000000000, query time of that 0.0028403630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1789.48 < 1909.91
  -> Decision False in time 0.0100000000, query time of that 0.0030765820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0019812980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1045.31 < 1051.12
  -> Decision False in time 0.0000000000, query time of that 0.0022584440, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1957.05 < 2006.66
  -> Decision False in time 0.0100000000, query time of that 0.0020854500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1322.76 < 1410.21
  -> Decision False in time 0.0000000000, query time of that 0.0020566830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2379.76 < 2390.45
  -> Decision False in time 0.0100000000, query time of that 0.0022113070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1668.29 < 1723.68
  -> Decision False in time 0.0000000000, query time of that 0.0022344460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 104.27000000000044
Index size:  185736.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0022466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074275460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0576659550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6100000000, query time of that 0.5681685230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065905230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0650933870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2253.12 < 2294.56
  -> Decision False in time 0.0400000000, query time of that 0.0374526120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065849410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0650795960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1724.87 < 1755.27
  -> Decision False in time 0.6700000000, query time of that 0.0570106300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 355.619999999999
Index size:  257580.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000333333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0116493730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0955207660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.9198160320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0103127970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1066824150, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2200000000, query time of that 1.0672523020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0101490330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1106637950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1220.4 < 1220.98
  -> Decision False in time 6.5600000000, query time of that 0.8544201000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 103.84999999999854
Index size:  186040.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0040500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059609260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0461561000, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4633242820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0053986070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0553073120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1602.34 < 1605.27
  -> Decision False in time 0.0400000000, query time of that 0.0287353420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052493670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1333.02 < 1417.27
  -> Decision False in time 0.0100000000, query time of that 0.0058341200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1476.77 < 1522.6
  -> Decision False in time 0.6600000000, query time of that 0.0469614700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 355.64999999999964
Index size:  244984.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0208990350, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1935173240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9700000000, query time of that 1.9091816000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0207867660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2224204190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3400000000, query time of that 2.2096658780, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0230209980, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.2433049400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5500000000, query time of that 2.6175311080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 72.84000000000015
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4147800000
  Testing...
|S| = 20
|T| = 283
Reject!
1190.21 < 1292.61
  -> Decision False in time 0.0100000000, query time of that 0.0016708860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1953.87 < 2091.18
  -> Decision False in time 0.0000000000, query time of that 0.0021451980, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2226.61 < 2247.6
  -> Decision False in time 0.0100000000, query time of that 0.0018511890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1800.55 < 2113.13
  -> Decision False in time 0.0000000000, query time of that 0.0013282810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1566.97 < 1672.26
  -> Decision False in time 0.0100000000, query time of that 0.0012535570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1835.33 < 1895.13
  -> Decision False in time 0.0000000000, query time of that 0.0012052940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1864.39 < 1961.37
  -> Decision False in time 0.0100000000, query time of that 0.0012895060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2371.34 < 2404.36
  -> Decision False in time 0.0000000000, query time of that 0.0013076190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1667.6 < 1825.94
  -> Decision False in time 0.0100000000, query time of that 0.0013335180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 136.11000000000058
Index size:  133032.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0102772590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0846379840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7899326490, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0089260490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0915909880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2105.08 < 2158.99
  -> Decision False in time 0.0600000000, query time of that 0.0571062460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0092958990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1179.91 < 1203.35
  -> Decision False in time 0.0200000000, query time of that 0.0096941610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1420.54 < 1475.73
  -> Decision False in time 0.9700000000, query time of that 0.1084696910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 355.3199999999997
Index size:  257388.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0179357730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1505003490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5200000000, query time of that 1.4632836300, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0161849370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1637383170, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7600000000, query time of that 1.6520540540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0158870620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.1829369240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7200000000, query time of that 1.7302450610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 338.2099999999991
Index size:  206712.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0107979190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0951943690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.9400426930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0108032970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1053317560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.0872942260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0118504540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1034167970, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0800000000, query time of that 1.0696451520, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 137.07999999999993
Index size:  204456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0025216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063064730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0508034480, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.4993447780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0056370960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0581505780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1741.58 < 1759.66
  -> Decision False in time 0.1700000000, query time of that 0.1252028390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1370.94 < 1384.84
  -> Decision False in time 0.0100000000, query time of that 0.0058137260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1693.65 < 1758.5
  -> Decision False in time 0.3000000000, query time of that 0.0237072660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1170.98 < 1206.64
  -> Decision False in time 0.3200000000, query time of that 0.0235930630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 355.64999999999964
Index size:  250764.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074984530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0614463030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6500000000, query time of that 0.6090200650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065216430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0675764040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.6926362620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0075225970, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0689147880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1968.07 < 1969.4
  -> Decision False in time 0.2400000000, query time of that 0.0211219550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 136.75
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0148483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039039530, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1293.8 < 1301.33
  -> Decision False in time 0.0200000000, query time of that 0.0232191320, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1959.56 < 2202.11
  -> Decision False in time 0.0500000000, query time of that 0.0426335240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1084.46 < 1087.12
  -> Decision False in time 0.0000000000, query time of that 0.0032098840, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1439.33 < 1453.37
  -> Decision False in time 0.0100000000, query time of that 0.0032557090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1515.46 < 1533.29
  -> Decision False in time 0.0100000000, query time of that 0.0070137390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1485.85 < 1494.1
  -> Decision False in time 0.0100000000, query time of that 0.0035016530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1153.72 < 1246.35
  -> Decision False in time 0.0400000000, query time of that 0.0034281990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1377.02 < 1404.49
  -> Decision False in time 0.0500000000, query time of that 0.0037454270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 136.8700000000008
Index size:  179236.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0067235090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0587316610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6300000000, query time of that 0.5779976500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061202100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0653802670, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1892.79 < 1937.8
  -> Decision False in time 0.1500000000, query time of that 0.1209222160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0068570430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0654301030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1154.62 < 1164.1
  -> Decision False in time 0.2400000000, query time of that 0.0200919240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 337.96999999999935
Index size:  232796.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0004633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063843500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0548248280, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5800000000, query time of that 0.5321438980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057272870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0607484080, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1135.95 < 1185.14
  -> Decision False in time 0.0300000000, query time of that 0.0174721710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0061246780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0625515670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1776.12 < 1790.9
  -> Decision False in time 0.6900000000, query time of that 0.0521328980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 103.31999999999971
Index size:  200552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0088200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043236090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0338965600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1353.98 < 1366.75
  -> Decision False in time 0.1700000000, query time of that 0.1517018970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0039149310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0397017600, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1840.58 < 1847.44
  -> Decision False in time 0.0300000000, query time of that 0.0164513110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0041918690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1745.91 < 1761.56
  -> Decision False in time 0.0000000000, query time of that 0.0041600510, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1738.44 < 1742.23
  -> Decision False in time 0.0400000000, query time of that 0.0039626630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 136.27999999999884
Index size:  182456.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4525433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0022340040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1637.8 < 1642.01
  -> Decision False in time 0.0100000000, query time of that 0.0038244440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1370.69 < 1578.31
  -> Decision False in time 0.0000000000, query time of that 0.0020777850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2387.22 < 2415.94
  -> Decision False in time 0.0000000000, query time of that 0.0016921320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1693.43 < 1738.5
  -> Decision False in time 0.0100000000, query time of that 0.0017166330, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1919.27 < 1943.91
  -> Decision False in time 0.0000000000, query time of that 0.0018389810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1717.38 < 1753.84
  -> Decision False in time 0.0100000000, query time of that 0.0017274490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1135.12 < 1178.64
  -> Decision False in time 0.0000000000, query time of that 0.0015943410, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1251.95 < 1312.95
  -> Decision False in time 0.0000000000, query time of that 0.0017931760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 338.1399999999994
Index size:  247712.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0038687780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0278760080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1826.82 < 1837.05
  -> Decision False in time 0.0700000000, query time of that 0.0556713430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030615080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0332232410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1118.43 < 1159.28
  -> Decision False in time 0.0100000000, query time of that 0.0067772590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1195.27 < 1234.82
  -> Decision False in time 0.0100000000, query time of that 0.0033478480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1487.11 < 1496.91
  -> Decision False in time 0.0100000000, query time of that 0.0033902950, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1201.98 < 1258.38
  -> Decision False in time 0.0800000000, query time of that 0.0050121650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 355.7099999999991
Index size:  257372.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0234522770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2381904410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3800000000, query time of that 2.3237650050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0254275360, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2527991960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.6800000000, query time of that 2.5889560110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0300478090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.3125214100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9800000000, query time of that 3.3782312630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 104.34000000000015
Index size:  190120.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0534816667
  Testing...
|S| = 20
|T| = 283
Reject!
2051.83 < 2065.75
  -> Decision False in time 0.0100000000, query time of that 0.0028661420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1870.58 < 2328.81
  -> Decision False in time 0.0100000000, query time of that 0.0063684290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1459.81 < 1518.35
  -> Decision False in time 0.0100000000, query time of that 0.0088942500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0023167240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1544.06 < 1610.39
  -> Decision False in time 0.0100000000, query time of that 0.0024121370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1535.11 < 1608.3
  -> Decision False in time 0.0100000000, query time of that 0.0021239600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1015.69 < 1029.74
  -> Decision False in time 0.0100000000, query time of that 0.0021888850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1921.08 < 1928.2
  -> Decision False in time 0.0000000000, query time of that 0.0024654670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1560.02 < 1790.55
  -> Decision False in time 0.0900000000, query time of that 0.0047729630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 73.71000000000095
Index size:  177224.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0259616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0060718860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0484762620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1971.42 < 2250.17
  -> Decision False in time 0.0400000000, query time of that 0.0359174030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054606430, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1828.02 < 1865.58
  -> Decision False in time 0.0400000000, query time of that 0.0259541530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1686.41 < 1748.27
  -> Decision False in time 0.0100000000, query time of that 0.0117052250, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1632.73 < 1670.22
  -> Decision False in time 0.0700000000, query time of that 0.0056451670, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1795.68 < 1859.7
  -> Decision False in time 0.0100000000, query time of that 0.0058379390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2071.34 < 2157.79
  -> Decision False in time 0.0100000000, query time of that 0.0057371890, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 338.9400000000005
Index size:  250396.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0821233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032609670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0219789080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1656.73 < 1690.28
  -> Decision False in time 0.0000000000, query time of that 0.0066722190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024035130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1561.99 < 1598.5
  -> Decision False in time 0.0100000000, query time of that 0.0029302680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1517.18 < 1520.58
  -> Decision False in time 0.0200000000, query time of that 0.0107204790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1636.75 < 1668.99
  -> Decision False in time 0.0100000000, query time of that 0.0025944360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1314.8 < 1356.57
  -> Decision False in time 0.0200000000, query time of that 0.0026696600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1484.57 < 1518.34
  -> Decision False in time 0.0000000000, query time of that 0.0028047250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 339.1800000000003
Index size:  251996.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0233684960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2347379200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3500000000, query time of that 2.3025628390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0244946960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2474834740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7200000000, query time of that 2.5839795180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0275801050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.3150371890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.6800000000, query time of that 3.1777834180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 354.2800000000025
Index size:  260932.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0096666030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0827698770, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7848143110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0096598040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0922025430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1200000000, query time of that 0.9139368460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0097859070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0901274890, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9100000000, query time of that 0.8938631740, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 72.33000000000175
Index size:  187244.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0860983333
  Testing...
|S| = 20
|T| = 283
Reject!
2354.15 < 2369.85
  -> Decision False in time 0.0100000000, query time of that 0.0027723040, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1874.13 < 1879.66
  -> Decision False in time 0.0000000000, query time of that 0.0021650820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2406.89 < 2491.13
  -> Decision False in time 0.0100000000, query time of that 0.0035965220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0030049990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1687.3 < 1744.94
  -> Decision False in time 0.0000000000, query time of that 0.0026982400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1502.85 < 1728.94
  -> Decision False in time 0.0100000000, query time of that 0.0024999880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1650.39 < 1727.1
  -> Decision False in time 0.0200000000, query time of that 0.0030092800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2374.55 < 2431.27
  -> Decision False in time 0.0000000000, query time of that 0.0029839550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2039.45 < 2084.15
  -> Decision False in time 0.0100000000, query time of that 0.0023677650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 337.0499999999993
Index size:  193704.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000600000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0089820650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0809516060, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.8105107500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087262510, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0949507030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1300000000, query time of that 0.9548520960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0103573780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0901662820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7600000000, query time of that 0.8904010140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 339.1399999999994
Index size:  247556.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0125357300, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1112436660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2000000000, query time of that 1.1477738660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0131066980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1349282270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5000000000, query time of that 1.3269829550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0137825950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1323765060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9600000000, query time of that 1.3512146600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 357.59000000000015
Index size:  244724.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0145657370, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1275725690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.3420638930, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0167555610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1585171270, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7400000000, query time of that 1.5702854430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0174934900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.1651578270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1100000000, query time of that 1.6604858410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 357.4500000000007
Index size:  216928.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0365174000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3412438790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.6800000000, query time of that 3.6157912150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0421937290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4109975620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.3200000000, query time of that 4.1748157500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0543322920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.1100000000, query time of that 0.5718430980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.8800000000, query time of that 5.9620561530, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 339.0600000000013
Index size:  217384.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0392218680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3753622030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.8600000000, query time of that 3.8018710280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0426363890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4600000000, query time of that 0.4335042120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.4400000000, query time of that 4.3050316320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0529284060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0700000000, query time of that 0.5776877780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 10.6700000000, query time of that 6.1433776120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 338.47000000000116
Index size:  247676.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010350000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055969730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0433351860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4508701240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0050541130, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0521923110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1834.03 < 1896.14
  -> Decision False in time 0.5600000000, query time of that 0.3607016930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0051880420, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0527081000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1263.96 < 1353.56
  -> Decision False in time 1.4600000000, query time of that 0.0935295280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 136.5
Index size:  206480.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0769550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0032823610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2181.14 < 2239.83
  -> Decision False in time 0.0100000000, query time of that 0.0048709780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2045.21 < 2224.75
  -> Decision False in time 0.0000000000, query time of that 0.0045782620, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1772.01 < 1797.49
  -> Decision False in time 0.0100000000, query time of that 0.0020921220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1437.47 < 1446.89
  -> Decision False in time 0.0000000000, query time of that 0.0024760920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1621 < 1627.88
  -> Decision False in time 0.0200000000, query time of that 0.0063275860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1584.78 < 1597.23
  -> Decision False in time 0.0000000000, query time of that 0.0024105530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1286.08 < 1378.04
  -> Decision False in time 0.0100000000, query time of that 0.0022293200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
953.082 < 970.258
  -> Decision False in time 0.0100000000, query time of that 0.0026287980, with c1=5.0000000000, c2=0.1000000000
