copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 81.51
Index size:  395652.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.6374583333
  Testing...
|S| = 20
|T| = 283
Reject!
1799.92 < 1804.87
  -> Decision False in time 0.0100000000, query time of that 0.0027010550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1731.1 < 2178.97
  -> Decision False in time 0.0100000000, query time of that 0.0021366030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2470.63 < 2507.34
  -> Decision False in time 0.0000000000, query time of that 0.0012347690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1916.5 < 1953.63
  -> Decision False in time 0.0100000000, query time of that 0.0012614710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2019.46 < 2112.5
  -> Decision False in time 0.0000000000, query time of that 0.0012342770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1853.05 < 2042.92
  -> Decision False in time 0.0100000000, query time of that 0.0012706870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2173.91 < 2269.72
  -> Decision False in time 0.0000000000, query time of that 0.0011873810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2021.86 < 2110.56
  -> Decision False in time 0.0000000000, query time of that 0.0011280730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2032.51 < 2150.69
  -> Decision False in time 0.0100000000, query time of that 0.0011072340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 136.18
Index size:  212200.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0119682240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1032170890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0400000000, query time of that 0.9995313030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0108314850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1170575260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3200000000, query time of that 1.1662124470, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0102795710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1508.65 < 1574.4
  -> Decision False in time 0.6300000000, query time of that 0.0961470540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1735.22 < 1736.36
  -> Decision False in time 1.0200000000, query time of that 0.1444236910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 338.56000000000006
Index size:  250360.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0052435600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2050.89 < 2059.97
  -> Decision False in time 0.0400000000, query time of that 0.0328650510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4362208400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0050037370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0503740930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1338.63 < 1345.42
  -> Decision False in time 0.5900000000, query time of that 0.3844078880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0052841570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0506312900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1554.82 < 1583.24
  -> Decision False in time 1.1200000000, query time of that 0.0696432630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 136.41999999999996
Index size:  203232.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0025150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064458400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0498462090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5300000000, query time of that 0.4852418140, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0057250860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0561102020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1451.91 < 1455.95
  -> Decision False in time 0.6900000000, query time of that 0.4986956970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0057492130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
379.828 < 449.627
  -> Decision False in time 0.1300000000, query time of that 0.0116221530, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1959.79 < 1980.53
  -> Decision False in time 0.9500000000, query time of that 0.0651906640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 136.17000000000007
Index size:  184976.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0017016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0069829210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0566746090, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5579088070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0062165730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0657225010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.6453392410, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0067935840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1635.8 < 1787.56
  -> Decision False in time 0.4200000000, query time of that 0.0363431240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
492.784 < 528.629
  -> Decision False in time 2.7800000000, query time of that 0.2162961660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 103.70000000000005
Index size:  182500.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0037066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054940940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0452226930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1337.25 < 1408
  -> Decision False in time 0.2100000000, query time of that 0.1936265020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047499940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2121.19 < 2138.49
  -> Decision False in time 0.0100000000, query time of that 0.0056507470, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1614.6 < 1676.53
  -> Decision False in time 0.0600000000, query time of that 0.0410402580, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0052088050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2059.89 < 2095.01
  -> Decision False in time 0.0700000000, query time of that 0.0055453080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1453.74 < 1474.28
  -> Decision False in time 0.3400000000, query time of that 0.0240574910, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 356.35000000000014
Index size:  251460.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000666667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0090038770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0789110460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8200000000, query time of that 0.7705933150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0080895530, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0930579100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.9007009430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0089074060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0865778170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8800000000, query time of that 0.8762471690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 336.6300000000001
Index size:  195136.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000183333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0135170920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1142036830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1800000000, query time of that 1.1329037380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0137537010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1328220880, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5600000000, query time of that 1.3358988790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0135625090, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1299247740, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 1.3341207070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 338.5100000000002
Index size:  247276.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092527460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0803612390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.7956110810, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0093406760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0955334320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1000000000, query time of that 0.9142490160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0100428430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.0880488560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 0.9061543980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 357.3899999999999
Index size:  260560.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0265049390, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2505708760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.4000000000, query time of that 2.3487420420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0266954290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2492635380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7200000000, query time of that 2.5598086540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0281495550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.3053705750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 3.3078012710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 355.67999999999984
Index size:  206016.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0163442080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1447876730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4800000000, query time of that 1.4333556090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0150960470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1651419720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7700000000, query time of that 1.6359348420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0171287710, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8600000000, query time of that 0.1754014430, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6000000000, query time of that 1.7839879620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 73.09000000000015
Index size:  193072.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.7899466667
  Testing...
|S| = 20
|T| = 283
Reject!
1818.64 < 1824.2
  -> Decision False in time 0.0100000000, query time of that 0.0015432070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1984.22 < 2042.94
  -> Decision False in time 0.0000000000, query time of that 0.0010421080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1736.92 < 1960.78
  -> Decision False in time 0.0000000000, query time of that 0.0012782650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1726.76 < 1894.3
  -> Decision False in time 0.0100000000, query time of that 0.0009463690, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1832.35 < 1840.41
  -> Decision False in time 0.0000000000, query time of that 0.0009470020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1678.97 < 2116.63
  -> Decision False in time 0.0100000000, query time of that 0.0008834730, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1923.3 < 1930.14
  -> Decision False in time 0.0000000000, query time of that 0.0009474470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1575.22 < 1675.34
  -> Decision False in time 0.0000000000, query time of that 0.0009667600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2039.91 < 2094.37
  -> Decision False in time 0.0100000000, query time of that 0.0009131460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 354.96000000000004
Index size:  231668.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0445960520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4700000000, query time of that 0.4534979590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 4.6800000000, query time of that 4.6134331920, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0507588710, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.5400000000, query time of that 0.4937083210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 5.0400000000, query time of that 4.8559064260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0597527520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.6617147520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3600000000, query time of that 6.4120797580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 354.14999999999964
Index size:  205380.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0124219880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1098554290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0900000000, query time of that 1.0541690390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0113386250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1220220710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3500000000, query time of that 1.1979658690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0129767490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1183320910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1165.73 < 1257.39
  -> Decision False in time 3.2400000000, query time of that 0.4650350630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 104.05000000000018
Index size:  193508.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5639866667
  Testing...
|S| = 20
|T| = 283
Reject!
619.052 < 947.34
  -> Decision False in time 0.0000000000, query time of that 0.0019567460, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1540.85 < 1579.75
  -> Decision False in time 0.0100000000, query time of that 0.0023766300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2023.23 < 2026.02
  -> Decision False in time 0.0000000000, query time of that 0.0013185000, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1808.57 < 1979.63
  -> Decision False in time 0.0000000000, query time of that 0.0012480380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2039.6 < 2382.96
  -> Decision False in time 0.0000000000, query time of that 0.0012723930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2075.24 < 2195.47
  -> Decision False in time 0.0000000000, query time of that 0.0012139920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1923.4 < 1950.13
  -> Decision False in time 0.0100000000, query time of that 0.0013889380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1317.89 < 1324.85
  -> Decision False in time 0.0000000000, query time of that 0.0012947980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2039.65 < 2234.78
  -> Decision False in time 0.0000000000, query time of that 0.0011887570, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 136.42000000000007
Index size:  192632.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0144766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041633150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2147.71 < 2220.71
  -> Decision False in time 0.0200000000, query time of that 0.0162262070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1494.8 < 1505.91
  -> Decision False in time 0.0200000000, query time of that 0.0233339070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030710100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1580.23 < 1605.63
  -> Decision False in time 0.0100000000, query time of that 0.0035500240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2120.73 < 2193.65
  -> Decision False in time 0.0400000000, query time of that 0.0181050890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1576.73 < 1602.77
  -> Decision False in time 0.0000000000, query time of that 0.0032954780, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1353.3 < 1397.6
  -> Decision False in time 0.0100000000, query time of that 0.0033064160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1448.51 < 1536.77
  -> Decision False in time 0.0500000000, query time of that 0.0035263550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 337.5
Index size:  245020.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0394897830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3858596200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.8600000000, query time of that 3.8110051370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0418248420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.4073245590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.3800000000, query time of that 4.2012667710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0520912270, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.5421406580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2700000000, query time of that 5.6254927250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 354.60000000000036
Index size:  260068.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0184281990, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1904457530, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9400000000, query time of that 1.8894349650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0195624900, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2088539540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2500000000, query time of that 2.1485914350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0200285570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.2434829580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4600000000, query time of that 2.5621329080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 72.90000000000055
Index size:  181644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0441483333
  Testing...
|S| = 20
|T| = 283
Reject!
1870.15 < 2105.2
  -> Decision False in time 0.0100000000, query time of that 0.0031723260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1984.39 < 2116.5
  -> Decision False in time 0.0200000000, query time of that 0.0143233330, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2298.44 < 2340.52
  -> Decision False in time 0.0100000000, query time of that 0.0082658820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0038293830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1449.96 < 1562.97
  -> Decision False in time 0.0100000000, query time of that 0.0053791640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2096.81 < 2116.46
  -> Decision False in time 0.0100000000, query time of that 0.0032783150, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0037207470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1454.9 < 1567.97
  -> Decision False in time 0.0200000000, query time of that 0.0040237700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1835.71 < 1858.86
  -> Decision False in time 0.0000000000, query time of that 0.0040828750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 72.90999999999985
Index size:  142856.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2490633333
  Testing...
|S| = 20
|T| = 283
Reject!
2300.96 < 2314.51
  -> Decision False in time 0.0000000000, query time of that 0.0023254180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2184.45 < 2336.35
  -> Decision False in time 0.0100000000, query time of that 0.0025412600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1236.36 < 1242.38
  -> Decision False in time 0.0000000000, query time of that 0.0025011320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1495.21 < 1513.97
  -> Decision False in time 0.0000000000, query time of that 0.0016800800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1645.43 < 1706.9
  -> Decision False in time 0.0000000000, query time of that 0.0016027500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1888.39 < 1914.02
  -> Decision False in time 0.0100000000, query time of that 0.0017581170, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1625.55 < 1639.1
  -> Decision False in time 0.0100000000, query time of that 0.0018059730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1945.34 < 1949.84
  -> Decision False in time 0.0000000000, query time of that 0.0020813760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1916.29 < 2176.31
  -> Decision False in time 0.0000000000, query time of that 0.0017429990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 354.9900000000007
Index size:  256388.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0220155220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2223750540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1500000000, query time of that 2.0929613050, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0248561560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2284890890, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4800000000, query time of that 2.3663675610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0231941740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.2859752660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7200000000, query time of that 2.9333349360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 354.1800000000003
Index size:  202392.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0198298070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1713741790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.6380845100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0211339960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1886703460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0100000000, query time of that 1.8182902710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0201523840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2033359670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2200000000, query time of that 2.0835522480, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 355.2399999999998
Index size:  232460.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0121014920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1238519410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4000000000, query time of that 1.3550935660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0163461380, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1527843100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6900000000, query time of that 1.5487175650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0154154500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1675698820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0800000000, query time of that 1.6543451010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 136.54000000000087
Index size:  196624.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0761533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025030700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1173.87 < 1250.79
  -> Decision False in time 0.0200000000, query time of that 0.0172540760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1644.43 < 1754.57
  -> Decision False in time 0.0100000000, query time of that 0.0027859960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0021847460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1048.65 < 1141.44
  -> Decision False in time 0.0100000000, query time of that 0.0042692920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1767.02 < 1920.37
  -> Decision False in time 0.0200000000, query time of that 0.0038512910, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1226.98 < 1238.92
  -> Decision False in time 0.0100000000, query time of that 0.0022723470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
662.919 < 704.833
  -> Decision False in time 0.0100000000, query time of that 0.0021988940, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1471.33 < 1556.15
  -> Decision False in time 0.0200000000, query time of that 0.0022125680, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 338.39999999999964
Index size:  238100.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0828416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031784680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2069.47 < 2109.18
  -> Decision False in time 0.0200000000, query time of that 0.0081614170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1414.31 < 1425.85
  -> Decision False in time 0.0000000000, query time of that 0.0039720380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1268.45 < 1357.48
  -> Decision False in time 0.0100000000, query time of that 0.0022789800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1866.77 < 1878.53
  -> Decision False in time 0.0100000000, query time of that 0.0025180500, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
533.89 < 536.388
  -> Decision False in time 0.0000000000, query time of that 0.0024312080, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1875.16 < 1906.39
  -> Decision False in time 0.0000000000, query time of that 0.0024786940, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1308.68 < 1349.72
  -> Decision False in time 0.0100000000, query time of that 0.0022115680, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1281.54 < 1288.03
  -> Decision False in time 0.0000000000, query time of that 0.0026164990, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 356.6900000000005
Index size:  256628.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0073524510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0599843680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5999866010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0067038070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0683805470, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1452.03 < 1606.41
  -> Decision False in time 0.1200000000, query time of that 0.1052344120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065881890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0689377030, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1877.97 < 1885.12
  -> Decision False in time 2.0400000000, query time of that 0.1714925070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 103.73999999999978
Index size:  190988.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0093966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047816510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1711.32 < 1713.21
  -> Decision False in time 0.0200000000, query time of that 0.0222246810, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
882.291 < 919.162
  -> Decision False in time 0.2000000000, query time of that 0.1825060500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036750420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1156.54 < 1181.51
  -> Decision False in time 0.0400000000, query time of that 0.0211215110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1615.6 < 1643.02
  -> Decision False in time 0.0400000000, query time of that 0.0210554600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1408.65 < 1489.13
  -> Decision False in time 0.0100000000, query time of that 0.0040803790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1465.91 < 1548.64
  -> Decision False in time 0.0300000000, query time of that 0.0039652140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1039.82 < 1135.04
  -> Decision False in time 0.1400000000, query time of that 0.0083920790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 337.59000000000015
Index size:  244012.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0045430670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0351378620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4000000000, query time of that 0.3517096320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0040862620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0419447580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.8400000000, query time of that 0.4114846110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1689.19 < 1718.11
  -> Decision False in time 0.0200000000, query time of that 0.0044316950, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1544.98 < 1549.39
  -> Decision False in time 0.0000000000, query time of that 0.0044994470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1442.48 < 1446.69
  -> Decision False in time 0.3900000000, query time of that 0.0213765560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 103.51000000000022
Index size:  199524.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070658680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0562366710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6000000000, query time of that 0.5526480260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0058497850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0613003900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1440.63 < 1472.68
  -> Decision False in time 0.7100000000, query time of that 0.5824648330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0062914800, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0628755420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1855.06 < 1879.57
  -> Decision False in time 1.3600000000, query time of that 0.1062655420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 135.61000000000058
Index size:  182064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0041100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0053037020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0404166950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.4101439150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0044658270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0476029110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1403.48 < 1408.79
  -> Decision False in time 0.0300000000, query time of that 0.0189740090, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0049173010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1450.33 < 1451.95
  -> Decision False in time 0.0900000000, query time of that 0.0075000160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1496.68 < 1503.5
  -> Decision False in time 0.5600000000, query time of that 0.0343578320, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 72.91000000000167
Index size:  183512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0163366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065262180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2164.05 < 2231.27
  -> Decision False in time 0.0400000000, query time of that 0.0365155750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2019.14 < 2122.31
  -> Decision False in time 0.0100000000, query time of that 0.0114375850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061235620, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1494.89 < 1499.21
  -> Decision False in time 0.0100000000, query time of that 0.0064442300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1398.49 < 1747.89
  -> Decision False in time 0.0400000000, query time of that 0.0346913520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1862.95 < 1979.01
  -> Decision False in time 0.0100000000, query time of that 0.0067127080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1597.17 < 1621.29
  -> Decision False in time 0.4200000000, query time of that 0.0361393300, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1796.68 < 1819.52
  -> Decision False in time 0.0100000000, query time of that 0.0068859860, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 103.48999999999978
Index size:  188668.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0188483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036601450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0271939950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1295.72 < 1342.17
  -> Decision False in time 0.0700000000, query time of that 0.0633699990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029661910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1711.22 < 1719.37
  -> Decision False in time 0.0600000000, query time of that 0.0257948740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2069 < 2088.27
  -> Decision False in time 0.0700000000, query time of that 0.0325594710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1704.3 < 1712.14
  -> Decision False in time 0.0100000000, query time of that 0.0030729590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1470.44 < 1478.28
  -> Decision False in time 0.0200000000, query time of that 0.0030924420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1254.7 < 1256.35
  -> Decision False in time 0.0100000000, query time of that 0.0035008300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 336.90999999999985
Index size:  250496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0245766110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2364731140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.3500000000, query time of that 2.3061553290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0267842330, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2486261010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.7500000000, query time of that 2.5542944500, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0278243850, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.3251948930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9500000000, query time of that 3.2540650630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 352.9300000000003
Index size:  253388.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0295718740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2635487290, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7600000000, query time of that 2.6981625570, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0319035200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.3016061660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1300000000, query time of that 3.0153202880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0336651080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.3785684210, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9300000000, query time of that 3.9130171840, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 72.64000000000124
Index size:  188500.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0316166667
  Testing...
|S| = 20
|T| = 283
Reject!
2041.71 < 2199.27
  -> Decision False in time 0.0100000000, query time of that 0.0047869020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1904.57 < 1919.02
  -> Decision False in time 0.0100000000, query time of that 0.0099994200, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1728.29 < 1833.26
  -> Decision False in time 0.0100000000, query time of that 0.0042372440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1625.09 < 1935.36
  -> Decision False in time 0.0000000000, query time of that 0.0034115610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2072.87 < 2100.2
  -> Decision False in time 0.0100000000, query time of that 0.0072559800, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1408.63 < 1751.03
  -> Decision False in time 0.0700000000, query time of that 0.0332251790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2068.56 < 2092.19
  -> Decision False in time 0.0100000000, query time of that 0.0040620210, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1721.05 < 1758.67
  -> Decision False in time 0.0100000000, query time of that 0.0040608600, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1704.42 < 1707.14
  -> Decision False in time 0.0100000000, query time of that 0.0038791660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 103.3700000000008
Index size:  137696.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0018533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0081957170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0681657450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7100000000, query time of that 0.6619537020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0078081340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0762771070, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1646.61 < 1648.69
  -> Decision False in time 0.1000000000, query time of that 0.0928680940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0075578770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1452.36 < 1453.04
  -> Decision False in time 0.5800000000, query time of that 0.0573992330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
673.423 < 709.291
  -> Decision False in time 0.1900000000, query time of that 0.0238737290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 103.63999999999942
Index size:  186084.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092525260, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0816834030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1426.28 < 1510.35
  -> Decision False in time 0.0600000000, query time of that 0.0570976820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0092676270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0936239000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1132.5 < 1174.42
  -> Decision False in time 0.5700000000, query time of that 0.5311699070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0089972920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1117.88 < 1195.41
  -> Decision False in time 0.5600000000, query time of that 0.0657701380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6700000000, query time of that 0.9191295160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 354.9300000000003
Index size:  262552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0115510020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1167760670, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2300000000, query time of that 1.1837058130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0120765960, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1390626190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5100000000, query time of that 1.3786013960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0138332080, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1413048630, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6600000000, query time of that 1.3905801710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 134.3000000000011
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4551300000
  Testing...
|S| = 20
|T| = 283
Reject!
1943.09 < 1943.9
  -> Decision False in time 0.0000000000, query time of that 0.0020114820, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1682.5 < 1956.65
  -> Decision False in time 0.0100000000, query time of that 0.0032401430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1130.83 < 1132.07
  -> Decision False in time 0.0000000000, query time of that 0.0026749210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1340.73 < 1390.3
  -> Decision False in time 0.0000000000, query time of that 0.0016701610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1706.49 < 1781.99
  -> Decision False in time 0.0000000000, query time of that 0.0014146280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1679.58 < 1850.3
  -> Decision False in time 0.0100000000, query time of that 0.0015115710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1997.69 < 2069.76
  -> Decision False in time 0.0000000000, query time of that 0.0016155530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2332.34 < 2568.07
  -> Decision False in time 0.0000000000, query time of that 0.0015022170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
467.843 < 470.177
  -> Decision False in time 0.0200000000, query time of that 0.0016665710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 352.8200000000015
Index size:  230760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0408678320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3700000000, query time of that 0.3660441110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.6800000000, query time of that 3.6189726370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0421199880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.4100000000, query time of that 0.3945334390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 4.1300000000, query time of that 4.0430411610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0470695610, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.5101451400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2200000000, query time of that 5.3343479620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 135.54000000000087
Index size:  189100.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0263066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034416730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2112.51 < 2191.38
  -> Decision False in time 0.0200000000, query time of that 0.0159011070, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1304.75 < 1321.83
  -> Decision False in time 0.0400000000, query time of that 0.0318637690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1324.17 < 1344.97
  -> Decision False in time 0.0000000000, query time of that 0.0023623780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1448.82 < 1557.59
  -> Decision False in time 0.0300000000, query time of that 0.0087058980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2126.18 < 2191.38
  -> Decision False in time 0.0100000000, query time of that 0.0028210590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0030284310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1218.87 < 1238.58
  -> Decision False in time 0.1000000000, query time of that 0.0063057340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1235.06 < 1238.62
  -> Decision False in time 0.0200000000, query time of that 0.0031442170, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 353.47000000000116
Index size:  230448.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0105681810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0953487660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.9175286380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0109675450, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1097354190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3000000000, query time of that 1.0685828460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0113460130, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1064380420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 1.0485589000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 336.2900000000009
Index size:  205736.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0109807420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0905042640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9113444510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0101880220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1078012020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2500000000, query time of that 1.0543498750, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0122229410, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1061910760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 1.0737106690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 135.14999999999964
Index size:  204424.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0093879810, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0806088560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7677503970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0086872100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0897936110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1300000000, query time of that 0.8886471350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0087155660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.0871794220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2100.09 < 2101.46
  -> Decision False in time 2.6300000000, query time of that 0.2793350490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 336.4399999999987
Index size:  238872.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082713240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0672968720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6557292150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0078541310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0759803060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.7468252140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0079904050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0744675330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1994.27 < 2012.7
  -> Decision False in time 2.4500000000, query time of that 0.2212959420, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 135.52999999999884
Index size:  205356.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0086250000
  Testing...
|S| = 20
|T| = 283
Reject!
1593.35 < 1605.44
  -> Decision False in time 0.0000000000, query time of that 0.0043465800, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331502730, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1939.01 < 1969.85
  -> Decision False in time 0.1500000000, query time of that 0.1369263840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0037185290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0391019930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1495.3 < 1512.37
  -> Decision False in time 0.0500000000, query time of that 0.0237684210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0038511230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1866.91 < 2040.3
  -> Decision False in time 0.1000000000, query time of that 0.0082446480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
847.369 < 874.942
  -> Decision False in time 0.0200000000, query time of that 0.0039432240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 336.2900000000009
Index size:  238824.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0149216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0038005000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0268744820, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1426.75 < 1456.81
  -> Decision False in time 0.1000000000, query time of that 0.0926071430, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028191190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1193.56 < 1216.68
  -> Decision False in time 0.0000000000, query time of that 0.0032787620, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1132.84 < 1147.5
  -> Decision False in time 0.0200000000, query time of that 0.0065519010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1396.67 < 1420.05
  -> Decision False in time 0.0100000000, query time of that 0.0034241690, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1940.35 < 1952.4
  -> Decision False in time 0.0100000000, query time of that 0.0032805690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1464.93 < 1480.92
  -> Decision False in time 0.0900000000, query time of that 0.0050418850, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 73.15000000000146
Index size:  195840.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3821783333
  Testing...
|S| = 20
|T| = 283
Reject!
1765.52 < 1799.25
  -> Decision False in time 0.0000000000, query time of that 0.0021317510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2151.28 < 2151.49
  -> Decision False in time 0.0000000000, query time of that 0.0015286230, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1905.17 < 1923.08
  -> Decision False in time 0.0100000000, query time of that 0.0017238830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
525.44 < 623.796
  -> Decision False in time 0.0000000000, query time of that 0.0013964290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2083.58 < 2334.47
  -> Decision False in time 0.0000000000, query time of that 0.0015420820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1836.29 < 1953.57
  -> Decision False in time 0.0000000000, query time of that 0.0015071180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1845.81 < 1934.49
  -> Decision False in time 0.0100000000, query time of that 0.0014226370, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1376.12 < 1556.49
  -> Decision False in time 0.0000000000, query time of that 0.0014146930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1273.58 < 1289.02
  -> Decision False in time 0.0000000000, query time of that 0.0015852280, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 103.88999999999942
Index size:  172476.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0117180960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0994306300, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0500000000, query time of that 1.0011978060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0119789390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1199028260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1442.65 < 1483.32
  -> Decision False in time 1.2800000000, query time of that 1.1379708930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0109959900, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1115689440, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1750.67 < 1789.12
  -> Decision False in time 1.0500000000, query time of that 0.1405115020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 104.15999999999985
Index size:  189168.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2812850000
  Testing...
|S| = 20
|T| = 283
Reject!
1939 < 2087.72
  -> Decision False in time 0.0100000000, query time of that 0.0024069870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2176.58 < 2184.53
  -> Decision False in time 0.0000000000, query time of that 0.0024385560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2088.78 < 2145.78
  -> Decision False in time 0.0000000000, query time of that 0.0029835650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1835.67 < 1847.26
  -> Decision False in time 0.0100000000, query time of that 0.0014906810, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1014.99 < 1062.08
  -> Decision False in time 0.0000000000, query time of that 0.0014805760, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
642.466 < 674.373
  -> Decision False in time 0.0000000000, query time of that 0.0015904930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1285.03 < 1309.5
  -> Decision False in time 0.0000000000, query time of that 0.0016130110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1879.9 < 2285.74
  -> Decision False in time 0.0100000000, query time of that 0.0014778160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1711.27 < 1809.21
  -> Decision False in time 0.0000000000, query time of that 0.0016434300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 104.30999999999767
Index size:  188904.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0531366667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028506610, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0201661390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2094.46 < 2116.26
  -> Decision False in time 0.0200000000, query time of that 0.0134406950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2223.66 < 2246.68
  -> Decision False in time 0.0000000000, query time of that 0.0021219240, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1392.44 < 1403.21
  -> Decision False in time 0.0200000000, query time of that 0.0072117560, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
446.076 < 562.084
  -> Decision False in time 0.0200000000, query time of that 0.0074575100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1426.71 < 1462.89
  -> Decision False in time 0.0100000000, query time of that 0.0023839810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1209.49 < 1263.28
  -> Decision False in time 0.0200000000, query time of that 0.0022887720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1295.11 < 1307.66
  -> Decision False in time 0.0000000000, query time of that 0.0026703670, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 136.5500000000029
Index size:  192856.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0010783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078551740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0718531510, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6976160170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0081050470, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0826431280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1579.03 < 1587.45
  -> Decision False in time 0.7700000000, query time of that 0.7206484940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0078042310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1447.21 < 1464.98
  -> Decision False in time 0.7800000000, query time of that 0.0760031040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1129.98 < 1223.08
  -> Decision False in time 1.9500000000, query time of that 0.1863422220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 338.28999999999724
Index size:  250436.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0168696180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1623518990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6700000000, query time of that 1.6196957030, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0183206280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1869538210, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0000000000, query time of that 1.8334970010, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0181210480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2166712980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6400000000, query time of that 2.1168633290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 336.630000000001
Index size:  244572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0130466680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1232852270, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2700000000, query time of that 1.2082537040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0139173000, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1413570300, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5800000000, query time of that 1.3976880280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0140948030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1459698310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8400000000, query time of that 1.4320844900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 135.7599999999984
Index size:  203496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2087000000
  Testing...
|S| = 20
|T| = 283
Reject!
1537.82 < 1583.2
  -> Decision False in time 0.0000000000, query time of that 0.0022188670, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
998.506 < 1013.15
  -> Decision False in time 0.0100000000, query time of that 0.0046931950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1398.79 < 1417.2
  -> Decision False in time 0.0100000000, query time of that 0.0059618950, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1295.95 < 1329.45
  -> Decision False in time 0.0000000000, query time of that 0.0017970820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2080.02 < 2136.15
  -> Decision False in time 0.0000000000, query time of that 0.0018138190, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1690.23 < 1751.75
  -> Decision False in time 0.0100000000, query time of that 0.0017649600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1879.06 < 1921.18
  -> Decision False in time 0.0000000000, query time of that 0.0017898400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1657.6 < 1687.24
  -> Decision False in time 0.0000000000, query time of that 0.0018063920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1707.21 < 1713.2
  -> Decision False in time 0.0100000000, query time of that 0.0018498110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 73.15999999999985
Index size:  183448.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0971050000
  Testing...
|S| = 20
|T| = 283
Reject!
1889.93 < 1977.22
  -> Decision False in time 0.0100000000, query time of that 0.0036468690, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1913.17 < 1926.1
  -> Decision False in time 0.0100000000, query time of that 0.0072944630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1204.64 < 1252.47
  -> Decision False in time 0.0000000000, query time of that 0.0034946210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1877.3 < 2116.18
  -> Decision False in time 0.0000000000, query time of that 0.0024804720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1986.74 < 2392.21
  -> Decision False in time 0.0100000000, query time of that 0.0026816390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1557.66 < 1841.66
  -> Decision False in time 0.0000000000, query time of that 0.0029181770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1863.14 < 1877.56
  -> Decision False in time 0.0100000000, query time of that 0.0031351620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1639.71 < 1788.8
  -> Decision False in time 0.0000000000, query time of that 0.0028111160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1785.29 < 2129.11
  -> Decision False in time 0.0100000000, query time of that 0.0026685550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 73.15999999999985
Index size:  183516.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0225016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056748790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0480979450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2062.01 < 2343.77
  -> Decision False in time 0.0500000000, query time of that 0.0422183980, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051330590, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1992.75 < 2078.36
  -> Decision False in time 0.0500000000, query time of that 0.0371983400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1262.84 < 1285.98
  -> Decision False in time 0.0300000000, query time of that 0.0228504850, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056828320, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1579.04 < 1596.86
  -> Decision False in time 0.0200000000, query time of that 0.0059264400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1636.67 < 1697.24
  -> Decision False in time 0.1100000000, query time of that 0.0113198750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 355.130000000001
Index size:  257464.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0178892910, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1725918110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7700000000, query time of that 1.7250113750, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0197057140, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2009761700, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.1200000000, query time of that 1.9812199060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0212509770, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2242203460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2700000000, query time of that 2.2014903010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 73.09000000000015
Index size:  187252.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1513200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0028552520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1363.35 < 1405.09
  -> Decision False in time 0.0100000000, query time of that 0.0023575790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1895.09 < 2050.69
  -> Decision False in time 0.0100000000, query time of that 0.0067614150, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1615.66 < 1644
  -> Decision False in time 0.0100000000, query time of that 0.0021273270, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1888.32 < 1916.55
  -> Decision False in time 0.0000000000, query time of that 0.0015481540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2130.89 < 2256.39
  -> Decision False in time 0.0200000000, query time of that 0.0041779120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1897.51 < 1965.63
  -> Decision False in time 0.0100000000, query time of that 0.0021435730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1697.6 < 1697.99
  -> Decision False in time 0.0100000000, query time of that 0.0020877450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1664.17 < 1719.88
  -> Decision False in time 0.0000000000, query time of that 0.0018592790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 337.72999999999956
Index size:  193816.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0004850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0064047870, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0524136450, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5152618600, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058436780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0586556390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1392.57 < 1399.89
  -> Decision False in time 0.1500000000, query time of that 0.1083470940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1641.71 < 1647.38
  -> Decision False in time 0.0200000000, query time of that 0.0061134290, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0591152350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1479.26 < 1519.99
  -> Decision False in time 2.2000000000, query time of that 0.1621982200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 103.65000000000146
Index size:  199812.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1255783333
  Testing...
|S| = 20
|T| = 283
Reject!
1702.31 < 2016.82
  -> Decision False in time 0.0000000000, query time of that 0.0025012400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1863.84 < 1909.56
  -> Decision False in time 0.0100000000, query time of that 0.0074611960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1806.93 < 1911.85
  -> Decision False in time 0.0100000000, query time of that 0.0062266870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1380.5 < 1393.75
  -> Decision False in time 0.0000000000, query time of that 0.0017305300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1201.4 < 1259.24
  -> Decision False in time 0.0000000000, query time of that 0.0019708640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1491.9 < 1517.45
  -> Decision False in time 0.0100000000, query time of that 0.0019472800, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2077.05 < 2108.11
  -> Decision False in time 0.0000000000, query time of that 0.0019866550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1467.06 < 1517.13
  -> Decision False in time 0.0000000000, query time of that 0.0018104660, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2256.61 < 2266.05
  -> Decision False in time 0.0100000000, query time of that 0.0019401370, with c1=5.0000000000, c2=0.1000000000
