copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 300.51
Index size:  474892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0130414920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1123285580, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0700000000, query time of that 1.0250705690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0120682560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1196430450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.1986465600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0121850310, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1232501910, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1621.36 < 1632.11
  -> Decision False in time 0.9500000000, query time of that 0.1422210070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 301.87
Index size:  278372.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0256229940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1210684460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1899945540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0132429640, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1349744530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5700000000, query time of that 1.3712771300, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0142512500, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1424501700, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8800000000, query time of that 1.4185295430, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.99999999999989
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5705950000
  Testing...
|S| = 20
|T| = 283
Reject!
1820.22 < 1882.76
  -> Decision False in time 0.0100000000, query time of that 0.0013490250, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1743.85 < 1904.22
  -> Decision False in time 0.0100000000, query time of that 0.0013913860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1133.53 < 1247.22
  -> Decision False in time 0.0000000000, query time of that 0.0013684730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1288.24 < 1301.68
  -> Decision False in time 0.0000000000, query time of that 0.0009324750, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2157.5 < 2249.37
  -> Decision False in time 0.0100000000, query time of that 0.0008971320, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
923.251 < 938.454
  -> Decision False in time 0.0000000000, query time of that 0.0009555760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1921.95 < 1928.19
  -> Decision False in time 0.0000000000, query time of that 0.0008807220, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1087.4 < 1177.31
  -> Decision False in time 0.0100000000, query time of that 0.0009056250, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1281.11 < 1385.78
  -> Decision False in time 0.0000000000, query time of that 0.0009346610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 301.3399999999999
Index size:  199024.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0080883600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0782751640, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7775091910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0088508320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0876523000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.0800000000, query time of that 0.9023237210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0087023750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0901030330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9100000000, query time of that 0.8965026660, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 129.48000000000002
Index size:  191444.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2574650000
  Testing...
|S| = 20
|T| = 283
Reject!
1654.03 < 1680.31
  -> Decision False in time 0.0100000000, query time of that 0.0021735620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1852.88 < 1889.66
  -> Decision False in time 0.0100000000, query time of that 0.0016325020, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1185.65 < 1243.68
  -> Decision False in time 0.0000000000, query time of that 0.0022135370, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1549.55 < 1622.91
  -> Decision False in time 0.0100000000, query time of that 0.0011574550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1058.77 < 1105.64
  -> Decision False in time 0.0000000000, query time of that 0.0012112770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1293.94 < 1322.29
  -> Decision False in time 0.0100000000, query time of that 0.0026090960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2007.07 < 2226.74
  -> Decision False in time 0.0100000000, query time of that 0.0014574550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1500.44 < 1582.77
  -> Decision False in time 0.0100000000, query time of that 0.0017498920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1747 < 1756.02
  -> Decision False in time 0.0100000000, query time of that 0.0014463090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 129.42000000000007
Index size:  173288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0020150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0078691340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0701888740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.6947714780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0081735600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0824444410, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1433.56 < 1486.82
  -> Decision False in time 0.2200000000, query time of that 0.2069718110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0081007020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0790592010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1139.21 < 1146.29
  -> Decision False in time 0.2700000000, query time of that 0.0332667600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 301.8800000000001
Index size:  250700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0352130960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.3310423780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.3400000000, query time of that 3.2878104650, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0386106120, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3900000000, query time of that 0.3660401740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.8100000000, query time of that 3.5606726520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0414876520, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0300000000, query time of that 0.4908939790, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.8500000000, query time of that 5.1556562130, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 294.28999999999996
Index size:  194168.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026850000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0052143660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0412716080, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4500000000, query time of that 0.3972674890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0047414490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0467599650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1243.94 < 1279.73
  -> Decision False in time 0.6700000000, query time of that 0.3987609940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0047208750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1062.14 < 1076.69
  -> Decision False in time 0.5200000000, query time of that 0.0312794100, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1905.66 < 1939.12
  -> Decision False in time 0.7700000000, query time of that 0.0454769120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 303.4499999999998
Index size:  259512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0154241280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1355081840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4100000000, query time of that 1.3558428910, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0147228910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1555664090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7300000000, query time of that 1.5672641870, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0178671340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1704111200, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1922.46 < 1933.54
  -> Decision False in time 3.1800000000, query time of that 0.6260980270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 110.50999999999976
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5964816667
  Testing...
|S| = 20
|T| = 283
Reject!
953.051 < 993.574
  -> Decision False in time 0.0000000000, query time of that 0.0018815160, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1482.38 < 1488.65
  -> Decision False in time 0.0100000000, query time of that 0.0025095690, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1469.82 < 1632.36
  -> Decision False in time 0.0000000000, query time of that 0.0012165220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1115.89 < 1158.29
  -> Decision False in time 0.0000000000, query time of that 0.0011799310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2251.42 < 2433.06
  -> Decision False in time 0.0000000000, query time of that 0.0012321780, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1647.4 < 1746.48
  -> Decision False in time 0.0100000000, query time of that 0.0012262710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
679.543 < 712.064
  -> Decision False in time 0.0000000000, query time of that 0.0012314740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1297.37 < 1313.38
  -> Decision False in time 0.0000000000, query time of that 0.0013419340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
866.201 < 916.87
  -> Decision False in time 0.0000000000, query time of that 0.0013563300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 80.21000000000004
Index size:  180804.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0179783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0065999550, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0529369760, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2837.59 < 2997.03
  -> Decision False in time 0.4700000000, query time of that 0.4291330630, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1324.08 < 1357.64
  -> Decision False in time 0.0000000000, query time of that 0.0059804220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1918.38 < 1919.27
  -> Decision False in time 0.0300000000, query time of that 0.0250237360, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1284.57 < 1316.12
  -> Decision False in time 0.0100000000, query time of that 0.0060617110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1100.12 < 1153.54
  -> Decision False in time 0.0900000000, query time of that 0.0060094070, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
974.457 < 989.281
  -> Decision False in time 0.0100000000, query time of that 0.0064636110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1295.67 < 1295.8
  -> Decision False in time 0.1500000000, query time of that 0.0132380700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 109.44000000000005
Index size:  186152.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0150650000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0047250080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0326781250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1559.76 < 1565.15
  -> Decision False in time 0.0400000000, query time of that 0.0343728840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035255670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1199.4 < 1200.19
  -> Decision False in time 0.0300000000, query time of that 0.0152243040, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1452.68 < 1461.96
  -> Decision False in time 0.0100000000, query time of that 0.0077462100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0038712650, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1843.63 < 1859.86
  -> Decision False in time 0.0400000000, query time of that 0.0040929070, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1466.12 < 1525.86
  -> Decision False in time 0.0200000000, query time of that 0.0042861510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 110.98000000000002
Index size:  186116.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0032950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075953860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0629373610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6700000000, query time of that 0.6226744230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0075966420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0734346950, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1836.65 < 1839.27
  -> Decision False in time 0.1200000000, query time of that 0.1012105000, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1307.63 < 1334.44
  -> Decision False in time 0.0300000000, query time of that 0.0076570120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0727419730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1495.44 < 1502.4
  -> Decision False in time 0.0300000000, query time of that 0.0075000250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 80.32999999999993
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0319050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054535840, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1155.83 < 1185.68
  -> Decision False in time 0.0400000000, query time of that 0.0376106240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2329.05 < 2881.51
  -> Decision False in time 0.0300000000, query time of that 0.0324003170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041312070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2280.61 < 2380.82
  -> Decision False in time 0.0300000000, query time of that 0.0228589530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1260.34 < 1314.88
  -> Decision False in time 0.0600000000, query time of that 0.0326591460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046068190, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
960.085 < 1001.75
  -> Decision False in time 0.1900000000, query time of that 0.0136536980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1123.64 < 1145.05
  -> Decision False in time 0.0300000000, query time of that 0.0046194140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 110.61999999999989
Index size:  188736.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063420110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0539199120, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1148.22 < 1167.25
  -> Decision False in time 0.1200000000, query time of that 0.1126302440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056436390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0614475110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1400.82 < 1485.57
  -> Decision False in time 0.4300000000, query time of that 0.3189000740, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061733050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1340.51 < 1359.1
  -> Decision False in time 0.4600000000, query time of that 0.0347232140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1032.25 < 1050.09
  -> Decision False in time 0.3900000000, query time of that 0.0322409350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 110.57999999999993
Index size:  185800.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0065500000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055694120, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0429337710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4800000000, query time of that 0.4295696500, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0048559100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0507291920, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
962.676 < 970.468
  -> Decision False in time 0.5000000000, query time of that 0.3141751940, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1460.93 < 1504.66
  -> Decision False in time 0.0400000000, query time of that 0.0052306750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1100.34 < 1108.67
  -> Decision False in time 0.1600000000, query time of that 0.0106269780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1480.74 < 1553.72
  -> Decision False in time 0.0200000000, query time of that 0.0054284750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 80.19999999999982
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0229616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0056009750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0448060490, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1348.14 < 1392.51
  -> Decision False in time 0.0300000000, query time of that 0.0230041180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0046693310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2092.22 < 2093.16
  -> Decision False in time 0.0300000000, query time of that 0.0206488680, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1075.18 < 1079.25
  -> Decision False in time 0.0600000000, query time of that 0.0429320400, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1008.96 < 1033.79
  -> Decision False in time 0.0100000000, query time of that 0.0051268240, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1499.3 < 1549.58
  -> Decision False in time 0.0000000000, query time of that 0.0054242580, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1530.43 < 1549.23
  -> Decision False in time 0.0600000000, query time of that 0.0051967750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 303.96000000000004
Index size:  260732.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0122238580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1120773660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1500000000, query time of that 1.1107831450, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0128260100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1306955050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.4900000000, query time of that 1.2926307610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0137022160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1286523690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1500000000, query time of that 1.3026448380, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 294.08999999999924
Index size:  194208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000516667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0149566950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1484930990, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.3662874670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0153921570, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1553133650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.5602643700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0169285480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.1741816270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.3000000000, query time of that 1.6658081400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 129.52999999999975
Index size:  203192.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0221416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035661600, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1654.55 < 1727.59
  -> Decision False in time 0.0100000000, query time of that 0.0055780150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1520.42 < 1547.09
  -> Decision False in time 0.1200000000, query time of that 0.0973880220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0028855080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1174.98 < 1185.83
  -> Decision False in time 0.0400000000, query time of that 0.0184886120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
953.393 < 974.961
  -> Decision False in time 0.0200000000, query time of that 0.0071933140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1283.01 < 1286.68
  -> Decision False in time 0.0600000000, query time of that 0.0032153580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
975.179 < 975.253
  -> Decision False in time 0.0100000000, query time of that 0.0032784350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1333.96 < 1391.21
  -> Decision False in time 0.0100000000, query time of that 0.0032720210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 293.6799999999994
Index size:  230528.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0094526230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0804532970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7864495730, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0094285910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0914569900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1600000000, query time of that 0.9367158020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0097794160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0910547960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1924.16 < 1937.87
  -> Decision False in time 7.2900000000, query time of that 0.7782678510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 129.64000000000033
Index size:  205348.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0136066667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041758030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0310386420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1214.99 < 1215.09
  -> Decision False in time 0.0200000000, query time of that 0.0137199010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032762370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0367669220, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1536.73 < 1557.59
  -> Decision False in time 0.0500000000, query time of that 0.0260697790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1511.98 < 1527.73
  -> Decision False in time 0.0100000000, query time of that 0.0036936390, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1114.25 < 1248.23
  -> Decision False in time 0.0300000000, query time of that 0.0040219820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1237.93 < 1260.71
  -> Decision False in time 0.0100000000, query time of that 0.0039231400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 292.7000000000007
Index size:  230448.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0061450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0044342310, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0331729960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
933.154 < 939.576
  -> Decision False in time 0.2000000000, query time of that 0.1753040240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036443720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1720.66 < 1749.91
  -> Decision False in time 0.0200000000, query time of that 0.0118798350, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1781.26 < 1788.44
  -> Decision False in time 0.0100000000, query time of that 0.0038787690, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1520.53 < 1527.31
  -> Decision False in time 0.0000000000, query time of that 0.0040012910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1272.48 < 1277.1
  -> Decision False in time 0.0900000000, query time of that 0.0081377340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
953.308 < 967.668
  -> Decision False in time 0.0200000000, query time of that 0.0037273490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 109.5
Index size:  201392.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0285150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036131470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0265629140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1385.46 < 1385.93
  -> Decision False in time 0.0400000000, query time of that 0.0325486790, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029661020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1359.38 < 1380.09
  -> Decision False in time 0.0100000000, query time of that 0.0066302390, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1630.47 < 1855.5
  -> Decision False in time 0.0400000000, query time of that 0.0184199360, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1170.59 < 1216.9
  -> Decision False in time 0.0200000000, query time of that 0.0032419990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1881.28 < 1946.97
  -> Decision False in time 0.0700000000, query time of that 0.0034173560, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1800.38 < 1863.54
  -> Decision False in time 0.0200000000, query time of that 0.0034639590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 79.23000000000047
Index size:  186648.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0816866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033039730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2391.4 < 2556.35
  -> Decision False in time 0.0200000000, query time of that 0.0152510750, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1381.99 < 1440.1
  -> Decision False in time 0.0000000000, query time of that 0.0045205860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0026600630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1411.32 < 1438.48
  -> Decision False in time 0.0100000000, query time of that 0.0061836060, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2051.03 < 2776.47
  -> Decision False in time 0.0100000000, query time of that 0.0028262530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1535.57 < 1535.9
  -> Decision False in time 0.0000000000, query time of that 0.0028929010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1578.73 < 1784.16
  -> Decision False in time 0.0100000000, query time of that 0.0027330960, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1410.75 < 1421.59
  -> Decision False in time 0.0100000000, query time of that 0.0031022760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 78.76000000000022
Index size:  183708.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4019433333
  Testing...
|S| = 20
|T| = 283
Reject!
1338.71 < 1604.83
  -> Decision False in time 0.0100000000, query time of that 0.0022209570, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1980.02 < 2040.99
  -> Decision False in time 0.0000000000, query time of that 0.0017216910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2287.07 < 2297.11
  -> Decision False in time 0.0000000000, query time of that 0.0020145280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1777.37 < 1868.57
  -> Decision False in time 0.0000000000, query time of that 0.0015918090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1682.21 < 1776.39
  -> Decision False in time 0.0100000000, query time of that 0.0014470870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1327.55 < 1401.1
  -> Decision False in time 0.0000000000, query time of that 0.0014572790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
991.924 < 1219.56
  -> Decision False in time 0.0000000000, query time of that 0.0016192170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2054.96 < 2088.24
  -> Decision False in time 0.0000000000, query time of that 0.0014537860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1278.49 < 1292.8
  -> Decision False in time 0.0100000000, query time of that 0.0014543300, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 109.22000000000025
Index size:  189212.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0087011790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0776371140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8000000000, query time of that 0.7603451830, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0087363610, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0877585430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1300000000, query time of that 0.8838792980, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0094103480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1131.36 < 1185.14
  -> Decision False in time 0.4100000000, query time of that 0.0444925540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1313 < 1340.99
  -> Decision False in time 0.2500000000, query time of that 0.0304321000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 129.47000000000025
Index size:  190780.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0420683333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0031238320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0230634350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.2700000000, query time of that 0.2228767260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025159940, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1703.09 < 1710.88
  -> Decision False in time 0.0200000000, query time of that 0.0060799250, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1163.94 < 1350.83
  -> Decision False in time 0.0100000000, query time of that 0.0062596540, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1438.6 < 1453.12
  -> Decision False in time 0.0900000000, query time of that 0.0028288570, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1054.82 < 1063.7
  -> Decision False in time 0.0100000000, query time of that 0.0029818800, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1249.23 < 1264.49
  -> Decision False in time 0.0000000000, query time of that 0.0029374770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 293.33999999999924
Index size:  236844.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0114024400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0987172440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.9726018850, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0122624190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1130955230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1434.05 < 1440.9
  -> Decision False in time 0.8600000000, query time of that 0.8251066790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0122300810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1154037750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9400000000, query time of that 1.1359761540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 300.71999999999935
Index size:  259436.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0008783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0057768420, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0512945870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5247110120, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0060786310, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0601965510, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1591.41 < 1621.81
  -> Decision False in time 0.3400000000, query time of that 0.2541509120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0059057740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1531.93 < 1544.77
  -> Decision False in time 0.2100000000, query time of that 0.0185383180, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2091.52 < 2104.36
  -> Decision False in time 2.1600000000, query time of that 0.1585994980, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 129.15999999999985
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0038783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0061152080, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0455926140, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4506079550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0052534300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0516097120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1970.82 < 2019.24
  -> Decision False in time 0.1400000000, query time of that 0.0925672110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0053883880, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1325.95 < 1329.33
  -> Decision False in time 0.3500000000, query time of that 0.0242200040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1196.58 < 1206.43
  -> Decision False in time 0.1200000000, query time of that 0.0110471140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 294.03999999999905
Index size:  220868.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0204708680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1909104110, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8900000000, query time of that 1.8439813990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0191457440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.1964112660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2500000000, query time of that 2.1160644840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0205840480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.2493603820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4800000000, query time of that 2.5016292560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 292.39000000000124
Index size:  245268.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005916667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0075079340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0597548420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5864140360, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0064463080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0670957640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.6673204260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0068193810, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1097.5 < 1121.67
  -> Decision False in time 0.2900000000, query time of that 0.0288046190, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1384.88 < 1388.42
  -> Decision False in time 0.6300000000, query time of that 0.0524741240, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 295.46999999999935
Index size:  246056.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002966667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0087359790, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0710969610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7500000000, query time of that 0.6934660320, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0078183100, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0823958790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1086.85 < 1094.26
  -> Decision False in time 0.0800000000, query time of that 0.0712988600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0085425990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0794596760, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1432.83 < 1440.46
  -> Decision False in time 1.0900000000, query time of that 0.1080259690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 79.66000000000167
Index size:  193800.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0481100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0041270180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1575.24 < 1612.06
  -> Decision False in time 0.0200000000, query time of that 0.0138580050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1059.66 < 1066.34
  -> Decision False in time 0.0100000000, query time of that 0.0088244470, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1865.4 < 2888.52
  -> Decision False in time 0.0000000000, query time of that 0.0035802280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1514.83 < 1526.81
  -> Decision False in time 0.0300000000, query time of that 0.0147133450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2260.17 < 2703.79
  -> Decision False in time 0.0100000000, query time of that 0.0038816620, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1285.5 < 1298.42
  -> Decision False in time 0.0200000000, query time of that 0.0037476180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
911.299 < 915.114
  -> Decision False in time 0.0100000000, query time of that 0.0042989670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1421.76 < 1423.72
  -> Decision False in time 0.0400000000, query time of that 0.0040046260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 79.98999999999978
Index size:  177864.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1284050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030558220, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2202.84 < 2388.13
  -> Decision False in time 0.0000000000, query time of that 0.0048879910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1260.29 < 1390.94
  -> Decision False in time 0.0100000000, query time of that 0.0091682530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0021030660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1281.04 < 1356.81
  -> Decision False in time 0.0100000000, query time of that 0.0027871610, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1388.69 < 1611.93
  -> Decision False in time 0.0000000000, query time of that 0.0026339030, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1679.53 < 1682.92
  -> Decision False in time 0.0000000000, query time of that 0.0022852260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1360.18 < 1362.89
  -> Decision False in time 0.0100000000, query time of that 0.0023348710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1625.39 < 1631.75
  -> Decision False in time 0.0000000000, query time of that 0.0024416290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 293.14000000000124
Index size:  232320.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0262000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0033013320, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1532.7 < 1550.61
  -> Decision False in time 0.0100000000, query time of that 0.0045827130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1827.86 < 1833.42
  -> Decision False in time 0.0100000000, query time of that 0.0117824170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027511820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2171.71 < 2191.05
  -> Decision False in time 0.0100000000, query time of that 0.0054195260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1481.11 < 1510.45
  -> Decision False in time 0.0300000000, query time of that 0.0091435970, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1210.06 < 1216.01
  -> Decision False in time 0.0100000000, query time of that 0.0030712470, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
819.16 < 842.34
  -> Decision False in time 0.0000000000, query time of that 0.0031823380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1395.86 < 1398.02
  -> Decision False in time 0.0100000000, query time of that 0.0030417500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 109.7400000000016
Index size:  200576.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3313266667
  Testing...
|S| = 20
|T| = 283
Reject!
1414.25 < 1419.75
  -> Decision False in time 0.0100000000, query time of that 0.0022658230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1189.31 < 1214.83
  -> Decision False in time 0.0000000000, query time of that 0.0027911440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1439.6 < 1463.49
  -> Decision False in time 0.0000000000, query time of that 0.0014527230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1250.55 < 1262.32
  -> Decision False in time 0.0000000000, query time of that 0.0015403260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1065.75 < 1118.65
  -> Decision False in time 0.0100000000, query time of that 0.0014303310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1671.47 < 1754.64
  -> Decision False in time 0.0000000000, query time of that 0.0014985430, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
940.574 < 1005.51
  -> Decision False in time 0.0000000000, query time of that 0.0015033490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
967.83 < 1082.59
  -> Decision False in time 0.0000000000, query time of that 0.0014370340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1409.85 < 1734.16
  -> Decision False in time 0.0100000000, query time of that 0.0014824090, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 109.6200000000008
Index size:  181880.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1546800000
  Testing...
|S| = 20
|T| = 283
Reject!
1096.39 < 1107.18
  -> Decision False in time 0.0000000000, query time of that 0.0024728090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2124.08 < 2126
  -> Decision False in time 0.0100000000, query time of that 0.0059058600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1483.43 < 1530.53
  -> Decision False in time 0.0100000000, query time of that 0.0049031400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1384.1 < 1497.48
  -> Decision False in time 0.0000000000, query time of that 0.0017354420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1338.47 < 1353.57
  -> Decision False in time 0.0100000000, query time of that 0.0039133650, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1162.48 < 1168.37
  -> Decision False in time 0.0000000000, query time of that 0.0019235460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1035.33 < 1085.9
  -> Decision False in time 0.0100000000, query time of that 0.0019793990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1030.58 < 1046.12
  -> Decision False in time 0.0000000000, query time of that 0.0016747540, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1266.4 < 1442.12
  -> Decision False in time 0.0100000000, query time of that 0.0019479500, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 294.9500000000007
Index size:  240208.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0309203060, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.3034540250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9500000000, query time of that 2.8972931820, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0322662400, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3253088740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.3300000000, query time of that 3.2090925700, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0383286740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0200000000, query time of that 0.4552683140, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7800000000, query time of that 4.6921008560, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 129.3199999999997
Index size:  203124.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0019266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070118950, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0626086500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6800000000, query time of that 0.6403667210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0068142870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0732709450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1338.04 < 1362.92
  -> Decision False in time 0.4800000000, query time of that 0.4356436210, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0071540050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1486.28 < 1585.8
  -> Decision False in time 0.7300000000, query time of that 0.0683566780, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
919.559 < 924.168
  -> Decision False in time 0.1700000000, query time of that 0.0188096080, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 299.71999999999935
Index size:  241640.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0246653920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.2144432950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1200000000, query time of that 2.0734222020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0225865220, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2500000000, query time of that 0.2313352180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.4900000000, query time of that 2.3715321320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0258427060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.3023207060, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1700000000, query time of that 3.0601492200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 108.8700000000008
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0023800000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0113381700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0989846390, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.9347648540, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0106692580, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1075435790, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.0925537040, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0113868580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.1091798110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1618.31 < 1642.82
  -> Decision False in time 2.1900000000, query time of that 0.2822362610, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 128.65999999999985
Index size:  178860.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0012583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0108119360, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0919756460, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.9260340130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0107918910, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1109948400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.0898314890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0116811050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1062926170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1740.29 < 1757.52
  -> Decision False in time 1.9700000000, query time of that 0.2500616950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 300.40999999999985
Index size:  253740.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001016667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0111596100, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0868853170, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.8849231110, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0104858880, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1056801750, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.0335893320, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0099382430, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1109031170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8900000000, query time of that 1.0052640580, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 292.1999999999989
Index size:  194128.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1071050000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027088830, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1184.99 < 1197.7
  -> Decision False in time 0.0100000000, query time of that 0.0070013630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1298.47 < 1305.92
  -> Decision False in time 0.0100000000, query time of that 0.0050203080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0021965630, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1643.83 < 1645.87
  -> Decision False in time 0.0100000000, query time of that 0.0019159740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1815.52 < 1815.6
  -> Decision False in time 0.0100000000, query time of that 0.0019867760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1225.13 < 1231.27
  -> Decision False in time 0.0200000000, query time of that 0.0025263640, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1071.01 < 1076.62
  -> Decision False in time 0.0200000000, query time of that 0.0026014610, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1510.08 < 1536.71
  -> Decision False in time 0.0000000000, query time of that 0.0020533190, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 303.0
Index size:  262180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0307394110, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2900000000, query time of that 0.2818708360, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.8100000000, query time of that 2.7666426840, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0320901650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3400000000, query time of that 0.3069841730, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.2500000000, query time of that 3.0833929760, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0386180120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.3351894080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1100000000, query time of that 3.2936551180, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 129.54000000000087
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1054250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0025568340, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1448.32 < 1506.31
  -> Decision False in time 0.0100000000, query time of that 0.0050093650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
949.137 < 954.378
  -> Decision False in time 0.0300000000, query time of that 0.0199774560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1308.05 < 1330.76
  -> Decision False in time 0.0000000000, query time of that 0.0015297890, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1215.02 < 1217.98
  -> Decision False in time 0.0100000000, query time of that 0.0019570250, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1210.35 < 1216.26
  -> Decision False in time 0.0000000000, query time of that 0.0024128790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1158.96 < 1261.99
  -> Decision False in time 0.0100000000, query time of that 0.0021423600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1467.75 < 1512.19
  -> Decision False in time 0.0100000000, query time of that 0.0020489460, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1363.73 < 1382.02
  -> Decision False in time 0.0100000000, query time of that 0.0022757040, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 301.90999999999985
Index size:  236920.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000266667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0193535490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1670213860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7100000000, query time of that 1.6590981480, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0175356190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1867783310, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0800000000, query time of that 1.9152573560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0199309480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2180649360, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1625.61 < 1627.94
  -> Decision False in time 0.0500000000, query time of that 0.0201470020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 302.9599999999991
Index size:  206648.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0182208880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1565322540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.6000000000, query time of that 1.5446538800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0205715560, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1822642710, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9300000000, query time of that 1.7846572670, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0200212580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1915311490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1700000000, query time of that 1.9919396780, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 295.15999999999985
Index size:  194036.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0014416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0056530410, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0441357660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4617394010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0053921760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0538653090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.5294122220, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056595010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1238.86 < 1263.91
  -> Decision False in time 0.4800000000, query time of that 0.0335457230, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2043.94 < 2064.43
  -> Decision False in time 0.7200000000, query time of that 0.0469158600, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 128.79999999999927
Index size:  204004.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0025716667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0063162330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0525631710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5700000000, query time of that 0.5201989640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0061170980, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0598376480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1495.26 < 2318.52
  -> Decision False in time 0.0300000000, query time of that 0.0245977460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0063952730, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1184.35 < 1226.38
  -> Decision False in time 0.6100000000, query time of that 0.0474513860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
875.567 < 919.796
  -> Decision False in time 0.2100000000, query time of that 0.0186336110, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 301.7999999999993
Index size:  249792.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0079007680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0671949370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6555456870, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0069105860, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0758390820, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.7702101240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0082415360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.0771359880, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1421.21 < 1487.46
  -> Decision False in time 0.7800000000, query time of that 0.0723433050, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.34000000000015
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8218316667
  Testing...
|S| = 20
|T| = 283
Reject!
2265.95 < 2368.71
  -> Decision False in time 0.0100000000, query time of that 0.0018829920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1636.69 < 2247.14
  -> Decision False in time 0.0000000000, query time of that 0.0015216950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1864.3 < 2216.41
  -> Decision False in time 0.0000000000, query time of that 0.0010131290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1497.71 < 1776.38
  -> Decision False in time 0.0000000000, query time of that 0.0009487090, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1906.27 < 2584.24
  -> Decision False in time 0.0000000000, query time of that 0.0008762230, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1094.97 < 1186.25
  -> Decision False in time 0.0000000000, query time of that 0.0009976880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2191.44 < 2394.09
  -> Decision False in time 0.0100000000, query time of that 0.0008985350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1931.13 < 2179.38
  -> Decision False in time 0.0000000000, query time of that 0.0009988320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1500.96 < 1620.73
  -> Decision False in time 0.0000000000, query time of that 0.0008980820, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 298.0599999999995
Index size:  199892.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000216667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0188344090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2000000000, query time of that 0.1881812220, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9200000000, query time of that 1.8693004460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0227715350, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2201909280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2700000000, query time of that 2.1279828290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0248018260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2582048350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.5500000000, query time of that 2.5116352140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 78.25
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2311650000
  Testing...
|S| = 20
|T| = 283
Reject!
981.266 < 1004.74
  -> Decision False in time 0.0000000000, query time of that 0.0022192580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1504.11 < 1583.45
  -> Decision False in time 0.0100000000, query time of that 0.0054580940, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2129.49 < 2362.4
  -> Decision False in time 0.0200000000, query time of that 0.0123394330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1265.66 < 1266.37
  -> Decision False in time 0.0100000000, query time of that 0.0017809300, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1363.86 < 1417.44
  -> Decision False in time 0.0000000000, query time of that 0.0018983850, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1095.18 < 1215.08
  -> Decision False in time 0.0100000000, query time of that 0.0017672390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1499.22 < 1500.53
  -> Decision False in time 0.0100000000, query time of that 0.0018098300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1743.04 < 1751.25
  -> Decision False in time 0.0000000000, query time of that 0.0020216550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
902.593 < 917.519
  -> Decision False in time 0.0100000000, query time of that 0.0020262620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 298.5899999999965
Index size:  199920.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000450000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0138894290, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1300831950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3400000000, query time of that 1.2895701220, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0163618660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1469466540, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6700000000, query time of that 1.4825432860, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0173265490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1608839390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.0400000000, query time of that 1.5728111700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 127.95999999999913
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0064400000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0051626510, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1395.81 < 1400.97
  -> Decision False in time 0.0300000000, query time of that 0.0325523420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.4300000000, query time of that 0.3781174160, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0043770230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0435004980, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
976.332 < 982.143
  -> Decision False in time 0.1300000000, query time of that 0.0720526810, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0045407790, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1620.31 < 1639.56
  -> Decision False in time 0.1600000000, query time of that 0.0094467500, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1821.64 < 1837.21
  -> Decision False in time 0.0000000000, query time of that 0.0042970810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 129.15999999999985
Index size:  171532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5070950000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0021808500, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1462.67 < 1530.44
  -> Decision False in time 0.0000000000, query time of that 0.0020397030, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1720.55 < 1764.94
  -> Decision False in time 0.0000000000, query time of that 0.0041264690, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1588.34 < 1610.94
  -> Decision False in time 0.0100000000, query time of that 0.0013347410, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1078.64 < 1084.63
  -> Decision False in time 0.0000000000, query time of that 0.0014142530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1461.81 < 1664.33
  -> Decision False in time 0.0000000000, query time of that 0.0013936880, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1463.65 < 1575.69
  -> Decision False in time 0.0000000000, query time of that 0.0014153180, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1423.48 < 1426.33
  -> Decision False in time 0.0000000000, query time of that 0.0014570120, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1115.21 < 1231.55
  -> Decision False in time 0.0100000000, query time of that 0.0014286220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 109.33000000000175
Index size:  185552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0742583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030378940, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1418.63 < 1452.52
  -> Decision False in time 0.0100000000, query time of that 0.0135383610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2399.08 < 2459.45
  -> Decision False in time 0.0300000000, query time of that 0.0241675180, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1522.39 < 1533.95
  -> Decision False in time 0.0100000000, query time of that 0.0020801290, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1049.1 < 1071.04
  -> Decision False in time 0.0100000000, query time of that 0.0024696740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1624.52 < 1628.44
  -> Decision False in time 0.0000000000, query time of that 0.0023673140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
975.721 < 1201.75
  -> Decision False in time 0.0000000000, query time of that 0.0022254440, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1441.35 < 1501.26
  -> Decision False in time 0.0100000000, query time of that 0.0021512350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
940.574 < 954.294
  -> Decision False in time 0.0100000000, query time of that 0.0025398950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 294.0199999999968
Index size:  235496.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000900000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0118806130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1058152610, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1000000000, query time of that 1.0520950550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0120500020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1233118550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3700000000, query time of that 1.2039409190, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0121278010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1266999490, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8700000000, query time of that 1.2105321690, with c1=5.0000000000, c2=0.1000000000
