copying files to /scratch...
starting benchmark...
/scratch/knn/venv/lib/python3.6/site-packages/h5py/__init__.py:36: FutureWarning: Conversion of the second argument of issubdtype from `float` to `np.floating` is deprecated. In future, it will be treated as `np.float64 == np.dtype(float).type`.
  from ._conv import register_converters as _register_converters
running only hnsw
order: [Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]), Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])]
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 292.18
Index size:  457552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1083100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034309070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1290.56 < 1292.04
  -> Decision False in time 0.0300000000, query time of that 0.0166540680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1527.08 < 1534.92
  -> Decision False in time 0.0100000000, query time of that 0.0089135230, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2127.94 < 2140.89
  -> Decision False in time 0.0100000000, query time of that 0.0023124440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1393.14 < 1403.46
  -> Decision False in time 0.0100000000, query time of that 0.0018957110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1500.15 < 1535.77
  -> Decision False in time 0.0100000000, query time of that 0.0026560550, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1209.65 < 1231.54
  -> Decision False in time 0.0100000000, query time of that 0.0019596150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1463.85 < 1511.23
  -> Decision False in time 0.0300000000, query time of that 0.0029329040, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1327.94 < 1388.94
  -> Decision False in time 0.0100000000, query time of that 0.0024164620, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 301.95000000000005
Index size:  278784.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0219627710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1961218800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.9600000000, query time of that 1.9150391550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0208329770, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2141179160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.3000000000, query time of that 2.1299589490, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.0273581300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.2549553320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4800000000, query time of that 2.5612912290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 78.83000000000004
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0174433333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063283070, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0502651710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1358.51 < 1361.34
  -> Decision False in time 0.4000000000, query time of that 0.3720489240, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058875030, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1607.77 < 1618.87
  -> Decision False in time 0.0300000000, query time of that 0.0210118280, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1566.39 < 1588
  -> Decision False in time 0.1700000000, query time of that 0.1307739710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0060703700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
757.741 < 765.132
  -> Decision False in time 0.0600000000, query time of that 0.0065689000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1802.55 < 1873.14
  -> Decision False in time 0.0700000000, query time of that 0.0064910510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 78.78999999999996
Index size:  133512.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0806533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0033914330, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1866.62 < 1896.77
  -> Decision False in time 0.0100000000, query time of that 0.0084980660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1114.16 < 1193.81
  -> Decision False in time 0.0100000000, query time of that 0.0074199260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0024791870, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1652.31 < 1704.36
  -> Decision False in time 0.0000000000, query time of that 0.0028667810, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1468.96 < 1492.46
  -> Decision False in time 0.0200000000, query time of that 0.0086654310, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1040.26 < 1142.89
  -> Decision False in time 0.0100000000, query time of that 0.0030212340, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
885.694 < 886.133
  -> Decision False in time 0.0200000000, query time of that 0.0032446810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
697.678 < 699.072
  -> Decision False in time 0.0200000000, query time of that 0.0030176220, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 292.75
Index size:  236168.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0107963680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0972990570, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.9582610020, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0106394740, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1140621590, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2900000000, query time of that 1.1072828440, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0117775450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.1121374980, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2310.12 < 2364.08
  -> Decision False in time 4.3100000000, query time of that 0.5835208120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 300.6299999999999
Index size:  255064.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0345396620, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3300000000, query time of that 0.3278658600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 3.2800000000, query time of that 3.2263547990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0363260370, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3800000000, query time of that 0.3570056010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.6900000000, query time of that 3.5164551020, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0377007050, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0100000000, query time of that 0.4884580850, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.7000000000, query time of that 5.1495867490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 77.93000000000029
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0420283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0038528150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1039.47 < 1066.99
  -> Decision False in time 0.0100000000, query time of that 0.0093312410, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1402.08 < 1600.63
  -> Decision False in time 0.0100000000, query time of that 0.0061387130, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0032489820, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1122.24 < 1131.64
  -> Decision False in time 0.0100000000, query time of that 0.0037409640, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1412.53 < 1422.36
  -> Decision False in time 0.0100000000, query time of that 0.0072548140, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1097.6 < 1117.26
  -> Decision False in time 0.0300000000, query time of that 0.0035393580, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1484.45 < 1487.74
  -> Decision False in time 0.0200000000, query time of that 0.0040808080, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1130.7 < 1147.78
  -> Decision False in time 0.0100000000, query time of that 0.0039120470, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 108.26000000000022
Index size:  136556.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026133333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0095824000, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0761199720, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8100000000, query time of that 0.7569407960, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0084811540, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0882360380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2363.76 < 2397.22
  -> Decision False in time 0.0800000000, query time of that 0.0722724390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0085810540, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2410.89 < 2418.03
  -> Decision False in time 0.0700000000, query time of that 0.0089429690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1470.64 < 1480.5
  -> Decision False in time 2.0700000000, query time of that 0.2217573340, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 78.32999999999993
Index size:  180880.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5741033333
  Testing...
|S| = 20
|T| = 283
Reject!
1018.01 < 1071.74
  -> Decision False in time 0.0100000000, query time of that 0.0018424590, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1858.05 < 2228.82
  -> Decision False in time 0.0000000000, query time of that 0.0013850430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
866.322 < 945.147
  -> Decision False in time 0.0000000000, query time of that 0.0012725330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1165.38 < 1368.64
  -> Decision False in time 0.0000000000, query time of that 0.0012499650, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1141.23 < 1237.69
  -> Decision False in time 0.0000000000, query time of that 0.0012032690, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1775.75 < 1797.31
  -> Decision False in time 0.0100000000, query time of that 0.0011874060, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1542.93 < 1635.83
  -> Decision False in time 0.0000000000, query time of that 0.0011990360, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1116.22 < 1164.22
  -> Decision False in time 0.0000000000, query time of that 0.0012414220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1886.56 < 2383.34
  -> Decision False in time 0.0000000000, query time of that 0.0012579250, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 60}])
Got a train set of size (60000 * 784)
Built index in 299.72000000000025
Index size:  257644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0113982860, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1028240970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.0500000000, query time of that 1.0016598040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0118416730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.1186285450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.1744110650, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0126838200, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1922.46 < 1933.54
  -> Decision False in time 0.5200000000, query time of that 0.0820465520, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2122.56 < 2123.28
  -> Decision False in time 4.2000000000, query time of that 0.6140666900, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 78.12000000000035
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.8017566667
  Testing...
|S| = 20
|T| = 283
Reject!
1466.62 < 1546.07
  -> Decision False in time 0.0000000000, query time of that 0.0016432020, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1949.43 < 1972.95
  -> Decision False in time 0.0000000000, query time of that 0.0010509960, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2619.68 < 2648.45
  -> Decision False in time 0.0000000000, query time of that 0.0009481330, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1251.08 < 1274.53
  -> Decision False in time 0.0000000000, query time of that 0.0010224700, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1328.93 < 1335.11
  -> Decision False in time 0.0100000000, query time of that 0.0009847570, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1399.07 < 1649.73
  -> Decision False in time 0.0000000000, query time of that 0.0009268200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1951.72 < 1971.67
  -> Decision False in time 0.0000000000, query time of that 0.0009297110, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2624.52 < 2682.67
  -> Decision False in time 0.0000000000, query time of that 0.0009654110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1482.5 < 1522.93
  -> Decision False in time 0.0000000000, query time of that 0.0009245200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 128.48999999999978
Index size:  141392.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0026616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0062132640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0516126440, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5500000000, query time of that 0.5145722550, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0060823110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0607135550, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1866.36 < 1869.1
  -> Decision False in time 0.0100000000, query time of that 0.0061132110, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0062106450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0602692320, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
963.01 < 1027.53
  -> Decision False in time 0.1000000000, query time of that 0.0125516070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 300.3199999999997
Index size:  248752.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000566667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0120119520, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.1125733040, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1500000000, query time of that 1.1062751080, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0141169780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1293263260, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5300000000, query time of that 1.2759409930, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0141987890, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.1353288310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.2200000000, query time of that 1.3135942690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 108.27999999999975
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0705316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0029644170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1533.27 < 1538.88
  -> Decision False in time 0.0000000000, query time of that 0.0060443870, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1966.21 < 1974.1
  -> Decision False in time 0.0300000000, query time of that 0.0166373670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1210.46 < 1226.4
  -> Decision False in time 0.0000000000, query time of that 0.0020366200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1283.15 < 1385.28
  -> Decision False in time 0.0100000000, query time of that 0.0021586010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1371.94 < 1379.09
  -> Decision False in time 0.0100000000, query time of that 0.0022595590, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
758.903 < 775.833
  -> Decision False in time 0.0000000000, query time of that 0.0020863150, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1362.04 < 1365.73
  -> Decision False in time 0.0700000000, query time of that 0.0023650420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1872.66 < 1912.24
  -> Decision False in time 0.0100000000, query time of that 0.0026864270, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 127.65999999999985
Index size:  184108.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0137583333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0041204430, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0313979470, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2441.55 < 2460.45
  -> Decision False in time 0.0100000000, query time of that 0.0048670990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0034088990, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2204.28 < 2208.39
  -> Decision False in time 0.0500000000, query time of that 0.0239877400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2040.47 < 2065.67
  -> Decision False in time 0.0400000000, query time of that 0.0203860330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1229.11 < 1266.38
  -> Decision False in time 0.0300000000, query time of that 0.0037143600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1785.74 < 1792.35
  -> Decision False in time 0.0200000000, query time of that 0.0042106110, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
938.533 < 951.954
  -> Decision False in time 0.0900000000, query time of that 0.0057644970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 128.17000000000007
Index size:  188808.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0224750000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0037269050, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0270026050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
962.768 < 1013.96
  -> Decision False in time 0.1000000000, query time of that 0.0856385440, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1542.76 < 1567.17
  -> Decision False in time 0.0100000000, query time of that 0.0028409780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1748.59 < 1796.53
  -> Decision False in time 0.0300000000, query time of that 0.0156799870, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1177.06 < 1179.4
  -> Decision False in time 0.1900000000, query time of that 0.0780911070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1119.73 < 1194.1
  -> Decision False in time 0.0700000000, query time of that 0.0033035490, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1401.83 < 1416.49
  -> Decision False in time 0.2000000000, query time of that 0.0104651390, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1081.37 < 1202.67
  -> Decision False in time 0.2300000000, query time of that 0.0102645710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 292.0599999999995
Index size:  235896.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015083333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0058665880, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0471571250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5100000000, query time of that 0.4613201190, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0050583490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1824.75 < 1857.9
  -> Decision False in time 0.0200000000, query time of that 0.0160431720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1862.3 < 1884.02
  -> Decision False in time 0.0600000000, query time of that 0.0377105260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0056507380, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0556270370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
726.053 < 749.872
  -> Decision False in time 2.0600000000, query time of that 0.1362705120, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 140}])
Got a train set of size (60000 * 784)
Built index in 298.8699999999999
Index size:  265788.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0186383210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1705031430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.7500000000, query time of that 1.7001320780, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0191780760, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2200000000, query time of that 0.1896951340, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.0600000000, query time of that 1.9449161460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0210219480, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.2075344920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.6900000000, query time of that 2.0191318140, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 108.34000000000015
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0042483333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0059227470, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0512721650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5185128410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0056442780, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1054.7 < 1056.65
  -> Decision False in time 0.0500000000, query time of that 0.0307198090, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2237.41 < 2469.99
  -> Decision False in time 0.0800000000, query time of that 0.0585533260, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0061713620, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
918.374 < 948.228
  -> Decision False in time 0.6300000000, query time of that 0.0465265670, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1349.92 < 1358.59
  -> Decision False in time 0.0200000000, query time of that 0.0067342200, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 129.21000000000004
Index size:  183928.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009233333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099473780, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0933584950, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9500000000, query time of that 0.9098877680, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0106420040, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1043547120, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.0444374450, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0112440020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1035864420, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1423.27 < 1448.07
  -> Decision False in time 1.1200000000, query time of that 0.1459064360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 160}])
Got a train set of size (60000 * 784)
Built index in 109.16000000000076
Index size:  188552.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0021733333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0103363190, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0918464560, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.9063097990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0099367250, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1067300770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.0530998900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0113852020, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1043300270, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
879.402 < 956.228
  -> Decision False in time 0.0600000000, query time of that 0.0107785360, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 293.1400000000003
Index size:  238700.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0001616667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0100864090, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0807979790, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7766236280, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0088001200, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0883372740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1475.99 < 1499.31
  -> Decision False in time 0.8900000000, query time of that 0.8174363790, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0093665750, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1805.17 < 1920.02
  -> Decision False in time 0.5900000000, query time of that 0.0691082470, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8500000000, query time of that 0.9017863950, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 109.0
Index size:  198992.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0272383333
  Testing...
|S| = 20
|T| = 283
Reject!
1665.9 < 1729.35
  -> Decision False in time 0.0100000000, query time of that 0.0027413650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0258072050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1902.67 < 2008.41
  -> Decision False in time 0.0200000000, query time of that 0.0162071350, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0027093320, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1261.08 < 1270.58
  -> Decision False in time 0.0200000000, query time of that 0.0063142400, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
942.288 < 949.653
  -> Decision False in time 0.0100000000, query time of that 0.0063942600, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2342.97 < 2429.2
  -> Decision False in time 0.0100000000, query time of that 0.0029618700, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1268.82 < 1279.67
  -> Decision False in time 0.0000000000, query time of that 0.0032967010, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
995.236 < 1011.14
  -> Decision False in time 0.2400000000, query time of that 0.0095865970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 400}])
Got a train set of size (60000 * 784)
Built index in 292.4200000000001
Index size:  228800.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0318850660, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.3100000000, query time of that 0.3028484630, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.9200000000, query time of that 2.8706135410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0308478260, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3500000000, query time of that 0.3196347020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.4500000000, query time of that 3.2305824520, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0344881030, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 1.0000000000, query time of that 0.4410465930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1458.06 < 1559.93
  -> Decision False in time 5.2900000000, query time of that 2.7160129650, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 298.6099999999997
Index size:  265768.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0009316667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0063740210, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0528187100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5600000000, query time of that 0.5188567660, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0058478230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0602779580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1946.22 < 2000.97
  -> Decision False in time 0.2100000000, query time of that 0.1577347380, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0059915040, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0622840820, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1615.45 < 1630.05
  -> Decision False in time 1.2000000000, query time of that 0.0943070790, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 20}])
Got a train set of size (60000 * 784)
Built index in 78.18000000000029
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1143283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028211930, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2314.49 < 2512.88
  -> Decision False in time 0.0000000000, query time of that 0.0027100430, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2215.77 < 2515.67
  -> Decision False in time 0.0200000000, query time of that 0.0104126070, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1504.62 < 1518.64
  -> Decision False in time 0.0000000000, query time of that 0.0020323460, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1388.52 < 1429.84
  -> Decision False in time 0.0000000000, query time of that 0.0021680990, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1735.8 < 1743.86
  -> Decision False in time 0.0100000000, query time of that 0.0023409960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1926.13 < 1976.3
  -> Decision False in time 0.0100000000, query time of that 0.0024768300, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1042.06 < 1066.24
  -> Decision False in time 0.0000000000, query time of that 0.0024768710, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2095.84 < 2119.8
  -> Decision False in time 0.0000000000, query time of that 0.0021512070, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 78.81999999999971
Index size:  141832.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0306550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0054383890, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0394900930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1959.96 < 2026.86
  -> Decision False in time 0.0500000000, query time of that 0.0449846170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1812.68 < 1867.93
  -> Decision False in time 0.0100000000, query time of that 0.0041620180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2104.61 < 2189.5
  -> Decision False in time 0.0000000000, query time of that 0.0049268030, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1196.88 < 1246.84
  -> Decision False in time 0.0100000000, query time of that 0.0045375180, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1489.72 < 1506.34
  -> Decision False in time 0.0100000000, query time of that 0.0049705600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1117.85 < 1122.27
  -> Decision False in time 0.1600000000, query time of that 0.0090230550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1097.67 < 1119.97
  -> Decision False in time 0.0000000000, query time of that 0.0046941510, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 290.28999999999996
Index size:  229084.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0252100000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0035313680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0247564970, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2161.99 < 2265.76
  -> Decision False in time 0.1900000000, query time of that 0.1644408640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1428.29 < 1440.3
  -> Decision False in time 0.0000000000, query time of that 0.0025497390, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1484.66 < 1503.64
  -> Decision False in time 0.0100000000, query time of that 0.0029322110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1587.04 < 1625.57
  -> Decision False in time 0.0400000000, query time of that 0.0188051050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1040.89 < 1042.18
  -> Decision False in time 0.0300000000, query time of that 0.0030357920, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1034.09 < 1053.51
  -> Decision False in time 0.1200000000, query time of that 0.0063501170, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1478.9 < 1497.47
  -> Decision False in time 0.0600000000, query time of that 0.0032156550, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 300}])
Got a train set of size (60000 * 784)
Built index in 300.1900000000005
Index size:  261976.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0283400150, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2800000000, query time of that 0.2766039590, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.7200000000, query time of that 2.6749220670, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0295960110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.3200000000, query time of that 0.2879783180, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 3.1400000000, query time of that 3.0165776050, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0335009590, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9900000000, query time of that 0.4021306350, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4800000000, query time of that 4.1908299490, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 292.4300000000003
Index size:  193956.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0198873170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1865453340, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.8800000000, query time of that 1.8268311510, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0197478020, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2400000000, query time of that 0.2061756480, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.2600000000, query time of that 2.0930945680, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0223863840, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2585659720, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9200000000, query time of that 2.6518177390, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 109.70999999999913
Index size:  202408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3380083333
  Testing...
|S| = 20
|T| = 283
Reject!
1918.43 < 2016.43
  -> Decision False in time 0.0100000000, query time of that 0.0017321700, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1643.5 < 1750.2
  -> Decision False in time 0.0100000000, query time of that 0.0032490710, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1702.15 < 1879.76
  -> Decision False in time 0.0000000000, query time of that 0.0013929860, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1770.84 < 1779.86
  -> Decision False in time 0.0100000000, query time of that 0.0011857490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
2280.39 < 2501.67
  -> Decision False in time 0.0000000000, query time of that 0.0011904380, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1212.34 < 1216.28
  -> Decision False in time 0.0100000000, query time of that 0.0011820510, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1202.61 < 1368.52
  -> Decision False in time 0.0000000000, query time of that 0.0011534820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1811.45 < 1812.55
  -> Decision False in time 0.0100000000, query time of that 0.0011262450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1450.48 < 1461.83
  -> Decision False in time 0.0000000000, query time of that 0.0011432060, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 79.53999999999905
Index size:  186664.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0267550000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0055863180, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2229.46 < 2296.66
  -> Decision False in time 0.0300000000, query time of that 0.0279220680, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2616.32 < 2787.74
  -> Decision False in time 0.0600000000, query time of that 0.0549318390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0049341660, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1316.83 < 1329.36
  -> Decision False in time 0.0200000000, query time of that 0.0107255010, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1195.64 < 1208.53
  -> Decision False in time 0.0200000000, query time of that 0.0164144330, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2099.13 < 2482.02
  -> Decision False in time 0.0100000000, query time of that 0.0052952450, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1513.8 < 1565.13
  -> Decision False in time 0.0200000000, query time of that 0.0052717730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1181.87 < 1190.1
  -> Decision False in time 0.1600000000, query time of that 0.0113942760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 301.4499999999989
Index size:  262164.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0131093760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1190242780, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.2400000000, query time of that 1.1914628170, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0149984340, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1700000000, query time of that 0.1389339530, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.5500000000, query time of that 1.3933100530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0149896060, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1452658280, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1922.46 < 1933.54
  -> Decision False in time 6.4100000000, query time of that 1.1037029630, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 108.8799999999992
Index size:  188492.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.5916016667
  Testing...
|S| = 20
|T| = 283
Reject!
2251.94 < 2319.73
  -> Decision False in time 0.0100000000, query time of that 0.0018580580, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1074.22 < 1187.73
  -> Decision False in time 0.0000000000, query time of that 0.0020414240, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1234.1 < 1255.22
  -> Decision False in time 0.0100000000, query time of that 0.0016436640, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1452.14 < 1504.64
  -> Decision False in time 0.0000000000, query time of that 0.0012857050, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1760.72 < 1868.15
  -> Decision False in time 0.0100000000, query time of that 0.0013406940, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1063.03 < 1078.81
  -> Decision False in time 0.0000000000, query time of that 0.0011686710, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1641.13 < 1722.6
  -> Decision False in time 0.0100000000, query time of that 0.0012584870, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1054.29 < 1126.4
  -> Decision False in time 0.0000000000, query time of that 0.0012696550, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1595.34 < 1603.51
  -> Decision False in time 0.0100000000, query time of that 0.0011751540, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 299.5899999999983
Index size:  247712.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0145344170, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1279271930, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3600000000, query time of that 1.3065632990, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0162444420, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1625.61 < 1627.94
  -> Decision False in time 0.0800000000, query time of that 0.0720111960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7000000000, query time of that 1.5083190240, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0152644120, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1585383810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.1000000000, query time of that 1.5513379370, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 292.59000000000015
Index size:  194180.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000466667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0154188960, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1396830150, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.3900000000, query time of that 1.3385763410, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0145087600, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1800000000, query time of that 0.1533750450, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.6800000000, query time of that 1.5450473200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0146431820, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8800000000, query time of that 0.1625276370, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.7000000000, query time of that 1.6761377710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 128.92000000000007
Index size:  204904.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0407383333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0030817130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2465.57 < 2476.44
  -> Decision False in time 0.0200000000, query time of that 0.0172308830, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1063.13 < 1065.92
  -> Decision False in time 0.0800000000, query time of that 0.0607955890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1033.14 < 1063.37
  -> Decision False in time 0.0000000000, query time of that 0.0024178010, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
975.126 < 981.153
  -> Decision False in time 0.0100000000, query time of that 0.0027952370, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1256.61 < 1328.73
  -> Decision False in time 0.0300000000, query time of that 0.0118152890, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
574.297 < 580.534
  -> Decision False in time 0.0200000000, query time of that 0.0026547530, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1397.86 < 1421.97
  -> Decision False in time 0.0100000000, query time of that 0.0030266240, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1008.54 < 1011.78
  -> Decision False in time 0.0100000000, query time of that 0.0027408290, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 299.2099999999991
Index size:  250532.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002000000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0088065030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0788224370, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.8300000000, query time of that 0.7825212260, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0083351180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0911896000, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.1600000000, query time of that 0.9125853770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0096571220, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0892551830, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1797.17 < 1808.39
  -> Decision False in time 0.2500000000, query time of that 0.0310039810, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 128.35000000000036
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0015416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082195710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0727105500, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6992603270, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0082218490, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1200000000, query time of that 0.0830558770, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1422.86 < 1831.48
  -> Decision False in time 0.4700000000, query time of that 0.4365469270, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0084451990, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9200000000, query time of that 0.0847451310, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
817.686 < 826.447
  -> Decision False in time 2.3000000000, query time of that 0.2325486800, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 109.6299999999992
Index size:  164584.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1568083333
  Testing...
|S| = 20
|T| = 283
Reject!
1850.43 < 1922.15
  -> Decision False in time 0.0000000000, query time of that 0.0024566640, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
906.131 < 920.827
  -> Decision False in time 0.0100000000, query time of that 0.0061526890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1113.92 < 1140.13
  -> Decision False in time 0.0200000000, query time of that 0.0125882970, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
2291.64 < 2322.2
  -> Decision False in time 0.0000000000, query time of that 0.0016006730, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1179.65 < 1216.16
  -> Decision False in time 0.0000000000, query time of that 0.0017068970, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1621.92 < 1672.94
  -> Decision False in time 0.0100000000, query time of that 0.0018380420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1771.42 < 1785.88
  -> Decision False in time 0.0000000000, query time of that 0.0018900910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1252.32 < 1261.5
  -> Decision False in time 0.0100000000, query time of that 0.0019519900, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1035.83 < 1050.84
  -> Decision False in time 0.0000000000, query time of that 0.0019208460, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 1}])
Got a train set of size (60000 * 784)
Built index in 128.1800000000003
Index size:  192288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.4961116667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0020142680, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
989.205 < 1033.1
  -> Decision False in time 0.0000000000, query time of that 0.0021628660, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1342.08 < 1424.88
  -> Decision False in time 0.0000000000, query time of that 0.0029750560, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1658.1 < 1659.56
  -> Decision False in time 0.0000000000, query time of that 0.0014883110, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1904.88 < 2129.29
  -> Decision False in time 0.0000000000, query time of that 0.0013680740, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1013.11 < 1015.25
  -> Decision False in time 0.0000000000, query time of that 0.0014773390, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1646.36 < 1657.18
  -> Decision False in time 0.0000000000, query time of that 0.0014760010, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
886.472 < 910.57
  -> Decision False in time 0.0000000000, query time of that 0.0014046000, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1883.96 < 2190.01
  -> Decision False in time 0.0000000000, query time of that 0.0014146640, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 200}])
Got a train set of size (60000 * 784)
Built index in 301.6200000000008
Index size:  253408.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000166667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0224036760, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.2300000000, query time of that 0.2171410600, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 2.1200000000, query time of that 2.0708265400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0228405440, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2600000000, query time of that 0.2217003430, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 2.5100000000, query time of that 2.3504953960, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0246216280, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.2853525870, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9400000000, query time of that 2.9087918750, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 79.19000000000051
Index size:  186644.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.3787216667
  Testing...
|S| = 20
|T| = 283
Reject!
1075.27 < 1081.24
  -> Decision False in time 0.0000000000, query time of that 0.0023478740, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
2927.89 < 2985.75
  -> Decision False in time 0.0100000000, query time of that 0.0015388260, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1782.99 < 1925.42
  -> Decision False in time 0.0000000000, query time of that 0.0033611890, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1945.96 < 2038.45
  -> Decision False in time 0.0000000000, query time of that 0.0014348970, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1952.77 < 2498.52
  -> Decision False in time 0.0000000000, query time of that 0.0014381110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1195.74 < 1268.7
  -> Decision False in time 0.0100000000, query time of that 0.0014520120, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1183 < 1285.68
  -> Decision False in time 0.0000000000, query time of that 0.0014188830, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2798.73 < 2998.04
  -> Decision False in time 0.0000000000, query time of that 0.0013804690, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
639.136 < 724.254
  -> Decision False in time 0.0000000000, query time of that 0.0013613160, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 90}])
Got a train set of size (60000 * 784)
Built index in 109.67000000000007
Index size:  139288.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0032250000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0071722450, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0639996650, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1530.52 < 1540.56
  -> Decision False in time 0.4900000000, query time of that 0.4585771530, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0070758800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0749433960, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1234.63 < 1276.4
  -> Decision False in time 0.0600000000, query time of that 0.0555547610, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0073887330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0724654330, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1721.1 < 1727.41
  -> Decision False in time 2.1500000000, query time of that 0.1969107690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 293.8199999999997
Index size:  231944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0061200000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0043117770, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0326809800, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1648.9 < 1658.94
  -> Decision False in time 0.2800000000, query time of that 0.2512823420, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0036953830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1329.41 < 1354.76
  -> Decision False in time 0.0100000000, query time of that 0.0079279100, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1119.04 < 1132.28
  -> Decision False in time 0.1700000000, query time of that 0.0884696920, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0039898170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1994.26 < 2024.27
  -> Decision False in time 0.3100000000, query time of that 0.0167768770, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1303.96 < 1338.29
  -> Decision False in time 0.1700000000, query time of that 0.0101588590, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 15}])
Got a train set of size (60000 * 784)
Built index in 294.0699999999997
Index size:  238724.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0027933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0053441970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0408353860, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1330.81 < 1337.28
  -> Decision False in time 0.1600000000, query time of that 0.1386168090, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0043793480, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0466664160, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1003.78 < 1005.44
  -> Decision False in time 0.6800000000, query time of that 0.3945992070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0048377170, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1375.19 < 1392.79
  -> Decision False in time 0.1200000000, query time of that 0.0099636810, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
2058.45 < 2118.4
  -> Decision False in time 0.8300000000, query time of that 0.0509130970, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 293.34999999999854
Index size:  244748.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0005816667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0072737730, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0600000000, query time of that 0.0601449620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6400000000, query time of that 0.5836906210, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0065655190, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0676170290, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9300000000, query time of that 0.6649840160, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0065893350, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
2336.06 < 2388.89
  -> Decision False in time 0.3700000000, query time of that 0.0313033990, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1540.11 < 1604.9
  -> Decision False in time 0.6000000000, query time of that 0.0510313350, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 300.75
Index size:  255192.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000983333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0097468230, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0929651550, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.9400000000, query time of that 0.8966365100, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0112053230, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.1046401420, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2122.56 < 2123.28
  -> Decision False in time 0.4700000000, query time of that 0.4499042100, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0118035330, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.1035100730, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1934.9 < 1997.39
  -> Decision False in time 4.0900000000, query time of that 0.5010784690, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 2}])
Got a train set of size (60000 * 784)
Built index in 128.04000000000087
Index size:  190340.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2549766667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0024529710, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
708.328 < 791.785
  -> Decision False in time 0.0100000000, query time of that 0.0074591910, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1239.06 < 1253.42
  -> Decision False in time 0.0000000000, query time of that 0.0017419040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1493.77 < 1543.5
  -> Decision False in time 0.0100000000, query time of that 0.0016379720, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1045.88 < 1046.57
  -> Decision False in time 0.0000000000, query time of that 0.0017521720, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1019.95 < 1105.89
  -> Decision False in time 0.0000000000, query time of that 0.0016937900, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
862.582 < 947.67
  -> Decision False in time 0.0000000000, query time of that 0.0017511160, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1136.19 < 1141.97
  -> Decision False in time 0.0100000000, query time of that 0.0017483480, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1764.12 < 1811.59
  -> Decision False in time 0.0000000000, query time of that 0.0017704770, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 70}])
Got a train set of size (60000 * 784)
Built index in 128.70000000000073
Index size:  173944.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0016533333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0074784650, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0668688890, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.6900000000, query time of that 0.6439764770, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0077149800, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0743635580, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
2039.07 < 2076.78
  -> Decision False in time 0.7800000000, query time of that 0.6841996560, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0073963760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9000000000, query time of that 0.0732143400, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1374.06 < 1461.69
  -> Decision False in time 1.4700000000, query time of that 0.1354455700, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 128.07999999999993
Index size:  185256.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0037633333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0060005400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0476483620, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.5000000000, query time of that 0.4503406700, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0048860080, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1108.88 < 1115.63
  -> Decision False in time 0.0700000000, query time of that 0.0470575050, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1013.99 < 1015.05
  -> Decision False in time 0.1000000000, query time of that 0.0610402420, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1300000000, query time of that 0.0052025600, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1737.97 < 1753.91
  -> Decision False in time 0.4100000000, query time of that 0.0297643220, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1734.87 < 2092.74
  -> Decision False in time 1.2500000000, query time of that 0.0811693010, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 120}])
Got a train set of size (60000 * 784)
Built index in 299.34000000000015
Index size:  252540.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000300000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0173196240, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1549316420, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.5900000000, query time of that 1.5390199390, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0194957180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.2100000000, query time of that 0.1797969930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.9300000000, query time of that 1.7895452350, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.0197465760, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9800000000, query time of that 0.2083484380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 9.4100000000, query time of that 2.0111567410, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 100}])
Got a train set of size (60000 * 784)
Built index in 300.0699999999997
Index size:  202572.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000416667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0152665280, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1400000000, query time of that 0.1304858740, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.4200000000, query time of that 1.3599364400, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0300000000, query time of that 0.0155601280, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1900000000, query time of that 0.1642430240, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.7200000000, query time of that 1.5971138200, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0169060910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1606065160, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1509.94 < 1584.3
  -> Decision False in time 0.4700000000, query time of that 0.0997363020, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 128.6299999999992
Index size:  191444.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0064033333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0048064750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0394559840, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1721.69 < 1754.07
  -> Decision False in time 0.0200000000, query time of that 0.0148549290, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1598.92 < 1599.45
  -> Decision False in time 0.0100000000, query time of that 0.0039792850, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
752.531 < 801.036
  -> Decision False in time 0.0400000000, query time of that 0.0275113900, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1230.05 < 1238.11
  -> Decision False in time 0.1200000000, query time of that 0.0707389770, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0046742720, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1223.67 < 1333.42
  -> Decision False in time 0.0300000000, query time of that 0.0051425930, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
962.822 < 967.301
  -> Decision False in time 0.1200000000, query time of that 0.0097244210, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 4, 'post': 0, 'efConstruction': 400}, False, {'ef': 10}])
Got a train set of size (60000 * 784)
Built index in 79.04000000000087
Index size:  177576.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.2468866667
  Testing...
|S| = 20
|T| = 283
Reject!
1164.59 < 1260.91
  -> Decision False in time 0.0000000000, query time of that 0.0024959400, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1080.58 < 1258.6
  -> Decision False in time 0.0100000000, query time of that 0.0028157380, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2439.11 < 2627.18
  -> Decision False in time 0.0100000000, query time of that 0.0076757380, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1972.64 < 2185.4
  -> Decision False in time 0.0000000000, query time of that 0.0015841790, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1834.51 < 1873.3
  -> Decision False in time 0.0000000000, query time of that 0.0016418830, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
625.094 < 1071.08
  -> Decision False in time 0.0000000000, query time of that 0.0015976460, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
2012.91 < 2202.08
  -> Decision False in time 0.0100000000, query time of that 0.0017738260, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1672.02 < 1678.5
  -> Decision False in time 0.0000000000, query time of that 0.0018119750, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1936.82 < 2572.58
  -> Decision False in time 0.0000000000, query time of that 0.0016940400, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 80}])
Got a train set of size (60000 * 784)
Built index in 292.0799999999981
Index size:  234308.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0000933333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0116639130, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.1065199350, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 1.1000000000, query time of that 1.0467576060, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0120885670, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1600000000, query time of that 0.1219216110, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 1.3800000000, query time of that 1.2049175480, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.1500000000, query time of that 0.0123419400, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.8900000000, query time of that 0.1178868920, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.8600000000, query time of that 1.1956027730, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 20, 'post': 2, 'efConstruction': 400}, False, {'ef': 40}])
Got a train set of size (60000 * 784)
Built index in 291.6100000000006
Index size:  245500.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0002866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0082662970, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0700000000, query time of that 0.0707020100, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7400000000, query time of that 0.6898776040, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076913830, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1000000000, query time of that 0.0802865460, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9600000000, query time of that 0.7840163290, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0082602910, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0786370380, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Accept!
  -> Decision True in time 8.9000000000, query time of that 0.8067231000, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 12, 'post': 0, 'efConstruction': 400}, False, {'ef': 5}])
Got a train set of size (60000 * 784)
Built index in 129.09999999999854
Index size:  204680.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.1058283333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0000000000, query time of that 0.0028492750, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Reject!
1198.9 < 1282.6
  -> Decision False in time 0.0100000000, query time of that 0.0030890250, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
2845.72 < 2864.34
  -> Decision False in time 0.0100000000, query time of that 0.0042107200, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Reject!
1369.75 < 1379.35
  -> Decision False in time 0.0000000000, query time of that 0.0015463180, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1546.27 < 1570.6
  -> Decision False in time 0.0100000000, query time of that 0.0015436250, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1175.73 < 1188.82
  -> Decision False in time 0.0000000000, query time of that 0.0016267530, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
734.523 < 784.184
  -> Decision False in time 0.0100000000, query time of that 0.0016494740, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1573.89 < 1618.87
  -> Decision False in time 0.0100000000, query time of that 0.0021527290, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1099.6 < 1122.41
  -> Decision False in time 0.0100000000, query time of that 0.0016859710, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 109.63999999999942
Index size:  181760.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0144866667
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0040137920, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0400000000, query time of that 0.0318370540, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1679.16 < 1689.46
  -> Decision False in time 0.2000000000, query time of that 0.1799071010, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0033923550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0375145930, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1739.8 < 1749.49
  -> Decision False in time 0.1100000000, query time of that 0.0533017070, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1169.62 < 1173.87
  -> Decision False in time 0.0300000000, query time of that 0.0038624550, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1055.45 < 1088.93
  -> Decision False in time 0.0700000000, query time of that 0.0040914340, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1326.32 < 1342.47
  -> Decision False in time 0.0800000000, query time of that 0.0059249260, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 8, 'post': 0, 'efConstruction': 400}, False, {'ef': 50}])
Got a train set of size (60000 * 784)
Built index in 109.63999999999942
Index size:  183364.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0067150000
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0054571490, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0500000000, query time of that 0.0435966130, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Reject!
1235.62 < 1236.19
  -> Decision False in time 0.2200000000, query time of that 0.2090024460, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0046854550, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Reject!
1602.53 < 1705.8
  -> Decision False in time 0.0000000000, query time of that 0.0063073020, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Reject!
1059.78 < 1075.92
  -> Decision False in time 0.1800000000, query time of that 0.1124934280, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Reject!
1298.96 < 1303.15
  -> Decision False in time 0.0200000000, query time of that 0.0049333660, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Reject!
1593.41 < 1640.32
  -> Decision False in time 0.3200000000, query time of that 0.0210078860, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1561.5 < 1565.02
  -> Decision False in time 0.0200000000, query time of that 0.0053343760, with c1=5.0000000000, c2=0.1000000000
Definition(algorithm='hnsw', constructor='NmslibReuseIndex', module='ann_benchmarks.algorithms.nmslib', docker_tag='ann-benchmarks-nmslib', arguments=['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}]) ...
Trying to instantiate ann_benchmarks.algorithms.nmslib.NmslibReuseIndex(['euclidean', 'hnsw', {'M': 32, 'post': 2, 'efConstruction': 400}, False, {'ef': 30}])
Got a train set of size (60000 * 784)
Built index in 300.98999999999796
Index size:  257292.0
Run 1/1...
  Calculating distance...
  -> Distance: 0.0003783333
  Testing...
|S| = 20
|T| = 283
Accept!
  -> Decision True in time 0.0100000000, query time of that 0.0076903030, with c1=0.0500000000, c2=0.0010000000
|S| = 196
|T| = 283
Accept!
  -> Decision True in time 0.0800000000, query time of that 0.0672400050, with c1=0.0500000000, c2=0.0100000000
|S| = 1960
|T| = 283
Accept!
  -> Decision True in time 0.7000000000, query time of that 0.6512907800, with c1=0.0500000000, c2=0.1000000000
|S| = 20
|T| = 2821
Accept!
  -> Decision True in time 0.0200000000, query time of that 0.0076108070, with c1=0.5000000000, c2=0.0010000000
|S| = 196
|T| = 2821
Accept!
  -> Decision True in time 0.1100000000, query time of that 0.0767068660, with c1=0.5000000000, c2=0.0100000000
|S| = 1960
|T| = 2821
Accept!
  -> Decision True in time 0.9700000000, query time of that 0.7522890840, with c1=0.5000000000, c2=0.1000000000
|S| = 20
|T| = 28201
Accept!
  -> Decision True in time 0.0900000000, query time of that 0.0070774230, with c1=5.0000000000, c2=0.0010000000
|S| = 196
|T| = 28201
Accept!
  -> Decision True in time 0.9100000000, query time of that 0.0760780450, with c1=5.0000000000, c2=0.0100000000
|S| = 1960
|T| = 28201
Reject!
1598.42 < 1601
  -> Decision False in time 1.6800000000, query time of that 0.1546911630, with c1=5.0000000000, c2=0.1000000000
