Paper ID: 205
Title: Density estimation from unweighted k-nearest neighbor graphs: a roadmap
Reviews

Submitted by Assigned_Reviewer_1

Q1: Comments to author(s). First provide a summary of the paper, and then address the following criteria: Quality, clarity, originality and significance. (For detailed reviewing guidelines, see http://nips.cc/PaperInformation/ReviewerInstructions)

The paper proposes a new knn density estimation that uses only the unweighted knn adjacency graph.

The paper is readable, interesting, and the topic is important.

The main result is Theorem 5, which claims the consistency of the proposed estimator.
I really like Section 3, which explains nicely the main ideas of the paper in the simplest 1d case.

Weak points of the paper:
(i) It would have been nice to see results about the convergence rate of the estimators too, but unfortunately the authors didn’t study this question.
(ii) The proof is only a sketch, and technical details are missing.
(iii) The simulations in the paper are only meant to be a proof of concept. It would have been nice to see numerical experiments on real data where the proposed approach can work well, but it is difficult to use other density estimators. These experiments on real datasets could also motivate the paper better.


Q2: Please summarize your review in 1-2 sentences
It’s an interesting paper about a surprising result. The motivation could be improved, and numerical experiments on real datasets could demonstrate the applicability of the proposed method.

Submitted by Assigned_Reviewer_4

Q1: Comments to author(s). First provide a summary of the paper, and then address the following criteria: Quality, clarity, originality and significance. (For detailed reviewing guidelines, see http://nips.cc/PaperInformation/ReviewerInstructions)
QUALITY:
This work shows an interesting way of estimating the density of a random vector from an unweighted k-NN graph. It assumes that the density is differentiable and bounded away from zero in the epsilon-interior of the support.

Some minor points:
Page 2: in the definition of In(x), "E" has not been defined. Did the authors mean "E_n"?
Page 2: last paragraph: the unweighted shortest path distance needs to be defined.
Page 4: Proposition 1: I guess the condition n/log(k) goes to infinity must be changed to k/log(n) goes to infinity.


CLARITY:
The paper is nicely written. The main results are motivated with examples and illustrations, and the proofs of the results are sufficiently sketched.


ORIGINALITY:
The main idea is to use rectifiable paths connecting two vertices to define "order" (that is right and left) in a higher dimensional space. This is a clever idea. It is known that in Euclidean space, a weighted k-NN graph can give a rough (but asymptotically acceptable) estimate of the density. In this work, the authors conjecture that even the unweighted k-NN graph gives an estimate of the density. The authors show support for their conjecture by showing that asymptotically their procedure converges to the true density with a little more knowledge of the geometry. But as in the case of the weighted graph, for real life applications, this estimate may not be too good, unless the size of the sample is large. This is what the authors do in their simulation: n=2000 with k=50 in one or two dimensions. Higher dimensions will require an enormous quantity if data. The procedure uses the knowledge of the vector dimension. In an unweighted graph, the actual dimension may be unknown. The suggestion given by the authors to estimate it will work again only if n is very large.


SIGNIFICANCE:
I like the extended application suggested at the end of the paper for multi-dimensional scaling. This might be a good and very practical application of the procedure.

Q2: Please summarize your review in 1-2 sentences
Density estimation from a k-NN unweighted graph is suggested and conjectured to give a consistent estimate for large data size and k. The paper is based on clever geometric ideas. The results and suggestions given in the paper, if proven correct, could be used widely in applications.

Submitted by Assigned_Reviewer_5

Q1: Comments to author(s). First provide a summary of the paper, and then address the following criteria: Quality, clarity, originality and significance. (For detailed reviewing guidelines, see http://nips.cc/PaperInformation/ReviewerInstructions)
A method of estimating a density (up to constants) from an unweighted, directed k nearest neighbor graph is described. It is assumed (more or less) that the density is continuously differentiable, supported on a compact and connected subset of R^d with non-empty interior and a smooth boundary, and is upper- and lower-bounded on its support.

The method is based on two ideas. The first is to use shortest paths in the graph as a way to estimate the "orientation" of vertices in the original space, i.e. to find pairs of groups of points that, in the original embedding, are nearby, non-intersecting, and aligned with the curve that corresponds to the shortest density-weighted path in R^d (between the same endpoints).

The second idea is to integrate a quantity that can be estimated from the sets described above over the shortest paths to find the log likelihood ratio between the start and end points of the path.

The paper provides an interesting perspective on graph-based supervised and unsupervised machine learning methods, as well as their connection to a class of density-based distances that has been of interest in the community recently. Though likely of no immediate practical importance, the reviewer believes that there may be significant theoretical insights to be gained from this work.

The proof of consistency for the version of the proposed method that depends only on the k-NN graph is incomplete, as it depends on a technical conjecture. However, it is not difficult to believe that the conjecture, or at least a similar statement, holds.

Minor points:

It is worth mentioning that the proposed method for estimating the dimension from the graph in section 6 is well known in the data mining community.

In proposition 1, n/\log k \rightarrow \infty probably should read k/\log n instead.
Q2: Please summarize your review in 1-2 sentences
A method of estimating a density (up to constants) from an unweighted, directed k nearest neighbor graph is described. Though likely of no immediate practical importance, the reviewer believes that there may be significant theoretical insights to be gained from this work.
Author Feedback

Q1:Author rebuttal: Please respond to any concerns raised in the reviews. There are no constraints on how you want to argue your case, except for the fact that your text should be limited to a maximum of 6000 characters. Note however that reviewers and area chairs are very busy and may not read long vague rebuttals. It is in your own interest to be concise and to the point.
We thank the reviewers for their time, effort and comments! We will make sure to implement the suggested changes.