This is a borderline paper which the reviewers discussed after reading the rebuttal. Overall, the deep CCA method is well-motivated and executed competently; however, the presentation should be improved and some additional comparisons need to be included in the final manuscript.