Publications
CONFERENCE (INTERNATIONAL) Gaussian process nonparametric tensor estimator and its minimax optimality
Heishiro Kanagawa (Tokyo Tech), Taiji Suzuki (Tokyo Tech), Hayato Kobayashi, Nobuyuki Shimizu, Yukihiro Tagami
The 33rd International Conference on Machine Learning (ICML 2016)
June 19, 2016
We investigate the statistical efficiency of a nonparametric Gaussian process method for a nonlinear tensor estimation problem. Low-rank tensor estimation has been used as a method to learn higher order relations among several data sources in a wide range of applications, such as multi-task learning, recommendation systems, and spatiotemporal analysis. We consider a general setting where a common linear tensor learning is extended to a nonlinear learning problem in reproducing kernel Hilbert space and propose a nonparametric Bayesian method based on the Gaussian process method. We prove its statistical convergence rate without assuming any strong convexity, such as restricted strong convexity. Remarkably, it is shown that our convergence rate achieves the minimax optimal rate. We apply our proposed method to multi-task learning and show that our method significantly outperforms existing methods through numerical experiments on real-world data sets.
Paper :
Gaussian process nonparametric tensor estimator and its minimax optimality
(external link)