Scaling Gaussian Process Regression with Derivatives.
ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 31 (NIPS 2018)(2018)
摘要
Gaussian processes (GPs) with derivatives are useful in many applications, including Bayesian optimization, implicit surface reconstruction, and terrain reconstruction. Fitting a GP to function values and derivatives at n points in d dimensions requires linear solves and log determinants with an n(d + 1) x n(d + 1) positive definite matrix - leading to prohibitive O(n(3)d(3)) computations for standard direct methods. We propose iterative solvers using fast O(nd) matrix-vector multiplications (MVMs), together with pivoted Cholesky preconditioning that cuts the iterations to convergence by several orders of magnitude, allowing for fast kernel learning and prediction. Our approaches, together with dimensionality reduction, enables Bayesian optimization with derivatives to scale to high-dimensional problems and large evaluation budgets.
更多查看译文
关键词
gaussian processes,dimensionality reduction,gaussian process regression,bayesian optimization,positive definite matrix
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络