Adaptive and Safe Bayesian Optimization in High Dimensions via One-Dimensional Subspaces
OPEN ACCESS
Loading...
Author / Producer
Date
2019
Publication Type
Conference Paper
ETH Bibliography
yes
Citations
Altmetric
OPEN ACCESS
Data
Rights / License
Abstract
Bayesian optimization is known to be difficult to scale to high dimensions, because the acquisition step requires solving a non-convex optimization problem in the same search space. In order to scale the method and keep its benefits, we propose an algorithm (LineBO) that restricts the problem to a sequence of iteratively chosen one-dimensional sub-problems. We show that our algorithm converges globally and obtains a fast local rate when the function is strongly convex. Further, if the objective has an invariant subspace, our method automatically adapts to the effective dimension without changing the algorithm. Our method scales well to high dimensions and makes use of a global Gaussian process model. When combined with the SafeOpt algorithm to solve the sub-problems, we obtain the first safe Bayesian optimization algorithm with theoretical guarantees applicable in high-dimensional settings. We evaluate our method on multiple synthetic benchmarks, where we obtain competitive performance. Further, we deploy our algorithm to optimize the beam intensity of the Swiss Free Electron Laser with up to 40 parameters while satisfying safe operation constraints.
Permanent link
Publication status
published
Book title
Proceedings of the 36th International Conference on Machine Learning (ICML 2019)
Journal / series
Volume
97
Pages / Article No.
3429 - 3438
Publisher
PMLR
Event
36th International Conference on Machine Learning (ICML 2019)
Edition / version
Methods
Software
Geographic location
Date collected
Date created
Subject
Organisational unit
03908 - Krause, Andreas / Krause, Andreas
Notes
Conference lecture held on June 13, 2019
Funding
159557 - Explore-exploit with Gaussian Processes under Complex Constraints (SNF)
167212 - Scaling Up by Scaling Down: Big ML via Small Coresets (SNF)
815943 - Reliable Data-Driven Decision Making in Cyber-Physical Systems (EC)
167212 - Scaling Up by Scaling Down: Big ML via Small Coresets (SNF)
815943 - Reliable Data-Driven Decision Making in Cyber-Physical Systems (EC)