Constrained Bayesian Optimisation with Multiple Information Sources
Pith reviewed 2026-07-02 15:50 UTC · model grok-4.3
The pith
A multi-source framework extends constrained Bayesian optimization to use auxiliary data sources for faster feasible region discovery.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
We propose a general multi-source framework that extends constrained Max-value Entropy Search, capturing inter-source correlation while balancing evaluation cost and information gain. Experiments on both synthetic and physics-based benchmarks show that our method efficiently identifies feasible and optimal solutions, even when auxiliary data are only weakly correlated. The proposed approach consistently outperforms existing methods, particularly in early-stage exploration.
What carries the argument
Multi-source extension of constrained Max-value Entropy Search incorporating inter-source correlations and cost-information trade-offs.
If this is right
- The method identifies feasible and optimal solutions efficiently on synthetic and physics benchmarks.
- It outperforms existing methods especially during initial exploration phases.
- It remains effective when auxiliary sources are only weakly correlated with the primary objective.
Where Pith is reading between the lines
- This could allow optimization in domains like structural design where multiple simulation levels are available.
- Further work might test the framework on problems with more than two sources or varying correlation strengths.
- One could check if the correlation modeling adds value beyond just using cheaper sources independently.
Load-bearing premise
That auxiliary information sources exist and can be correlated with the primary objective and constraints in a way that yields useful information for the search.
What would settle it
Running the method on a benchmark where auxiliary sources provide no correlation or negative information and observing if it still outperforms single-source constrained BO or fails to find feasible points.
Figures
read the original abstract
Bayesian Optimisation (BO) under unknown constraints is particularly challenging when feasible regions are small. In such settings, existing methods that typically rely solely on evaluations of the true objective and constraints struggle to efficiently explore the design space. However, many real-world applications offer auxiliary data sources (e.g. surrogate models or simplified simulations) that can support early exploration. Despite this potential, their integration into constrained BO remains largely unexplored. We propose a general multi-source framework that extends constrained Max-value Entropy Search, capturing inter-source correlation while balancing evaluation cost and information gain. Experiments on both synthetic and physics-based benchmarks show that our method efficiently identifies feasible and optimal solutions, even when auxiliary data are only weakly correlated. The proposed approach consistently outperforms existing methods, particularly in early-stage exploration.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a general multi-source framework that extends constrained Max-value Entropy Search (MES) to incorporate auxiliary information sources. The method captures inter-source correlations while balancing evaluation cost and information gain. Experiments on synthetic and physics-based benchmarks are claimed to show that the approach efficiently identifies feasible and optimal solutions even when auxiliary data are only weakly correlated, and that it consistently outperforms existing methods, especially during early-stage exploration.
Significance. If the central claims hold under rigorous validation, the work would address a practical gap in constrained Bayesian optimization by showing how auxiliary sources (e.g., surrogate models or simplified simulations) can be integrated even under weak correlation. This could improve sample efficiency in domains where feasible regions are small and multi-fidelity data are available.
major comments (1)
- [Abstract] The abstract states that experiments 'show that our method efficiently identifies feasible and optimal solutions' and that the approach 'consistently outperforms existing methods,' yet no information is supplied on experimental setup, baselines, number of independent runs, statistical tests, or quantitative metrics. Without these details the support for the central empirical claim cannot be assessed.
Simulated Author's Rebuttal
We thank the referee for the constructive feedback on the abstract. We address the comment below and will revise the manuscript accordingly.
read point-by-point responses
-
Referee: [Abstract] The abstract states that experiments 'show that our method efficiently identifies feasible and optimal solutions' and that the approach 'consistently outperforms existing methods,' yet no information is supplied on experimental setup, baselines, number of independent runs, statistical tests, or quantitative metrics. Without these details the support for the central empirical claim cannot be assessed.
Authors: We agree that the abstract, owing to its length constraints, omits specific experimental details. The full manuscript provides these in Section 5: the experimental setup uses both synthetic functions and physics-based benchmarks; baselines include standard constrained MES, multi-fidelity variants, and random search; results are reported over 20 independent runs with mean and standard error; performance is quantified via cumulative regret, feasibility rate, and simple regret; statistical comparisons use paired t-tests at p<0.05. To strengthen the abstract's claims, we will revise it to briefly reference the number of runs and primary metrics while retaining its concise form. revision: yes
Circularity Check
No significant circularity detected
full rationale
The abstract and available description present a multi-source extension of constrained Max-value Entropy Search that balances evaluation cost and information gain, validated on synthetic and physics-based benchmarks. No equations, derivations, or self-citations are shown that reduce any prediction or uniqueness claim to fitted inputs or prior author work by construction. The central claim rests on experimental outperformance under weak correlation, which is externally falsifiable and does not rely on self-referential fitting or renaming of known results.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
Bayesian
Gardner, Jacob R and Kusner, Matt J and Jake, Gardner , year =. Bayesian
-
[2]
Bayesian
Gelbart, Michael A and Snoek, Jasper and Adams, Ryan P , year =. Bayesian
-
[3]
and Adams, Ryan P
Hernández-Lobato, José Miguel and Gelbart, Michael A. and Adams, Ryan P. and Hoffman, Matthew W. and Ghahramani, Zoubin , month = sep, year =. A
-
[4]
Eriksson, David and Dong, Kun and Lee, Eric Hans and Bindel, David and Wilson, Andrew Gordon , month = oct, year =. Scaling
-
[5]
, month = jul, year =
Frazier, Peter I. , month = jul, year =. A
-
[6]
Scalable
Eriksson, David and Pearce, Michael and Gardner, Jacob and Turner, Ryan D and Poloczek, Matthias , year =. Scalable
-
[7]
Scalable
Eriksson, David and Poloczek, Matthias , month = feb, year =. Scalable
-
[8]
and Turner, Ryan and Poloczek, Matthias , month = feb, year =
Eriksson, David and Pearce, Michael and Gardner, Jacob R. and Turner, Ryan and Poloczek, Matthias , month = feb, year =. Scalable
-
[9]
Eriksson, David and Jankowiak, Martin , month = jun, year =. High-
-
[10]
Rasmussen, Carl Edward and Williams, Christopher K. I. , year =. Gaussian processes for machine learning , isbn =
-
[11]
On the. Biometrika , author =. 1933 , pages =. doi:10.2307/2332286 , number =
-
[12]
Parallel and Distributed Thompson Sampling for Large-scale Accelerated Exploration of Chemical Space
Hernández-Lobato, José Miguel and Requeima, James and Pyzer-Knapp, Edward O. and Aspuru-Guzik, Alán , year =. Parallel and. doi:10.48550/ARXIV.1706.01825 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1706.01825
-
[13]
ACM Transactions on Evolutionary Learning and Optimization , author =
A. ACM Transactions on Evolutionary Learning and Optimization , author =. 2022 , pages =. doi:10.1145/3545611 , language =
-
[14]
Mecánica Computacional Vol XXIX , author =
Constrained Optimization Problems in Mechanical Engineering Design Using a Real-Coded Steady-State Genetic Algorithm , language =. Mecánica Computacional Vol XXIX , author =. 2010 , pages =
2010
-
[16]
and Wang, H
Raponi, E. and Wang, H. and Bujny, M. and Boria, S. and Doerr, C. , year =. High Dimensional Bayesian Optimization Assisted by Principal Component Analysis , doi =
-
[17]
and Daulton, Samuel and Letham, Benjamin and Wilson, Andrew Gordon and Bakshy, Eytan , booktitle =
Balandat, Maximilian and Karrer, Brian and Jiang, Daniel R. and Daulton, Samuel and Letham, Benjamin and Wilson, Andrew Gordon and Bakshy, Eytan , booktitle =
-
[18]
Advances in Neural Information Processing Systems , year=
GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration , author=. Advances in Neural Information Processing Systems , year=
-
[19]
and De Breuker, R
Maathuis, H. and De Breuker, R. and Castro, S. G. P. , title =. 2024 , publisher =
2024
-
[20]
A Framework for
Nayebi, Amin and Munteanu, Alexander and Poloczek, Matthias , booktitle =. A Framework for. 2019 , editor =
2019
-
[21]
Wan, Xingchen and Nguyen, Vu and Ha, Huong and Ru, Binxin and Lu, Cong and Osborne, Michael A. , month = jun, year =. Think. doi:10.48550/arXiv.2102.07188 , abstract =
-
[22]
Increasing the Scope as You Learn: Adaptive Bayesian Optimization in Nested Subspaces
Papenmeier, Leonard and Nardi, Luigi and Poloczek, Matthias , month = apr, year =. Increasing the. doi:10.48550/arXiv.2304.11468 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2304.11468
-
[23]
Papenmeier, Leonard and Nardi, Luigi and Poloczek, Matthias , month = mar, year =. Bounce:. doi:10.48550/arXiv.2307.00618 , urldate =
-
[24]
Eriksson, David and Jankowiak, Martin , month = jun, year =. High-. doi:10.48550/arXiv.2103.00349 , urldate =
-
[25]
Ziomek, Juliusz and Bou-Ammar, Haitham , month = may, year =. Are. doi:10.48550/arXiv.2301.12844 , urldate =
-
[26]
M. C. Kennedy and A. O'Hagan , journal =. Predicting the Output from a Complex Computer Code When Fast Approximations Are Available , urldate =
-
[27]
Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences , author =
Multi-fidelity optimization via surrogate modelling , volume =. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences , author =. 2007 , pages =. doi:10.1098/rspa.2007.1900 , abstract =
-
[28]
Multi-Information Source Optimization
Poloczek, Matthias and Wang, Jialei and Frazier, Peter I. , month = nov, year =. Multi-. doi:10.48550/arXiv.1603.00389 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1603.00389
-
[29]
Li, Ke and Li, Fan , month = feb, year =. Multi-. doi:10.48550/arXiv.2402.09638 , urldate =
-
[30]
and Zhe, Shandian , month = mar, year =
Xu, Zhitong and Wang, Haitao and Phillips, Jeff M. and Zhe, Shandian , month = mar, year =. Standard. doi:10.48550/arXiv.2402.02746 , urldate =
-
[31]
Hvarfner, Carl and Hellsten, Erik Orm and Nardi, Luigi , month = dec, year =. Vanilla. doi:10.48550/arXiv.2402.02229 , urldate =
-
[32]
Scalable Variational Gaussian Process Classification
Hensman, James and Matthews, Alex and Ghahramani, Zoubin , month = nov, year =. Scalable. doi:10.48550/arXiv.1411.2005 , abstract =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1411.2005 2005
-
[33]
Proceedings of the 39th International Conference on Machine Learning , pages =
Sequential and Parallel Constrained Max-value Entropy Search via Information Lower Bound , author =. Proceedings of the 39th International Conference on Machine Learning , pages =. 2022 , editor =
2022
-
[34]
Fast Information-theoretic Bayesian Optimisation
Ru, Binxin and McLeod, Mark and Granziol, Diego and Osborne, Michael A. , month = jun, year =. Fast. doi:10.48550/arXiv.1711.00673 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1711.00673
-
[35]
Max-value Entropy Search for Efficient Bayesian Optimization
Wang, Zi and Jegelka, Stefanie , month = jan, year =. Max-value. doi:10.48550/arXiv.1703.01968 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1703.01968
-
[36]
Understanding High-Dimensional Bayesian Optimization
Papenmeier, Leonard and Poloczek, Matthias and Nardi, Luigi , month = jun, year =. Understanding. doi:10.48550/arXiv.2502.09198 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2502.09198
-
[37]
Moss, Henry B. and Leslie, David S. and Gonzalez, Javier and Rayson, Paul , month = oct, year =. doi:10.48550/arXiv.2102.03324 , urldate =
-
[38]
Ascia, Paolo and Raponi, Elena and Bäck, Thomas and Duddeck, Fabian , month = jun, year =. Feasibility-. doi:10.48550/arXiv.2506.14619 , urldate =
-
[39]
Takeno, Shion and Fukuoka, Hitoshi and Tsukada, Yuhki and Koyama, Toshiyuki and Shiga, Motoki and Takeuchi, Ichiro and Karasuyama, Masayuki , month = feb, year =. Multi-fidelity. doi:10.48550/arXiv.1901.08275 , urldate =
-
[40]
Belakaria, Syrine and Deshwal, Aryan and Doppa, Janardhan Rao , month = nov, year =. Max-value. doi:10.48550/arXiv.2009.01721 , urldate =
-
[41]
Multi-fidelity Bayesian Optimisation with Continuous Approximations
Kandasamy, Kirthevasan and Dasarathy, Gautam and Schneider, Jeff and Poczos, Barnabas , year =. Multi-fidelity. doi:10.48550/ARXIV.1703.06240 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1703.06240
-
[42]
Practical Multi-fidelity Bayesian Optimization for Hyperparameter Tuning
Wu, Jian and Toscano-Palmerin, Saul and Frazier, Peter I. and Wilson, Andrew Gordon , year =. Practical. doi:10.48550/ARXIV.1903.04703 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1903.04703 1903
-
[43]
Gratiet, Loic Le , month = jan, year =. Recursive co-kriging model for. doi:10.48550/arXiv.1210.0686 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1210.0686
-
[44]
Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences , author =
Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling , volume =. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences , author =. 2017 , pages =. doi:10.1098/rspa.2016.0751 , language =
-
[45]
Predictive Entropy Search for Efficient Global Optimization of Black-box Functions
Hernández-Lobato, José Miguel and Hoffman, Matthew W. and Ghahramani, Zoubin , month = jun, year =. Predictive. doi:10.48550/arXiv.1406.2541 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.1406.2541
-
[46]
Perrone, Valerio and Shcherbatyi, Iaroslav and Jenatton, Rodolphe and Archambeau, Cedric and Seeger, Matthias , month = oct, year =. Constrained. doi:10.48550/arXiv.1910.07003 , urldate =
-
[47]
Journal of Basic Engineering , author =
A. Journal of Basic Engineering , author =. 1964 , pages =. doi:10.1115/1.3653121 , language =
-
[48]
Journal of Mathematical Analysis and Applications , author =
A versatile stochastic model of a function of unknown and time varying form , volume =. Journal of Mathematical Analysis and Applications , author =. 1962 , pages =. doi:10.1016/0022-247X(62)90011-2 , language =
-
[49]
Ament, Sebastian and Daulton, Samuel and Eriksson, David and Balandat, Maximilian and Bakshy, Eytan , month = jan, year =. Unexpected. doi:10.48550/arXiv.2310.20708 , urldate =
-
[50]
Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics , pages =
Kernel Multi-task Learning using Task-specific Features , author =. Proceedings of the Eleventh International Conference on Artificial Intelligence and Statistics , pages =. 2007 , editor =
2007
-
[51]
International Journal of Impact Engineering , author =
Crashworthiness in preliminary design:. International Journal of Impact Engineering , author =. 2024 , pages =. doi:10.1016/j.ijimpeng.2024.104946 , language =
-
[52]
Computer Methods in Applied Mechanics and Engineering , author =
Kriging-assisted topology optimization of crash structures , volume =. Computer Methods in Applied Mechanics and Engineering , author =. 2019 , pages =. doi:10.1016/j.cma.2019.02.002 , language =
-
[53]
Maathuis, Hauke and Castro, Saullo G. P. and Breuker, Roeland De , month = nov, year =. Exploring. doi:10.48550/arXiv.2411.03247 , urldate =
-
[54]
Computational Geosciences , author =
Multifidelity uncertainty quantification for ice sheet simulations , volume =. Computational Geosciences , author =. 2025 , pages =. doi:10.1007/s10596-024-10329-3 , language =
-
[55]
Structural and Multidisciplinary Optimization , author =
A. Structural and Multidisciplinary Optimization , author =. 2022 , pages =. doi:10.1007/s00158-022-03204-1 , language =
-
[56]
Scaling. AIAA Journal , author =. 2025 , pages =. doi:10.2514/1.J065252 , language =
-
[57]
Mikkola, Petrus and Martinelli, Julien and Filstroff, Louis and Kaski, Samuel , year =. Multi-. doi:10.48550/ARXIV.2210.13937 , urldate =
-
[58]
Moss, Henry B. and Leslie, David S. and Rayson, Paul , month = jun, year =. doi:10.48550/arXiv.2006.12093 , urldate =
-
[59]
and Pleiss, Geoff and Bindel, David and Weinberger, Kilian Q
Gardner, Jacob R. and Pleiss, Geoff and Bindel, David and Weinberger, Kilian Q. and Wilson, Andrew Gordon , month = jun, year =. doi:10.48550/arXiv.1809.11165 , urldate =
-
[60]
Foumani, Zahra Zanjani and Bostanabad, Ramin , month = mar, year =. Constrained multi-fidelity. doi:10.48550/arXiv.2503.01126 , urldate =
-
[61]
Cordelier, Oihan and Diouane, Youssef and Bartoli, Nathalie and Laurendeau, Eric , month = jul, year =. Multi-. doi:10.2514/6.2025-3474 , language =
-
[62]
2022 , institution=
Building scalable test problems for benchmarking constrained optimizers , author=. 2022 , institution=
2022
-
[63]
Advanced Engineering Informatics , author =
Constraint-handling in genetic algorithms through the use of dominance-based tournament selection , volume =. Advanced Engineering Informatics , author =. 2002 , pages =. doi:10.1016/S1474-0346(02)00011-3 , language =
-
[64]
Journal of Global Optimization , author =
Derivative-. Journal of Global Optimization , author =. 2006 , pages =. doi:10.1007/s10898-005-3693-z , language =
-
[65]
Posterior Inference in Latent Space for Scalable Constrained Black-box Optimization
Om, Kiyoung and Sim, Kyuil and Yun, Taeyoung and Kang, Hyeongyu and Park, Jinkyoo , month = jul, year =. Posterior. doi:10.48550/arXiv.2507.00480 , urldate =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2507.00480
-
[66]
Structural and Multidisciplinary Optimization , author =
Bayesian optimization of cooperative components for multi-stage aero-structural compressor blade design , volume =. Structural and Multidisciplinary Optimization , author =. 2025 , pages =. doi:10.1007/s00158-025-03998-w , language =
-
[67]
The Computer Journal , author =
An. The Computer Journal , author =. 1960 , pages =. doi:10.1093/comjnl/3.3.175 , language =
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.