Bayesian Neural Network Surrogates for Bayesian Optimization of Carbon Capture and Storage Operations
Pith reviewed 2026-05-19 02:39 UTC · model grok-4.3
The pith
Bayesian neural network surrogates improve Bayesian optimization of carbon capture and storage operations over standard Gaussian process models in high-dimensional settings.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that replacing Gaussian processes with Bayesian neural networks inside a Bayesian optimization loop yields more effective search for decision variables in CCS reservoir models when the number of variables grows large or when objectives differ in scale, with net present value serving as the single scalar objective that balances revenue and emission reduction.
What carries the argument
Bayesian neural network surrogates inside the Bayesian optimization acquisition loop, used to model the black-box mapping from injection parameters to net present value.
If this is right
- CCS project planners can optimize more decision variables without the surrogate becoming a bottleneck.
- Single-objective net present value optimization can still produce plans that improve both economics and emission reduction.
- The framework offers a derivative-free route to better operating policies for existing oil-field infrastructure repurposed for storage.
- Similar surrogate swaps could be tested on other reservoir-management tasks that currently rely on Gaussian-process Bayesian optimization.
Where Pith is reading between the lines
- If the same surrogate swap works for multi-objective formulations, operators could directly trade off net present value against long-term leakage risk without manual scaling.
- The approach could extend to optimizing injection schedules across multiple wells or coupled surface-subsurface systems where dimensionality is even higher.
- Validation against field data from actual CCS pilots would show whether the reported gains survive model mismatch and measurement noise.
Load-bearing premise
The observed advantages of Bayesian neural networks over Gaussian processes will transfer from the tested synthetic or simplified cases to full-scale, realistic CCS reservoir simulations.
What would settle it
Running the same Bayesian optimization budget on a detailed reservoir model and finding that the Gaussian-process version reaches equal or higher net present value than the Bayesian-neural-network version.
Figures
read the original abstract
Carbon Capture and Storage (CCS) stands as a pivotal technology for fostering a sustainable future. The process, which involves injecting supercritical CO$_2$ into underground formations, a method already widely used for Enhanced Oil Recovery, serves a dual purpose: it not only curbs CO$_2$ emissions and addresses climate change but also extends the operational lifespan and sustainability of oil fields and platforms, easing the shift toward greener practices. This paper delivers a thorough comparative evaluation of strategies for optimizing decision variables in CCS project development, employing a derivative-free technique known as Bayesian Optimization. In addition to Gaussian Processes, which usually serve as the gold standard in BO, various novel stochastic models were examined and compared within a BO framework. This research investigates the effectiveness of utilizing more exotic stochastic models than GPs for BO in environments where GPs have been shown to underperform, such as in cases with a large number of decision variables or multiple objective functions that are not similarly scaled. By incorporating Net Present Value (NPV) as a key objective function, the proposed framework demonstrates its potential to improve economic viability while ensuring the sustainable deployment of CCS technologies. Ultimately, this study represents the first application in the reservoir engineering industry of the growing body of BO research, specifically in the search for more appropriate stochastic models, highlighting its potential as a preferred method for enhancing sustainability in the energy sector.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript presents a comparative evaluation of Bayesian Optimization (BO) frameworks for optimizing decision variables in Carbon Capture and Storage (CCS) operations. It replaces the standard Gaussian Process (GP) surrogate with alternatives including Bayesian Neural Networks (BNNs) and other stochastic models, using Net Present Value (NPV) as the objective. The work is framed as the first application of such non-GP BO research in reservoir engineering, targeting scenarios with high-dimensional inputs or unequally scaled multi-objective functions.
Significance. If the reported advantages of BNN surrogates hold under the tested conditions, the paper supplies an early industry-oriented demonstration that could encourage adoption of more flexible surrogates in energy-sector optimization. It directly addresses known GP limitations in certain regimes and links the optimization to both economic and sustainability metrics via NPV.
major comments (2)
- [§5] §5, Experimental Results: the performance tables compare BNN and GP surrogates on NPV but report only point estimates without error bars, number of independent runs, or statistical tests; this weakens the claim that BNNs are demonstrably superior in the CCS setting.
- [§4.1] §4.1, Reservoir Model Description: the number and scaling of decision variables (e.g., injection rates, well locations) are not quantified, so it is impossible to verify that the test case actually falls into the regime where GPs are known to underperform.
minor comments (2)
- [Abstract] Abstract: the phrase 'various novel stochastic models' is used without listing them; the introduction or methods section should enumerate the exact set of surrogates examined.
- [Figure 3] Figure 3: axis labels and legend entries are too small for readability; increase font size or split into multiple panels.
Simulated Author's Rebuttal
We thank the referee for their constructive comments, which highlight important aspects for strengthening the presentation of our results and the description of the experimental setup. We address each major comment below.
read point-by-point responses
-
Referee: §5, Experimental Results: the performance tables compare BNN and GP surrogates on NPV but report only point estimates without error bars, number of independent runs, or statistical tests; this weakens the claim that BNNs are demonstrably superior in the CCS setting.
Authors: We agree that reporting only point estimates limits the robustness of the comparison. In the revised manuscript we will rerun the experiments with a sufficient number of independent random seeds, report mean NPV values together with error bars (standard deviation), explicitly state the number of runs, and include statistical significance tests (e.g., Wilcoxon rank-sum test with p-values) between the BNN and GP variants. These additions will be placed in the updated Section 5 and its associated tables. revision: yes
-
Referee: §4.1, Reservoir Model Description: the number and scaling of decision variables (e.g., injection rates, well locations) are not quantified, so it is impossible to verify that the test case actually falls into the regime where GPs are known to underperform.
Authors: We acknowledge that the current text does not provide explicit counts or ranges for the decision variables. Section 4.1 will be expanded to state the total dimensionality of the input space, the number of injection-rate and well-location variables, and the numerical bounds and scaling applied to each. This information will allow readers to confirm that the test case lies in the high-dimensional or unequally scaled regime where the advantages of BNN surrogates are expected. revision: yes
Circularity Check
No significant circularity: empirical comparison only
full rationale
The manuscript is framed as an empirical study comparing Bayesian Optimization performance with Gaussian Process versus Bayesian Neural Network and other non-GP surrogates on a CCS reservoir optimization task using NPV as objective. No derivation chain, first-principles equations, or predictive claims that reduce to fitted parameters or self-referential definitions appear. The central result is a set of experimental metrics on synthetic and reservoir models; these are not forced by construction from any internal fit or self-citation. Self-citations, if present, are incidental and not load-bearing for the reported comparisons. The work is self-contained against external benchmarks and does not invoke uniqueness theorems or ansatzes that collapse to prior author work.
Axiom & Free-Parameter Ledger
Lean theorems connected to this paper
-
IndisputableMonolith/Cost/FunctionalEquation.leanwashburn_uniqueness_aczel unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
comparative evaluation of strategies for optimizing decision variables in CCS project development, employing a derivative-free technique known as Bayesian Optimization... various novel stochastic models were examined and compared within a BO framework
-
IndisputableMonolith/Foundation/RealityFromDistinction.leanreality_from_one_distinction unclear?
unclearRelation between the paper passage and the cited Recognition theorem.
By incorporating Net Present Value (NPV) as a key objective function
What do these tags mean?
- matches
- The paper's claim is directly supported by a theorem in the formal canon.
- supports
- The theorem supports part of the paper's argument, but the paper may add assumptions or extra steps.
- extends
- The paper goes beyond the formal theorem; the theorem is a base layer rather than the whole result.
- uses
- The paper appears to rely on the theorem as machinery.
- contradicts
- The paper's claim conflicts with a theorem or certificate in the canon.
- unclear
- Pith found a possible connection, but the passage is too broad, indirect, or ambiguous to say the theorem truly supports the claim.
Reference graph
Works this paper leans on
-
[1]
S. M. Jarvis, S. Samsatli, Technologies and infrastructures underpinning future co2 value chains: A comprehen- sive review and comparative analysis, Renewable and Sustainable Energy Reviews 85 (2018) 46–68
work page 2018
-
[2]
P. Gabrielli, M. Gazzani, M. Mazzotti, The role of carbon capture and utilization, carbon capture and storage, and biomass to enable a net-zero-co2 emissions chemical industry, Industrial & Engineering Chemistry Research 59 (15) (2020) 7033–7045
work page 2020
-
[3]
M. Bui, G. D. Puxty, M. Gazzani, S. M. Soltani, C. Pozo, The role of carbon capture and storage (ccs) technologies in a net-zero carbon future (2021)
work page 2021
-
[4]
S. Rackley, S. Rackley, Introduction to geological storage, Carbon Capture and Storage; Elsevier: Amsterdam, The Netherlands (2017) 285–304
work page 2017
-
[5]
L. Tomi ´c, V . K. Mariˇci´c, D. Danilovi´c, M. Crnogorac, Criteria for co2 storage in geological formations, Podzemni radovi (32) (2018) 61–74
work page 2018
-
[6]
X. Ji, C. Zhu, Co2 storage in deep saline aquifers, in: Novel materials for carbon dioxide mitigation technology, Elsevier, 2015, pp. 299–332
work page 2015
-
[7]
S. Bachu, Review of co2 storage e fficiency in deep saline aquifers, International Journal of Greenhouse Gas Control 40 (2015) 188–202
work page 2015
-
[8]
K. Michael, A. Golab, V . Shulakova, J. Ennis-King, G. Allinson, S. Sharma, T. Aiken, Geological storage of co2 in saline aquifers—a review of the experience from existing storage operations, International journal of greenhouse gas control 4 (4) (2010) 659–667
work page 2010
- [9]
-
[10]
E. Mohammadian, B. M. Jan, A. Azdarpour, H. Hamidi, N. H. B. Othman, A. Dollah, S. N. B. C. M. Hussein, R. A. B. Sazali, Co 2-eor/sequestration: Current trends and future horizons, in: Enhanced Oil Recovery Processes- New Technologies, IntechOpen, 2019
work page 2019
-
[11]
Z. Li, M. Dong, S. Li, S. Huang, Co2 sequestration in depleted oil and gas reservoirs—caprock characterization and storage capacity, Energy Conversion and Management 47 (11-12) (2006) 1372–1382
work page 2006
- [12]
- [13]
-
[14]
H. Class, A. Ebigbo, R. Helmig, H. K. Dahle, J. M. Nordbotten, M. A. Celia, P. Audigane, M. Darcis, J. Ennis- King, Y . Fan, et al., A benchmark study on problems related to co 2 storage in geologic formations: summary and discussion of the results, Computational geosciences 13 (2009) 409–434
work page 2009
-
[15]
S. Whitaker, Flow in porous media i: A theoretical derivation of darcy’s law, Transport in porous media 1 (1986) 3–25
work page 1986
-
[16]
A. F. Rasmussen, T. H. Sandve, K. Bao, A. Lauser, J. Hove, B. Skaflestad, R. Kl ¨ofkorn, M. Blatt, A. B. Rustad, O. Sævareid, et al., The open porous media flow reservoir simulator, Computers & Mathematics with Applications 81 (2021) 159–185
work page 2021
-
[17]
J. A. Trangenstein, J. B. Bell, Mathematical structure of the black-oil model for petroleum reservoir simulation, SIAM Journal on Applied Mathematics 49 (3) (1989) 749–783
work page 1989
- [18]
-
[19]
D. A. Cameron, L. J. Durlofsky, Optimization of well placement, co2 injection rates, and brine cycling for geo- logical carbon sequestration, International Journal of Greenhouse Gas Control 10 (2012) 100–112
work page 2012
-
[20]
S. Bachu, Co2 storage in geological media: Role, means, status and barriers to deployment, Progress in energy and combustion science 34 (2) (2008) 254–273
work page 2008
-
[21]
H. De Coninck, T. Flach, P. Curnow, P. Richardson, J. Anderson, S. Shackley, G. Sigurthorsson, D. Reiner, The acceptability of co2 capture and storage (ccs) in europe: An assessment of the key determining factors: Part
-
[22]
scientific, technical and economic dimensions, International Journal of Greenhouse Gas Control 3 (3) (2009) 333–343
work page 2009
-
[23]
K. W. Bandilla, M. A. Celia, Active pressure management through brine production for basin-wide deployment of geologic carbon sequestration, International Journal of Greenhouse Gas Control 61 (2017) 155–167
work page 2017
-
[24]
T. A. Buscheck, J. M. Bielicki, J. A. White, Y . Sun, Y . Hao, W. L. Bourcier, S. A. Carroll, R. D. Aines, Pre- injection brine production in co2 storage reservoirs: An approach to augment the development, operation, and performance of ccs while generating water, International Journal of Greenhouse Gas Control 54 (2016) 499–512
work page 2016
-
[25]
S. T. Anderson, H. Jahediesfanjani, Estimating the net costs of brine production and disposal to expand pressure- limited dynamic capacity for basin-scale co2 storage in a saline formation, International Journal of Greenhouse Gas Control 102 (2020) 103161. 25
work page 2020
-
[26]
Y . Wang, Y . Xu, K. Zhang, Investigation of co2 storage capacity in open saline aquifers with numerical models, Procedia Engineering 31 (2012) 886–892
work page 2012
-
[27]
K. Deb, K. Sindhya, J. Hakanen, Multi-objective optimization, in: Decision sciences, CRC Press, 2016, pp. 161–200
work page 2016
-
[28]
S. Mirjalili, S. Mirjalili, Genetic algorithm, Evolutionary Algorithms and Neural Networks: Theory and Applica- tions (2019) 43–55
work page 2019
-
[29]
J. Kennedy, R. Eberhart, Particle swarm optimization, in: Proceedings of ICNN’95-international conference on neural networks, V ol. 4, IEEE, 1995, pp. 1942–1948
work page 1995
-
[30]
B. Guyaguler, R. N. Horne, L. Rogers, J. J. Rosenzweig, Optimization of well placement in a gulf of mexico waterflooding project, SPE Reservoir Evaluation & Engineering 5 (03) (2002) 229–236
work page 2002
-
[31]
T. A. El-Mihoub, A. A. Hopgood, L. Nolle, A. Battersby, Hybrid genetic algorithms: A review., Eng. Lett. 13 (2) (2006) 124–137
work page 2006
- [32]
-
[33]
A. A. Emerick, E. Silva, B. Messer, L. F. Almeida, D. Szwarcman, M. A. C. Pacheco, M. M. Vellasco, Well placement optimization using a genetic algorithm with nonlinear constraints, in: SPE Reservoir Simulation Con- ference?, SPE, 2009, pp. SPE–118808
work page 2009
-
[34]
Z. Michalewicz, G. Nazhiyath, Genocop iii: A co-evolutionary algorithm for numerical optimization problems with nonlinear constraints, in: Proceedings of 1995 IEEE International Conference on Evolutionary Computation, V ol. 2, IEEE, 1995, pp. 647–651
work page 1995
- [35]
-
[36]
T. Goda, K. Sato, Global optimization of injection well placement toward higher safety of co2 geological storage, Energy Procedia 37 (2013) 4583–4590
work page 2013
-
[37]
Loh, On latin hypercube sampling, The annals of statistics 24 (5) (1996) 2058–2080
W.-L. Loh, On latin hypercube sampling, The annals of statistics 24 (5) (1996) 2058–2080
work page 1996
-
[38]
J. Hutahaean, V . Demyanov, D. Arnold, O. Vazquez, Optimization of well placement to minimize the risk of scale deposition in field development, in: Abu Dhabi international petroleum exhibition and conference, SPE, 2014, p. D021S026R002
work page 2014
- [39]
- [40]
-
[41]
Y . S. Ong, P. B. Nair, A. J. Keane, Evolutionary optimization of computationally expensive problems via surrogate modeling, AIAA journal 41 (4) (2003) 687–696
work page 2003
-
[42]
Y . Jin, Surrogate-assisted evolutionary computation: Recent advances and future challenges, Swarm and Evolu- tionary Computation 1 (2) (2011) 61–70
work page 2011
- [43]
-
[44]
T. Goel, R. T. Haftka, W. Shyy, N. V . Queipo, Ensemble of surrogates, Structural and Multidisciplinary Optimiza- tion 33 (2007) 199–216
work page 2007
-
[45]
E. Santibanez-Borda, R. Govindan, N. Elahi, A. Korre, S. Durucan, Maximising the dynamic co2 storage capacity through the optimisation of co2 injection and brine production rates, International Journal of Greenhouse Gas Control 80 (2019) 76–95
work page 2019
-
[46]
B. Amiri, A. Jahanbani Ghahfarokhi, V . Rocca, C. S. W. Ng, Optimization of o ffshore saline aquifer co2 storage in smeaheia using surrogate reservoir models, Algorithms 17 (10) (2024). doi:10.3390/a17100452. URL https://www.mdpi.com/1999-4893/17/10/452
-
[47]
Intriguing properties of neural networks
C. Szegedy, W. Zaremba, I. Sutskever, J. Bruna, D. Erhan, I. Goodfellow, R. Fergus, Intriguing properties of neural networks, arXiv preprint arXiv:1312.6199 (2013)
work page internal anchor Pith review Pith/arXiv arXiv 2013
-
[48]
C. Guo, G. Pleiss, Y . Sun, K. Q. Weinberger, On calibration of modern neural networks, in: International confer- ence on machine learning, PMLR, 2017, pp. 1321–1330
work page 2017
- [49]
-
[50]
P. I. Frazier, A tutorial on bayesian optimization, arXiv preprint arXiv:1807.02811 (2018)
work page internal anchor Pith review Pith/arXiv arXiv 2018
-
[51]
A. Der Kiureghian, O. Ditlevsen, Aleatory or epistemic? does it matter?, Structural safety 31 (2) (2009) 105–112
work page 2009
-
[52]
E. H ¨ullermeier, W. Waegeman, Aleatoric and epistemic uncertainty in machine learning: An introduction to concepts and methods, Machine learning 110 (3) (2021) 457–506
work page 2021
-
[53]
R. J. Adler, An introduction to continuity, extrema, and related topics for general gaussian processes, IMS, 1990
work page 1990
-
[54]
K. Balabaeva, L. Akmadieva, S. Kovalchuk, Optimal wells placement to maximize the field cov- 26 erage using derivative-free optimization, Procedia Computer Science 178 (2020) 65–74, 9th Inter- national Young Scientists Conference in Computational Science, YSC2020, 05-12 September 2020. doi:https://doi.org/10.1016/j.procs.2020.11.008. URL https://www.scien...
-
[55]
R. Bordas, J. Heritage, M. Javed, G. Peacock, T. Taha, P. Ward, I. Vernon, R. Hammersley, A bayesian opti- misation workflow for field development planning under geological uncertainty, in: ECMOR XVII, V ol. 2020, European Association of Geoscientists & Engineers, 2020, pp. 1–20
work page 2020
-
[56]
A. Kumar, Search space partitioning, mcts and trust-region bayesian optimization for joint optimization of well placement and control, in: 83rd EAGE Annual Conference & Exhibition, V ol. 2022, European Association of Geoscientists & Engineers, 2022, pp. 1–5
work page 2022
-
[57]
A. Kumar, High-dimensional bayesian optimization using sparse-axis aligned subspaces for joint optimization of well control and placement, in: 84th EAGE Annual Conference & Exhibition, V ol. 2023, European Association of Geoscientists & Engineers, 2023, pp. 1–5
work page 2023
-
[58]
D. Eriksson, M. Pearce, J. Gardner, R. D. Turner, M. Poloczek, Scalable global optimization via local bayesian optimization, Advances in neural information processing systems 32 (2019)
work page 2019
-
[59]
D. Eriksson, M. Jankowiak, High-dimensional bayesian optimization with sparse axis-aligned subspaces, in: Un- certainty in Artificial Intelligence, PMLR, 2021, pp. 493–503
work page 2021
-
[60]
X. Lu, K. E. Jordan, M. F. Wheeler, E. O. Pyzer-Knapp, M. Benatan, Bayesian optimization for field-scale geo- logical carbon storage, Engineering 18 (2022) 96–104. doi:https://doi.org/10.1016/j.eng.2022.06.011. URL https://www.sciencedirect.com/science/article/pii/S2095809922004957
-
[61]
M. A. Javed, Bayesian optimization of deviated well trajectories under geological uncertainty, MSc thesis for Heriot-Watt University (2020)
work page 2020
-
[62]
S. Wang, S. Chen, A novel bayesian optimization framework for computationally expensive optimization problem in tight oil reservoirs, in: SPE Annual Technical Conference and Exhibition?, SPE, 2017, p. D021S014R007
work page 2017
-
[63]
Z. Wang, S. Jegelka, Max-value entropy search for e fficient bayesian optimization, in: International Conference on Machine Learning, PMLR, 2017, pp. 3627–3635
work page 2017
-
[64]
J. Gardner, C. Guo, K. Weinberger, R. Garnett, R. Grosse, Discovering and exploiting additive structure for bayesian optimization, in: Artificial Intelligence and Statistics, PMLR, 2017, pp. 1311–1319
work page 2017
-
[65]
K. Kandasamy, J. Schneider, B. P ´oczos, High dimensional bayesian optimisation and bandits via additive models, in: International conference on machine learning, PMLR, 2015, pp. 295–304
work page 2015
-
[66]
J. Wu, M. Poloczek, A. G. Wilson, P. Frazier, Bayesian optimization with gradients, Advances in neural informa- tion processing systems 30 (2017)
work page 2017
-
[67]
K. Swersky, J. Snoek, R. P. Adams, Multi-task bayesian optimization, Advances in neural information processing systems 26 (2013)
work page 2013
-
[68]
H. Moss, D. Leslie, D. Beck, J. Gonzalez, P. Rayson, Boss: Bayesian optimization over string spaces, Advances in neural information processing systems 33 (2020) 15476–15486
work page 2020
-
[69]
Garnett, Bayesian optimization, Cambridge University Press, 2023
R. Garnett, Bayesian optimization, Cambridge University Press, 2023
work page 2023
-
[70]
S. P. Fotias, I. Ismail, V . Gaganis, Optimization of well placement in carbon capture and storage (ccs): Bayesian optimization framework under permutation invariance, Applied Sciences 14 (8) (2024) 3528
work page 2024
-
[71]
T. Buckle, R. Hutton, V . Demyanov, D. Arnold, A. Antropov, E. Kharyba, M. Pilipenko, L. Stulov, Improving local history match using machine learning generated regions from production response and geological parameter correlations, in: Petroleum Geostatistics 2019, V ol. 2019, European Association of Geoscientists & Engineers, 2019, pp. 1–5
work page 2019
- [72]
-
[73]
Sambridge, Geophysical inversion with a neighbourhood algorithm—i
M. Sambridge, Geophysical inversion with a neighbourhood algorithm—i. searching a parameter space, Geophys- ical journal international 138 (2) (1999) 479–494
work page 1999
-
[74]
Sambridge, Geophysical inversion with a neighbourhood algorithm—ii
M. Sambridge, Geophysical inversion with a neighbourhood algorithm—ii. appraising the ensemble, Geophysical Journal International 138 (3) (1999) 727–746
work page 1999
-
[75]
J. Hutahaean, V . Demyanov, M. Christie, Reservoir development optimization under uncertainty for infill well placement in brownfield redevelopment, Journal of Petroleum Science and Engineering 175 (2019) 444–464
work page 2019
-
[76]
L. Mohamed, M. Christie, V . Demyanov, Comparison of stochastic sampling algorithms for uncertainty quantifi- cation, SPE journal 15 (01) (2010) 31–38
work page 2010
-
[77]
Q. Liao, L. Zeng, H. Chang, D. Zhang, E fficient history matching using the markov-chain monte carlo method by means of the transformed adaptive stochastic collocation method, SPE Journal 24 (04) (2019) 1468–1489
work page 2019
-
[78]
X. Ma, M. Al-Harbi, A. Datta-Gupta, Y . Efendiev, An efficient two-stage sampling method for uncertainty quan- tification in history matching geological models, SPE Journal 13 (01) (2008) 77–87
work page 2008
-
[79]
F. Olalotiti-Lawal, A. Datta-Gupta, A multiobjective markov chain monte carlo approach for history matching and uncertainty quantification, Journal of Petroleum Science and Engineering 166 (2018) 759–777. 27
work page 2018
-
[80]
R. M. Neal, Bayesian learning for neural networks, V ol. 118, Springer Science & Business Media, 2012
work page 2012
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.