Enhancing Accuracy and Efficiency in Calibration of Drinking Water Distribution Networks Through Evolutionary Artificial Neural Networks and Expert Systems

Cristian Gomez; Elena Torfs; Ingmar Nopens; Kimberly Solon; Mark Morley; Pieter-Jan Haest

REVIEW 4 major objections 6 minor 3 references

Enhancing Accuracy and Efficiency in Calibration of Drinking Water Distribution Networks Through Evolutionary Artificial Neural Networks and Expert Systems

T0 review · 4 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read Neuroevolution plus expert rules fits a real water grid's 20,000 parameters.

desk verdict A promising applied calibration paper whose real-network result is undermined by an unaddressed identifiability problem and an untested transfer-learning claim. read the letter →

arxiv 2411.19387 v1 pith:FAYM6PCV submitted 2024-11-28 cs.CE

Cristian Gomez , Kimberly Solon , Pieter-Jan Haest , Mark Morley , Ingmar Nopens , Elena Torfs This is my paper · ORCID

classification cs.CE

keywords ArtificialNeuralNetworksAutomaticCalibrationDigitalTwinsFull-NetworkWaterDistributionNetworkModelNeuro-EvolutionofAugmentingTopologiesExpertSystemsTransferLearning

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper introduces ES-NEAT, an automatic calibration method for drinking water distribution network models, and claims it solves a problem long treated as ill-posed: estimating tens of thousands of hydraulic parameters from very few field measurements. On a real Belgian network with 5,197 nodes and 4,158 pipes, the authors calibrate roughly 20,000 parameters (base demands, leaks, pipe roughnesses, minor and valve losses) using only 42 measured nodes and 8 measured pipes. They report a calibration RMSE of 0.33, a validation RMSE of 0.56 on five held-out locations, and a total cost of 10,000 EPANET simulations, about 12 hours on a laptop-class machine. The method's distinct promise is that the evolved neural network stores the calibration result as a structured set of inter-parameter relationships, so a later recalibration can start from the previous network instead of from scratch. The paper aims to establish both a practical recipe for full-network calibration under data scarcity and a mechanism for transferring calibration knowledge across the repeated recalibrations that real water utilities face.

What carries the argument

The load-bearing machinery is ES-NEAT, a combination of an expert system with NEAT (Neuro-Evolution of Augmenting Topologies), a genetic algorithm that evolves both the weights and the topology of neural networks. In this application the neural network takes known network attributes such as pipe lengths, connectivity, diameters, and elevations as inputs and outputs calibrated parameters such as base demands, leak coefficients, pipe roughnesses, minor losses, and valve losses; NEAT searches over network topologies and weights, while the expert system supplies the rules that define each parameter's plausible range and prior distribution from stakeholder knowledge. Because flow and pressure respond to overlapping sets of parameters, the framework separates the calibration into a flow-sensitive phase followed by a pressure-sensitive phase, iterating until convergence, to stop one parameter silently compensating for another. The final ANN topology with its connection weights is the repository of calibration information that the paper proposes to transfer to subsequent calibration runs.

What would settle it

Run ES-NEAT on the Fossolo benchmark, where the true parameter values are known, and compare the recovered roughness, demand, and leak coefficients against the synthetic truth: if the method reaches low flow-and-pressure RMSE while returning parameter values far from the truth, the central claim of global calibration fails even though the fit looks good.

Watch

Extended reading notes

Core claim

The central claim is that ES-NEAT achieves accurate, global calibration of a real DWDN model with about 20,000 parameters in a setting where the parameters outnumber the measurements by orders of magnitude. The framework first runs a benchmark comparison of established optimization methods on the Fossolo network and selects NEAT as the best trade-off among accuracy, convergence speed, and the ability to store knowledge; ES-NEAT then pairs NEAT with an expert system whose rules constrain each parameter's range and distribution using stakeholder and domain knowledge. Calibration proceeds sequentially: flow-sensitive parameters such as base demands and leaks are adjusted first, then pressure-sensitive parameters such as roughness and minor losses, which the paper argues reduces the compensatory drift that makes underdetermined calibration meaningless. The reported outcome on the real network is an RMSE of 0.33 for calibration and 0.56 for validation, achieved with 10,000 simulations in about 12 hours. The paper further claims that the trained neural network encodes the calibrated parameter interactions and can be reused as the initial generation of a future NEAT run, so subsequent calibration efforts require less search.

Load-bearing premise

The load-bearing premise is that 42 pressure nodes and 8 flow pipes scattered through a 5,197-node, 4,158-pipe network carry enough information to pin down about 20,000 demand, leak, roughness, and loss parameters; if the measurements cannot identify those parameters, the low RMSE may come from compensating errors rather than from a correct calibrated state.

Editorial extensions

If this is right

Calibration of large real DWDNs can be completed in about 12 hours with only a few dozen measurement points, a cost that makes automated recalibration feasible on a routine basis.
The stored ANN gives a subsequent calibration run a structured starting point, so repeated calibrations over a network's lifetime should require less computation than the first calibration.
The benchmark comparison identifies NEAT as offering the best accuracy-convergence trade-off among the tested methods, which justifies using neuroevolution rather than a generic genetic algorithm for the real-network calibration.
Separating flow- and pressure-sensitive parameters reduces inter-parameter compensation, so the calibrated parameter set is expected to be more physically consistent than one produced by a single simultaneous search.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

Inference: if the stored ANN genuinely carries interaction structure, it could be read as a data-driven identifiability map: parameters with near-zero connection weights are candidates for being unobservable from the current sensor layout, which utilities could use to plan where to add meters.
Inference: the transfer-learning component is the natural next experiment: take the trained network from the Belgium case, alter one sector of the network, recalibrate from the stored ANN, and compare generations-to-convergence against a cold start; the paper implies but does not run this test.
Inference: because the expert system's rules set parameter ranges, ES-NEAT's accuracy depends on those ranges being right; an ablation that replaces stakeholder rules with wide uniform priors would separate the contribution of expert knowledge from that of NEAT itself.
Inference: the validation protocol, five held-out locations, tests interpolation between nearby sensors; a stronger generalization test would hold out an entire pressure zone or a different season, since spatially correlated errors could survive the current check.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Calibrating a real DWDN with about 20,000 parameters from 42 pressure/flow nodes and 8 pipes, and getting a validation RMSE of 0.56, is the kind of result that warrants attention. ES-NEAT is a genuine novelty: the combination of expert-system constraints with NEAT for this problem has not appeared before. The paper builds on the first author's thesis, which already applied NEAT to DWDN calibration, and the authors say so. What is actually new is the ES integration and the explicit goal of storing calibration information for reuse.

What the paper does well: it runs a head-to-head comparison of sixteen optimization methods on a benchmark network under a common iteration budget, and the case study is a real network with an actual utility. The before/after plots are convincing. Calibration is evaluated on held-out nodes and pipes, and the validation RMSE is reported — more than many calibration papers do. The paper also states plainly that DWDN calibration is ill-posed, which is honest.

The soft spots are real but not fatal. The identifiability concern is load-bearing: with 42 nodes and 8 pipes out of over 5,000 nodes and 4,000 pipes, and one year of data compressed to an average week, it is not established that the ~20,000 base demands, leaks, roughnesses, and minor losses are identifiable. Expert-system bounds restrict the search space but do not by themselves solve the problem. The low RMSE could come from compensating parameter errors, and a validation set of 3 nodes and 2 pipes is too small to rule out overfitting. The paper needs either a synthetic test with known true parameters, an identifiability analysis, or at least multiple restarts to show stability. None is provided. The transfer-learning claim is asserted but not tested: there is no experiment showing that initializing from the stored ANN speeds up a subsequent calibration. The comparison with prior methods is narrative, not a same-network control. And no code, data, or network files are provided, so the expert-system rules cannot be inspected or reproduced.

This is an applied paper for the hydraulic-modeling community. It is not going to rearrange the field, but the problem it tackles matters and the method is plausible. I would send it to peer review with a request for major revisions: supply the artifacts, add an identifiability or synthetic-validation experiment, and actually test the transfer-learning claim. The right referee is someone who understands both hydraulic inverse problems and metaheuristics.

For a reading group, it would make a good one-session discussion, mostly about why identifiability is the first question to ask when you see a small calibration set and a huge parameter count.

Referee Report

4 major / 6 minor

Summary. The manuscript proposes ES-NEAT, a calibration framework for drinking water distribution network (DWDN) models that combines expert systems (ES) with neuro-evolution of augmenting topologies (NEAT). The method is first benchmarked against several existing optimization algorithms on a small test network, and then applied to a real DWDN in Belgium with roughly 20,000 calibrated parameters, reporting a calibration RMSE of 0.33, a validation RMSE of 0.56, and a computational cost of about 10,000 EPANET simulations (12 hours). The paper also claims that the trained ANN stores calibration information that can be transferred to accelerate future calibration efforts.

Significance. If the reported results are reproducible and generalizable, ES-NEAT would be a practically valuable contribution: it addresses the high-dimensional, underdetermined calibration problem with a moderate computational budget, and the explicit goal of reusing calibration knowledge is a real need in DWDN practice. The benchmark comparison across many optimization methods is a useful resource, and the real-network demonstration is a positive step beyond purely synthetic tests. However, the significance is currently limited because the identifiability of the 20,000-parameter calibration is not analyzed, the real-network evaluation lacks comparison against alternative automated methods on the same data, and the transfer-learning advantage is asserted without a controlled experiment. These gaps prevent the paper from being a definitive demonstration of the method's claimed superiority.

major comments (4)

[Sections 2.1.2, 2.3, 3.2] The manuscript calibrates approximately 20,000 parameters (base demands, leaks, roughnesses, minor losses) from only 42 pressure nodes and 8 flow pipes, with 3 nodes and 2 pipes held out for validation. The Introduction itself states that the number of parameters typically outnumbers measurements, making the problem ill-posed, yet no identifiability, sensitivity, or uncertainty analysis is provided. The low RMSE values therefore do not establish that the recovered parameters are physically correct rather than a compensating combination of errors that matches the calibration sensors. The validation RMSE of 0.56 is computed on only 5 locations, which is too few to support the claim of 'global calibration.' Please add an identifiability analysis (e.g., Jacobian rank, parameter-uncertainty bounds, or a synthetic-recovery test) and justify the adequacy of the validation set.
[Section 3.2] The real-network evaluation compares ES-NEAT only against the prior manual calibration and against two literature studies on different networks (Meirelles et al., 2017; Nicolini et al., 2010). Because the benchmark-network ranking in Section 3.1 may not transfer to the real network's scale, data sparsity, and parameterization, the claim that ES-NEAT is the best automated method is not established. Please run at least one alternative automated calibration method (e.g., SCE-UA or PSO) on the same real network with the same measurement data and computational budget, and report comparative RMSE and convergence behavior.
[Section 3.3] The transfer-learning capability is a stated objective of the paper (Introduction, aim iii), but the only support is a conceptual description and an illustrative figure. No experiment shows that a subsequent calibration initialized from the stored ANN reaches the same accuracy faster or with fewer simulations than a cold start. Please provide a controlled warm-start versus cold-start experiment on either the benchmark or the real network, reporting convergence curves, final RMSE, and total simulation counts.
[Sections 2.3 and 2.4] The expert-system rules are described qualitatively (Figure 4) and the NEAT hyperparameters are listed in Section 3.2, but the actual rule base, parameter bounds, the ES inference procedure, and the exact mapping of network attributes to ANN inputs are not specified. No code, data, or network files are provided. This makes the method irreproducible as a methodological contribution. Please make the implementation artifacts available or provide a complete pseudocode, a full rule table, and the calibrated parameter-range tables so that an independent implementation is possible.

minor comments (6)

[Section 3.3] The second figure in this section is captioned 'Fig. 1' but is referred to in the text as Figure 8; renumber the figure.
[Figure 2 caption] The caption contains a duplicated '(a)' in 'The layout of the real network (a)'; the label should be cleaned up.
[Section 3.2] The statement that 'a value of less than 0.6 is considered good' and 'accepted by the community' lacks a citation; please provide a reference or justify this threshold.
[Section 3.1] The benchmark comparison reports single-run RMSE values for each method, but the stochastic algorithms (e.g., GA, PSO, NEAT) should be run with multiple random seeds to assess variability and statistical significance of the ranking.
[Section 2.2] The text refers to 'the work developed in the Ostrich automatic calibration tool software' but the citation (Shahed Behrouz et al., 2020) describes a SWMM calibration tool; clarify the connection to Ostrich.
[References] Several references are incomplete or inconsistent (e.g., 'Jain and Singh (2003)' appears without initials in the text, and some entries have irregular spacing); please standardize the reference formatting.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: calibration RMSE is fitted, validation RMSE is held out, and the self-citation to Gomez (2021) is descriptive rather than load-bearing.

full rationale

The paper's derivation chain is self-contained: ES-NEAT is described in Sections 2.3-2.4, applied to a benchmark in Section 3.1, and then applied to the real network in Section 3.2. The headline RMSE of 0.33 is the calibration fit on the measured nodes and pipes used for adjustment, while the validation RMSE of 0.56 is computed on 3 held-out nodes and 2 held-out pipes not used in calibration (Section 3.2, Figures 6-7). This is a standard train/validation split, not a fitted parameter renamed as a prediction. The self-citation 'The methodology was developed based on the work done by Gomez et. al. (2021)' (Section 2.3) is a provenance note; the paper itself specifies the NEAT hyperparameters, expert-system rules, and objective function, so the central result does not reduce to that citation. No uniqueness theorem is imported from the authors' prior work, and the expert-system ranges are stated as knowledge-based inputs rather than outputs re-derived from the same data. The dominant limitation is identifiability: with roughly 20,000 calibrated parameters and only 42 measured nodes and 8 measured pipes, low RMSE does not by itself prove the recovered parameters are correct, and 5 validation locations are a weak test of generalizability. That is a correctness and robustness risk, not a circularity. Accordingly, no circular step is identified.

Assumptions & free parameters 3 free parameters · 5 assumptions · 0 invented entities

The central claim relies on the EPANET model structure, the chosen hyperparameters, the expert-system bounds, and the representativeness of the limited measurements. None of these are independently verified in the paper, and the real-network data are not public.

free parameters (3)

NEAT hyperparameters = 100 generations, population 100, connection add rate 0.7, node add rate 0.4, removal rates 0.4/0.2, fully connected…
Chosen by hand in Section 3.2; no sensitivity analysis is reported, so the reported RMSE is conditional on these values.
Expert system parameter bounds = Not quantified in the paper
The ES rules (Figure 4) set ranges for demands, leaks, roughness, and minor losses based on stakeholder knowledge; these bounds directly constrain the search space and are not formally specified or tested for sensitivity.
Fitness threshold = RMSE 0.1 (stop criterion)
The minimization threshold of 0.1 for RMSE is a user-defined stop criterion; it does not affect the final result because the run used all 100 generations, but it is a hand-set hyperparameter.

assumptions (5)

domain assumption EPANET hydraulic equations accurately represent the real network
Section 2.4 uses EPANET 2.2 via WNTR; the calibration adjusts parameters within this model, so any model-structure error is inherited.
domain assumption The measurement data from 42 nodes and 8 pipes are representative and free of systematic error
Section 2.1.2 describes one year of 15-minute measurements averaged to one week; no noise model or measurement uncertainty is used.
domain assumption The expert-system rules correctly capture stakeholder knowledge
Section 2.3 describes ES rules qualitatively (Figure 4); if the rules are wrong or too restrictive, the calibration is biased.
ad hoc to paper Flow-to-pressure sequential calibration avoids parameter compensation
Section 2.3 states that calibrating flow parameters first reduces inter-parameter compensation; this is a methodological assumption not validated against simultaneous calibration.
domain assumption The Fossolo benchmark is a valid proxy for assessing candidate methods
Section 2.1.1 uses one medium-sized benchmark with 3 measured nodes and 3 pipes to select NEAT; selection on one network may not generalize.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Enhancing Accuracy and Efficiency in Calibration of Drinking Water Distribution Networks Through Evolutionary Artificial Neural Networks and Expert Systems." pith.science (2026). https://pith.science/paper/FAYM6PCV

@misc{pith2026241119387,
  author       = {Pith},
  title        = {Pith review of: Enhancing Accuracy and Efficiency in Calibration of Drinking Water Distribution Networks Through Evolutionary Artificial Neural Networks and Expert Systems},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/FAYM6PCV}},
  note         = {Machine review of arXiv:2411.19387}
}

read the original abstract

The importance of drinking water distribution networks (DWDNs) as critical urban infrastructures has led to the development and utilization of models for the analysis, design, operation, and management of DWDNs, to ensure optimal efficiency and water quality. In order to provide models that accurately represent real-world behavior and characteristics of an actual DWDN, model calibration is an essential and crucial procedure (Alves et al., 2014). However, since DWDNs are generally large, underground networks, data availability for model calibration is often an issue. In this paper, we introduce a novel automatic calibration methodology called Expert Systems and Neuro-Evolution of Augmenting Topologies (ES-NEAT). The proposed methodology leverages the power of Expert Systems (ES) and genetic algorithms for the evolution of neural network topologies to efficiently search for the optimal solution of high dimensional calibration problems while maintaining moderate computational effort. One of the key strengths of ES-NEAT lies in its ability to achieve high accuracy even with limited availability of measurements, addressing the inherent uncertainty in real-world DWDNs. By integrating specific knowledge provided by different stakeholders using the ES methodology, the framework offers a flexible approach that adapts to the unique characteristics of each drinking water distribution network. Moreover, the methodology is designed to store calibration information and transfer it in a structured format for use in subsequent calibration processes, increasing efficiency and ensuring generalizability. The method was successfully applied to a benchmark network model as well as a real-case study of a DWDN in Flanders, Belgium.

Figures

Figures reproduced from arXiv: 2411.19387 by the authors.

**Figure 3.** ES-NEAT methodology [PITH_FULL_IMAGE:figures/full_fig_p012_3.png] view at source ↗

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

3 extracted references · 1 canonical work pages

[1]

Calibración de redes de distribución de agua potable a través de inteligencia artificial

Abadi, M., Agarwal, A., Barham, P ., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., … Research, G. (2016). TensorFlow: Large -Scale Machine Learning on Heterogeneous Distributed Systems. https://arxiv.org/abs/16...

arXiv 2016
[10]

https://doi.org/10.1007/S13201-018-0672-3/FIGURES/2 Jain and Singh. (2003). Chapter 4 Statistical techniques for data analysis. Developments in Water Science, 51(C), 207–276. https://doi.org/10.1016/S0167-5648(03)80058-8 Kaisler, S. H. (1986). Expert Systems: An Overview. IEEE Journal of Oceanic Engineering , 11(4), 442–448. https://doi.org/10.1109/JOE.19...

work page arXiv 2003
[1910]

https://doi.org/10.3390/app10061910 Meirelles, G., Manzi, D., Brentan, B., Goulart, T ., & Luvizotto, E. (2017). Calibration Model for Water Distribution Network Using Pressures Estimated by Artificial Neural Networks. Water Resources Management , 31(13), 4339 –4351. https://doi.org/10.1007/S11269 - 017-1750-2/METRICS Mnih, V ., Kavukcuoglu, K., Silver, D...

arXiv 2017

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.

[1] [1]

Calibración de redes de distribución de agua potable a través de inteligencia artificial

Abadi, M., Agarwal, A., Barham, P ., Brevdo, E., Chen, Z., Citro, C., Corrado, G. S., Davis, A., Dean, J., Devin, M., Ghemawat, S., Goodfellow, I., Harp, A., Irving, G., Isard, M., Jia, Y., Jozefowicz, R., Kaiser, L., Kudlur, M., … Research, G. (2016). TensorFlow: Large -Scale Machine Learning on Heterogeneous Distributed Systems. https://arxiv.org/abs/16...

arXiv 2016

[2] [10]

https://doi.org/10.1007/S13201-018-0672-3/FIGURES/2 Jain and Singh. (2003). Chapter 4 Statistical techniques for data analysis. Developments in Water Science, 51(C), 207–276. https://doi.org/10.1016/S0167-5648(03)80058-8 Kaisler, S. H. (1986). Expert Systems: An Overview. IEEE Journal of Oceanic Engineering , 11(4), 442–448. https://doi.org/10.1109/JOE.19...

work page arXiv 2003

[3] [1910]

https://doi.org/10.3390/app10061910 Meirelles, G., Manzi, D., Brentan, B., Goulart, T ., & Luvizotto, E. (2017). Calibration Model for Water Distribution Network Using Pressures Estimated by Artificial Neural Networks. Water Resources Management , 31(13), 4339 –4351. https://doi.org/10.1007/S11269 - 017-1750-2/METRICS Mnih, V ., Kavukcuoglu, K., Silver, D...

arXiv 2017