REVIEW 3 major objections 5 minor 23 references
A Divide-and-Conquer Approach for Modeling Arrival Times in Business Process Simulation
T0 review · 3 major / 5 minor · reviewed 2026-08-07 · deepseek-v4-flash
Pith's one-line read AT-KDE claims that splitting arrival data by global trend, weekday, and intraday bin and fitting a kernel density estimate to each subset is more accurate and robust than static or learned arrival models in business process simulation…
desk verdict Solid empirical arrival-modeling pipeline for BPS; the 'robust' claim needs tempering and variance reporting, but it deserves review. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the three-level partition of the arrival dataset into disjoint subsets, followed by a dedicated Gaussian KDE per subset, where KDE stands for kernel density estimation, a non-parametric density estimator that smooths observed samples with a kernel. The partition is found by (1) detecting change points in sliding-window differences of moving-average daily arrival counts and clustering the resulting segments with DBSCAN, (2) clustering weekdays within each global segment using Ward's method, and (3) splitting each day into equal time bins. Each subset's inter-arrival times are then modeled by a KDE with bandwidth chosen by Silverman's rule and refined on a validation split. The partition converts a globally non-stationary arrival process into locally stationary pieces, so that a simple static density estimator suffices inside each piece; the ensemble of KDEs is what generates new timestamps, and the segment-label sequence is what decides which piece applies to a simulated day.
What would settle it
Take an event log where daily arrivals drop sharply immediately after the training period, fit AT-KDE with its default settings, and compare its square-root CADD on the test period with that of a trend-fitted baseline. If the baseline's CADD is substantially lower and the difference vanishes when the most-recent-segment fallback is replaced with a trend extrapolation, the paper's central robustness claim is falsified for that scenario.
Extended reading notes
Core claim
The central discovery the paper defends is that a non-parametric, divide-and-conquer arrival model can capture the dynamic structure of real organizational arrivals that static distributions miss, while remaining computationally cheap. AT-KDE works in three partitioning steps: change-point detection on moving averages of daily arrival counts plus DBSCAN clustering groups periods into global segment clusters; Ward clustering groups days of the week within each global cluster; and each day within a weekday cluster is cut into equal-length bins. A KDE over inter-arrival times is fitted to each subset, and simulation samples from the corresponding KDE for each simulated day, bin by bin, replicating recurring global patterns or falling back to the most recent segment when no recurrence is found. The paper's evidence is experimental: across 20 logs spanning finance, government, and healthcare, AT-KDE produced the best average square-root CADD in 12 logs and near-best results in most others, with a notable miss on a log where arrivals drop abruptly in the test period. The claim is therefore that the partition-plus-KDE recipe is both more accurate and more robust than static distribution fitting, decomposition-based forecasting, and learned forecasting models.
Load-bearing premise
If no repeating global pattern can be seen in the training data, AT-KDE assumes the most recent segment's behavior continues into the future, and that assumption is what fails when the simulation period behaves differently.
Editorial extensions
If this is right
- If AT-KDE's accuracy carries over into full simulation, simulators that use it should produce more trustworthy cycle-time, waiting-time, and resource-utilization estimates, because arrival load directly drives congestion.
- The approach needs only case start timestamps, so any event log with start times can feed it without extra data collection.
- On logs with little global drift, AT-KDE performs on par with static baselines, meaning it degrades gracefully instead of hurting accuracy.
- For logs with abrupt test-period changes, AT-KDE is not the best choice; a trend-focused forecaster can catch a drop that segmentation does not see.
- The empirical win on 12 of 20 logs with near-best gaps on most others supports the paper's robustness claim, but the single large miss shows the fallback rule is the limiting failure mode.
Reading between the lines
- The same segment-cluster-bin-fit-KDE recipe could be applied to other time-dependent simulation inputs, such as activity durations or inter-event delays; the paper names this as future work, and a testable extension would compare event-level distribution distances.
- The paper's segmentation features are coarse daily counts and inter-arrival percentiles; using richer features, such as spectral or quantile summaries, might reduce reliance on the most-recent-segment fallback on logs with subtle trends.
- Because the method samples from KDEs of inter-arrival times within fixed bins, it cannot produce arrivals outside the observed working hours; if a simulation needs to test schedule changes, the bin bounds would need to be learned or relaxed.
- A full-process evaluation that propagates these arrivals through a resource-aware simulator would likely show larger gains on cycle-time metrics than on arrival CADD alone, since correct load is the main driver of queuing delay.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes AT-KDE, a divide-and-conquer method for modeling case-arrival times in business process simulation. AT-KDE segments the arrival time series globally, clusters weekdays, bins each day into intraday intervals, fits one kernel density estimate per cell of this partition, and then generates new arrival timestamps by sampling from the appropriate KDE models. The authors evaluate AT-KDE on 20 event logs against seven baselines (Mean, Best Distribution, Prophet, LSTM, Chronos, XGBoost, and a Hawkes-process-based NPP), reporting the square-root Case Arrival Distribution Distance (CADD) on a temporal hold-out split. They report that AT-KDE achieves the best score on 12 of 20 logs and is substantially faster at simulation time than the dynamic baselines, and they conclude that AT-KDE is more accurate and robust than existing approaches.
Significance. If the empirical claims hold, the paper makes a useful contribution: it provides a non-parametric, computationally efficient arrival model that captures multiple temporal scales, and it evaluates the method on a broad, publicly available benchmark with a temporal split and several strong baselines. The release of code and results is a concrete strength. The main limitation is that the headline claims of accuracy and, especially, robustness are stronger than the evidence reported in the paper: no error bars or significance tests are shown for the 10-run averages, and the one large failure (Hospital) plus the acknowledged heuristic for future segment assignment leave the robustness claim under-supported. The central method is sound, but the evidence base needs strengthening before the claims can be accepted at face value.
major comments (3)
- [Section 5.2, Table 2] Table 2 reports only the mean square-root CADD over 10 runs and does not report standard deviations, confidence intervals, or significance tests, although the text says the repository contains the full overview including standard deviations. The claim that AT-KDE is "far more accurate and robust" is load-bearing and cannot be assessed from the means alone: 12 of 20 wins could be consistent with substantial run-to-run overlap, and the Hospital row shows a large loss to Prophet. Please include per-log error bars (or per-run distributions) and at least pairwise significance tests (e.g., corrected paired tests) for the headline comparisons, and then qualify the robustness claim according to what those tests show.
- [Section 4.5, Algorithm 3; Section 6 (Limitations)] The future segment assignment is a zero-order forecast: when the training label sequence L shows no recurring pattern, EstimateSegmentCluster reuses the most recent global segment cluster for the whole simulation horizon. This step determines which KDE submodels generate every simulated arrival, so it is load-bearing. The Hospital result and the paper's own Limitations paragraph confirm the risk: a sudden test-period decrease in arrivals is exactly the kind of trend this fallback cannot anticipate. To support the robustness claim in the regime the paper itself motivates (global dynamics that change after the training window), please report how often this fallback is active across the 20 logs, compare its behavior against simple alternatives (e.g., linear trend extrapolation or retaining multiple recent clusters) on those cases, and restrict the robustness claim to the regimes where it is actually demonstrated.
- [Abstract; Section 5.2] The abstract's phrase "far more accurate and robust" is stronger than what Table 2 shows: AT-KDE is not the best method on 8 of 20 logs, and on Hospital the gap to Prophet is described as substantial. Please replace the unconditional wording with a quantitative, qualified statement (e.g., "best or near-best on most logs, with a known weakness on sudden test-period drops"), and make the conclusion's "superior accuracy and robustness" wording match the reported distribution of outcomes rather than the best-case interpretation.
minor comments (5)
- [Section 4, Input definition] The input is described as "a sequence of N sequences," which appears to be a typo; it should say a sequence of N days (or N daily arrival sequences), since each t_i is the sequence of arrival timestamps on day i.
- [Section 5.1, Hyperparameters] The statement that the chosen configuration "proved robust across diverse datasets" is not supported by any sensitivity analysis in the paper; please add an ablation or refer to a specific repository section that reports sensitivity results for omega, L, k_max, and the DBSCAN parameters.
- [Section 5.1, Data Split] The temporal hold-out split is defined as the first 80% of cases versus the last 20% of cases; please clarify whether cases are sorted by arrival timestamp before splitting and whether this yields a calendar-time test interval, since an uneven arrival rate can make the test period length differ from 20% of the calendar time.
- [Table 2, missing entries] Several benchmark entries are missing (e.g., LSTM and NPP on BPIC19, NPP on BPIC20I); please state whether these are whole-log convergence failures or run-level failures, and explain how missing values are treated in the per-log averaging and in the count of logs where each method is best.
- [Section 3, Table 1] The motivating simulation-quality comparison is based on a single log and reports no confidence intervals; it would be clearer to present it as an illustrative case study rather than as evidence of a general relationship between arrival accuracy and simulation accuracy.
Circularity Check
No significant circularity: AT-KDE is assessed out-of-sample against external benchmarks; the only self-citations are non-load-bearing.
full rationale
AT-KDE is evaluated on a temporal hold-out split (first 80% of cases for training, last 20% for testing) against external benchmarks (Mean, Best Distribution, Prophet, LSTM, Chronos, XGBoost, NPP) using the external CADD metric of Chapela-Campa et al. The test arrivals are never used for fitting: bandwidth is selected on the training portion only, and all segmentation, clustering, and KDE fitting are learned from training data. The central claim is therefore a measured out-of-sample comparison, not a derivation that reduces to its inputs. The only self-citations are [11] (AgentSimulator), used in Section 3 to illustrate the downstream effect of arrival models on simulation quality, and [12], the code repository; neither is used to justify AT-KDE's accuracy, and neither supplies a theorem or fitted value that the experimental comparison depends on. Algorithm 3's fallback (assuming the most recent global cluster when no recurring pattern exists) is a stated heuristic with an acknowledged limitation in the Limitations section; it is a modeling assumption, not a circular step, because it does not define the evaluation metric or the benchmark outcomes. No equation in the paper defines a predicted quantity in terms of the target, and no fitted parameter is renamed as a prediction. Hence there is no significant circularity; the minor self-citation is not load-bearing.
Assumptions & free parameters
free parameters (6)
- bandwidth multiplier k =
not reported (varies per subset)
- window size omega =
7 days
- intraday bins L =
3 (3-hour bins)
- max weekday clusters k_max =
6
- sensitivity range Z =
[0.1, 1]
- DBSCAN eps and min_samples =
unspecified
assumptions (4)
- domain assumption Within each partition subset, inter-arrival times are sufficiently homogeneous to be modeled by a single KDE
- domain assumption Future arrivals follow the most recent global segment cluster when no recurring pattern is found
- domain assumption Change points detected via IQR outlier rule reflect meaningful global dynamics
- standard math Standard statistical results for KDE convergence, Silverman's rule, and clustering algorithms
Cite this review
Pith. "Pith review of A Divide-and-Conquer Approach for Modeling Arrival Times in Business Process Simulation." pith.science (2026). https://pith.science/paper/ILD6QIJS
@misc{pith2026250522381,
author = {Pith},
title = {Pith review of: A Divide-and-Conquer Approach for Modeling Arrival Times in Business Process Simulation},
year = {2026},
howpublished = {\url{https://pith.science/paper/ILD6QIJS}},
note = {Machine review of arXiv:2505.22381}
}
read the original abstract
Business Process Simulation (BPS) is a critical tool for analyzing and improving organizational processes by estimating the impact of process changes. A key component of BPS is the case-arrival model, which determines the pattern of new case entries into a process. Although accurate case-arrival modeling is essential for reliable simulations, as it influences waiting and overall cycle times, existing approaches often rely on oversimplified static distributions of inter-arrival times. These approaches fail to capture the dynamic and temporal complexities inherent in organizational environments, leading to less accurate and reliable outcomes. To address this limitation, we propose Auto Time Kernel Density Estimation (AT-KDE), a divide-and-conquer approach that models arrival times of processes by incorporating global dynamics, day-of-week variations, and intraday distributional changes, ensuring both precision and scalability. Experiments conducted across 20 diverse processes demonstrate that AT-KDE is far more accurate and robust than existing approaches while maintaining sensible execution time efficiency.
Figures
Figures from the paper (1 more)
Reference graph
Works this paper leans on
-
[1]
In: vom Brocke, J., Rosemann, M
van der Aalst, W.M.P.: Business process simulation survival guide. In: vom Brocke, J., Rosemann, M. (eds.) Handbook on Business Process Management 1, Intro- duction, Methods, and Information Systems, 2nd Ed, pp. 337–370. International Handbooks on Information Systems, Springer (2015) A Divide-and-Conquer Approach for Modeling Arrival Times 17
work page 2015
-
[2]
Ansari, A.F., Stella, L., Turkmen, C., et al.: Chronos: Learning the language of time series. TMLR (2024)
work page 2024
-
[3]
Decision Support Systems134(2020)
Camargo, M., Dumas, M., González-Rojas, O.: Automated discovery of business process simulation models from event logs. Decision Support Systems134(2020)
work page 2020
- [4]
-
[5]
Chapela-Campa, D., Benchekroun, I., Baron, O., Dumas, M., Krass, D., Senderovich, A.: Can I trust my simulation model? measuring the quality of busi- ness process simulation models. In: BPM. Springer (2023)
work page 2023
-
[6]
Daw, A., Pender, J.: Queues driven by hawkes processes. Stoch. Syst.8(3) (2018)
work page 2018
-
[7]
Dumas, M.: Constructing digital twins for accurate and reliable what-if business process analysis. In: BPM Workshops. vol. 2938, pp. 23–27. CEUR-WS.org (2021)
work page 2021
-
[8]
Dumas, M., Rosa, M.L., Mendling, J., Reijers, H.A.: Fundamentals of Business Process Management. Springer (2013)
work page 2013
Show all 23 references
-
[9]
Ester, M., Kriegel, H.P., Sander, J., Xu, X.: A density-based algorithm for discov- ering clusters in large spatial databases with noise. In: KDD. AAAI Press (1996)
1996
-
[10]
Princeton University Press (1994)
Hamilton, J.D.: Time Series Analysis. Princeton University Press (1994)
1994
-
[11]
In: ICPM
Kirchdorfer, L., Blümel, R., Kampik, T., van der Aa, H., Stuckenschmidt, H.: Agentsimulator: An agent-based approach for data-driven business process simu- lation. In: ICPM. pp. 97–104. IEEE (2024)
2024
-
[12]
https://doi.org/10.5281/zenodo.15489114
Kirchdorfer, L., Özdemir, K., Kusenic, S., Van der Aa, H., Stuckenschmidt, H.: Codebase: A divide-and-conquer approach for modeling arrival times in business process simulation (May 2025). https://doi.org/10.5281/zenodo.15489114
2025 doi
-
[13]
machine learning approaches for time series forecasting in data driven networks
Kontopoulou, V.I., Panagopoulos, A.D., Kakkos, I., Matsopoulos, G.K.: A review of arima vs. machine learning approaches for time series forecasting in data driven networks. Future Internet15(8) (2023)
2023
-
[14]
Procedia CIRP99, 650– 655 (2021), 14th CIRP Conference on Intelligent Computation in Manufacturing Engineering, 15-17 July 2020
Lindemann, B., Müller, T., Vietz, H., Jazdi, N., Weyrich, M.: A survey on long short-term memory networks for time series prediction. Procedia CIRP99, 650– 655 (2021), 14th CIRP Conference on Intelligent Computation in Manufacturing Engineering, 15-17 July 2020
2021
-
[15]
Springer (2022)
López-Pintado, O., Dumas, M.: Business process simulation with differentiated resources: Does it make a difference? In: BPM. Springer (2022)
2022
-
[16]
In: BPM Workshops
Martin, N., Depaire, B., Caris, A.: Using event logs to model interarrival times in business process simulation. In: BPM Workshops. pp. 255–267. Springer (2015)
2015
-
[17]
In: ICPM
Meneghello, F., Francescomarino, C.D., Ghidini, C.: Runtime integration of ma- chine learning and simulation for business processes. In: ICPM. IEEE (2023)
2023
-
[18]
The An- nals of Mathematical Statistics33(3), 1065 – 1076 (1962)
Parzen, E.: On Estimation of a Probability Density Function and Mode. The An- nals of Mathematical Statistics33(3), 1065 – 1076 (1962)
1962
-
[19]
BMC Med- ical Informatics Decis
Porto, B.M., Fogliatto, F.S.: Enhanced forecasting of emergency department pa- tient arrivals using feature engineering approach and machine learning. BMC Med- ical Informatics Decis. Mak.24(1), 377 (2024)
2024
-
[20]
Rozinat, A., Mans, R.S., Song, M., van der Aalst, W.M.P.: Discovering simulation models. Inf. Syst.34(3), 305–327 (2009)
2009
-
[21]
Chapman & Hall, London (1986)
Silverman, B.W.: Density Estimation for Statistics and Data Analysis. Chapman & Hall, London (1986)
1986
-
[22]
American Statistician72(1) (2018)
Taylor, S.J., Letham, B.: Forecasting at scale. American Statistician72(1) (2018)
2018
-
[23]
Journal of the American Statistical Association58(301), 236–244 (1963)
Ward Jr., J.H.: Hierarchical grouping to optimize an objective function. Journal of the American Statistical Association58(301), 236–244 (1963)
1963
Reviewed August 7, 2026 · model on record in the stance chip above.
Discussion (0). Sign in to comment.