REVIEW 4 major objections 5 minor 18 references
Generic Rolling Access to Synchrotron Radiation Facilities
T0 review · 4 major / 5 minor · reviewed 2026-08-05 · deepseek-v4-flash
Pith's one-line read A generic rolling access model can reduce synchrotron beamtime waits from about nine months to about two months while keeping expert review.
desk verdict Sensible rolling-access proposal from DESY, but the wait-time claims are only as strong as a simulation that doesn't add up as reported. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is a continuously updated proposal stack combined with a look-ahead schedule divided into n time slices, each with its own filling factor f_i, meaning the fraction of available shifts already booked. New proposals are ranked by an absolute rating from external reviewers, refined in regular panel meetings, and inserted into the stack immediately, so the ranking always reflects the current set of requests. The schedule is only partially filled in the near future—for example, the first slice may be fully booked while later slices are deliberately left at 30% and 10%—so that highly ranked urgent proposals can be fitted quickly while long-preparation projects are schedu
What would settle it
Measure the actual submission-to-beamtime distribution from the five test beamlines over a full year: if top-ranked academic proposals consistently wait more than 40 days, or the average wait is not near two months, the model's central quantitative claim is contradicted.
Extended reading notes
Core claim
This paper claims that the conventional call-based access model used by most synchrotron facilities—where proposals are collected at fixed deadlines, reviewed together, and then scheduled—can be replaced by a generic rolling access model that handles submission, evaluation, and scheduling continuously. The model's quantitative promise is a reduction in the typical wait from proposal submission to beamtime from roughly nine months under bi-annual calls to about two months on average, with the highest-ranked proposals scheduled within 15 to 40 days, and about two weeks for commercial customers at some beamlines. The evidence is a simulation of 450 virtual proposals arriving uniformly over 730
Load-bearing premise
The headline wait times rest on a simulation whose inputs—uniform random proposal arrivals, normally distributed ratings, 3 to 18 shift requests, and a three-month removal rule—are assumed rather than measured from real facility operations.
Editorial extensions
If this is right
- Proposal submission becomes deadline-free: one unified scheme replaces separate calls for regular, long-term, block-allocation, and rapid-access proposals, with only two templates split by requested shifts.
- The average wait between submission and first beamtime falls from about nine months to roughly two months for academic users, and to about two weeks for commercial customers on tested beamlines.
- Users can split approved shifts across multiple beamtime blocks and, once project-based access is added, can request multiple beamlines through a single proposal, enabling milestone-driven experiments.
- Proposals stay valid longer (up to two years in the test), giving teams flexible preparation time beyond a single scheduling period without losing priority.
- The scheduling parameters can be tuned per beamline, including a parameter set that reproduces the conventional six-month call model, so facilities can migrate gradually rather than switching abruptly.
Reading between the lines
- The paper leaves implicit that the same stack-and-filling-factor machinery could apply to other proposal-driven shared research facilities, such as neutron sources, free-electron lasers, or central imaging laboratories.
- A testable consequence the paper does not pursue is inserting fixed 'benchmark' proposals at regular intervals to check whether absolute reviewer ratings drift as the proposal pool changes over time.
- Because the simulation excludes review time and uses synthetic arrival and rating distributions, the natural validation is a before/after comparison of real submission-to-beamtime distributions once enough test-phase data accumulate.
- The two simulation runs reveal a tunable trade-off between access speed and beamtime utilization—more aggressive scheduling gives faster access but more unscheduled days—so each beamline could optimize its own slice lengths and filling factors.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a generic rolling access model for synchrotron radiation beamtime, intended to replace the conventional call-based access model. In the proposed scheme, proposal submission, external review, and scheduling all operate continuously, with a dynamic ranking stack, a three-period filling-factor schedule, and a validity/removal rule. The authors claim that this approach significantly reduces waiting times between proposal submission and experiment execution, and they support this with a simulation of two parameterized scheduling cases (Section 1.9). The manuscript also describes a test phase at five PETRA III beamlines and discusses advantages (unified submission, flexibility, multiple beamtimes) and challenges (dynamic ranking, near-cutoff proposals).
Significance. If the quantitative claims were robust, the model could have practical impact on user access at synchrotron facilities, addressing well-documented delays in the conventional call-based model. The paper's conceptual contribution—a unified rolling framework with explicit scheduling and review procedures—is useful and timely, and the planned test phase at PETRA III is a strength. The authors also make the model's parameters explicit, which is a good starting point for simulation and comparison. However, the current simulation evidence is not sufficient to establish the headline reduction in waiting times; the reported numbers contain a direct internal inconsistency and the results are largely predetermined by the selected scheduling and removal parameters. The central claim is therefore plausible but not yet demonstrated at the level of rigor expected for a quantitative performance claim.
major comments (4)
- [§1.9, Figure 3 caption] The simulation evidence is internally inconsistent: Section 1.9 states 'A total of 450 virtual beamtime requests were randomly distributed over 730 days,' whereas the Figure 3 caption says 'The simulation has been performed with 110 project proposals.' With 3–18 shifts per request, these imply total requested loads of roughly 4,700 and 1,150 shifts, respectively, against a horizon that provides on the order of 700 shifts over 730 days under the stated filling factors (case 1: 30 days at f=1, 60 days at f=0.3, 90 days at f=0.1 repeated). The waiting-time distributions, the fraction of sessions cut by one day, and the 2%/3.3% unscheduled-days figures are all sensitive to this load difference. The authors must correct this contradiction and provide the exact algorithmic specification or code; otherwise the reported quantitative claims cannot be reproduced or checked.
- [§1.9, scheduling rules] The reported result that top-ranked proposals are scheduled within 15–40 days is forced by construction: the first scheduling period Δt1 has filling factor f1=1, so the highest-ranked proposals in the stack are necessarily scheduled into that first period. Similarly, the removal rule c=3 months caps the scheduled waiting time at about three months, making the 'average wait time of two months' largely an artifact of the chosen parameters rather than an independent finding. The paper should report waiting times as a function of c and f1, and clearly separate 'time to scheduling' from 'total time from submission to execution,' since the simulation explicitly excludes review time.
- [§1.9, simulation inputs and sensitivity] The simulation uses synthetic input distributions—uniform proposal arrivals over 730 days, normally distributed ratings with mean 2.5 and standard deviation 1.0, requested shifts between 3 and 18—with no error bars, no sensitivity analysis, and no comparison with real queue data from the five PETRA III test beamlines. The central quantitative claim is therefore not yet an empirical prediction; it is an illustration conditioned on parameters that have not been validated. A sensitivity analysis over plausible arrival rates, rating distributions, and request sizes is required before the wait-time reduction can be claimed as a general property of the rolling access model.
- [§1.9, Figure 3c/3d] The two simulation cases (case 1 and case 2) are compared only through two selected parameter sets, with no statistical characterization of the outputs. Statements such as 'the higher-ranked proposals could be scheduled within less than 40 days' and '3.3% of all days remain unscheduled' are point estimates from a single stochastic run; without multiple runs or confidence intervals, these differences (2% vs 3.3%) cannot be interpreted as reliable findings. The paper should provide summary statistics over multiple seeds or a deterministic specification if the scheduling process is fully deterministic.
minor comments (5)
- [Abstract and §1.2] Grammar: 'This significantly reduces the waiting times ... than that of the call-based access model' should be 'compared with' or 'relative to.'
- [§1.9, text vs. figures] The text says 'Figures 3b and 3c illustrate the results for the two case scenarios with correlation plots,' but the correlation plots are actually (c) and (d), while (b) is a schedule example. Please renumber or correct the cross-references.
- [Second page, first paragraph] Typo: 'Commercial customers purchase beamtime through a contract and are receive priority scheduling' should be 'and receive priority scheduling.'
- [Figure 3 caption] The caption does not state the assumed arrival process, rating distribution, or removal rule, even though these are essential to interpreting the plots. Please add these details.
- [Page 3, facility name] SPring-8 is commonly written 'SPring-8' (not 'Spring-8'); please check and standardize facility names throughout.
Circularity Check
No significant circularity: the rolling-access wait-time claims are simulation outputs under explicitly stated parameters, not results equivalent to their inputs; the main issues are internal inconsistency (450 vs 110 proposals) and lack of external benchmarking, which are correctness/reproducibility concerns rather than circularity.
full rationale
The paper does not present a formal derivation chain in which a claimed prediction is an input by construction. The central quantitative claims (e.g., top-ranked proposals scheduled within 40 days, average wait of about two months) come from a discrete-event simulation whose parameters — arrival distribution, rating distribution, requested-shift range, scheduling periods (Δt_i), filling factors (f_i), and removal time c — are all stated as inputs. The output statistics are computed by the scheduling algorithm, not read back from the inputs. The fact that setting f1=1 and Δt1=30 days means the first 30 days are fully scheduled, and that c=3 months removes any proposal waiting longer than three months, are design properties of the simulated policy, not hidden identities that make the result equal to the input. The paper is transparent that review time is excluded and that the parameters are starting points for the PETRA III test phase. Self-citations (e.g., reference [10] to ESRF access modes, beamline descriptions) are descriptive and not load-bearing premises of the rolling-access model; no uniqueness theorem or prior-work ansatz is invoked to force the chosen schedule. The internal inconsistency between the text's '450 virtual beamtime requests' and Figure 3's '110 project proposals' is a serious reproducibility flaw, and the absence of real facility data or an external benchmark limits the strength of the wait-time claims, but these are not circularity: the simulation does not assume the waiting-time results it reports. Therefore the appropriate circularity score is 0.
Assumptions & free parameters
free parameters (9)
- S* =
21 shifts
- Smax =
72 shifts
- Tvalidity =
2 years
- Simulation rating distribution =
Normal, mean 2.5, std 1.0, range 1.0-5.0
- Simulation requested shifts =
Uniform between 3 and 18 shifts
- Simulation arrival process =
450 random arrivals over 730 days
- Scheduling parameters case 1 =
(30d, 60d, 90d, 1, 0.3, 0.1, 3 months, 1 week)
- Scheduling parameters case 2 =
(15d, 85d, 55d, 1, 0.15, 0.12, 3 months, 1 week)
- Test-phase scheduling parameters =
(2 months, 2 months, 2 months, 1, 0.7, 0.2, 6 months, 1 week)
assumptions (5)
- domain assumption Reviewer ratings on a 1-5 scale are comparable across time and can be stacked into a single ranked list.
- ad hoc to paper Proposal arrivals and ratings in the simulation follow the specified random distributions.
- domain assumption External expert review for each proposal can be completed within two weeks.
- ad hoc to paper Scheduling can shorten or split approved experimental sessions to fit the schedule.
- domain assumption Average waiting times for conventional access are approximately nine months for bi-annual and six months for tri-annual calls.
Cite this review
Pith. "Pith review of Generic Rolling Access to Synchrotron Radiation Facilities." pith.science (2026). https://pith.science/paper/PTVKGWTC
@misc{pith2026250902246,
author = {Pith},
title = {Pith review of: Generic Rolling Access to Synchrotron Radiation Facilities},
year = {2026},
howpublished = {\url{https://pith.science/paper/PTVKGWTC}},
note = {Machine review of arXiv:2509.02246}
}
read the original abstract
A generic model for rolling access to synchrotron radiation experiments is presented, which has the capacity to replace call-based access models. Proposal submission, evaluation and scheduling are all executed in a rolling fashion. This significantly reduces the waiting times between proposal submission and experiment execution than that of the call-based access model. The generic rolling access model is in principle applicable to any beamlines, regardless of the number of experimental methods or setups it provides to users. This access model is flexible and could provide faster access compared to call-based access model as well as accommodate experiments and projects requiring extended preparation times.
Reference graph
Works this paper leans on
-
[1]
An introduction to synchrotron radiation: techniques and applications
Willmott, Philip. An introduction to synchrotron radiation: techniques and applications. John Wiley & Sons, 2019. Print ISBN:9781119280392 |Online ISBN:9781119280453
work page 2019
-
[2]
History of synchrotron radiation
Robinson, Arthur L. "History of synchrotron radiation." Synchrotron Radiation News 28.4 (2015): 4-9
work page 2015
-
[3]
Mobilio, Settimio, Federico Boscherini, and Carlo Meneghini. Synchrotron Radiation. Springer-Verlag Berlin An, 2016
work page 2016
-
[4]
Chemical imaging of catalytic solids with synchrotron radiation
Beale, Andrew M., Simon DM Jacques, and Bert M. Weckhuysen. "Chemical imaging of catalytic solids with synchrotron radiation." Chemical Society Reviews 39.12 (2010): 4656- 4672
work page 2010
-
[5]
Synchrotron radiation research
Winick, Herman, and Sebastian Doniach. Synchrotron radiation research. Springer Science & Business Media, 2012. 18/19
work page 2012
-
[6]
Adapting the European Synchrotron to Industry
Capria, Ennio, et al. "Adapting the European Synchrotron to Industry." Synchrotron Radiation News (2024): 1-6
work page 2024
-
[7]
Käck, H. "Macromolecular crystallography from an industrial perspective – the impact of synchrotron radiation on structure-based drug discovery" Journal of Synchrotron Radiation 32, (2005): 294-303
work page 2005
-
[8]
Materials characterization by synchrotron x-ray microprobes and nanoprobes
Mino, Lorenzo, et al. "Materials characterization by synchrotron x-ray microprobes and nanoprobes." Reviews of Modern Physics 90.2 (2018): 025007
work page 2018
Show all 18 references
-
[9]
From scientific experiments to innovation: Impact pathways of a Synchrotron Light Facility
Catalano, Gelsomina, et al. "From scientific experiments to innovation: Impact pathways of a Synchrotron Light Facility." Annals of Public and Cooperative Economics 92.3 (2021): 447- 472
2021
-
[10]
ESRF Prepares New User Access Modes
McCarthy, J., and H. Reichert. "ESRF Prepares New User Access Modes." (2022): 52-54
2022
-
[11]
The high-resolution diffraction beamline P08 at PETRA III
Seeck, O. H., et al. "The high-resolution diffraction beamline P08 at PETRA III." Journal of synchrotron radiation 19.1 (2012): 30-38
2012
-
[12]
A grazing incidence diffraction setup for Langmuir trough experiments at the high-resolution diffraction beamline P08 at PETRA III
Shen, Chen, René Kirchhof, and Florian Bertram. "A grazing incidence diffraction setup for Langmuir trough experiments at the high-resolution diffraction beamline P08 at PETRA III." Journal of Physics: Conference Series. Vol. 2380. No. 1. IOP Publishing, 2022
2022
-
[13]
A novel X-ray diffractometer for studies of liquid–liquid interfaces
Murphy, Bridget M., et al. "A novel X-ray diffractometer for studies of liquid–liquid interfaces." Journal of synchrotron radiation 21.1 (2014): 45-56
2014
-
[14]
The new dedicated HAXPES beamline P22 at PETRA III
Schlueter, C., et al. "The new dedicated HAXPES beamline P22 at PETRA III." AIP Conference Proceedings. Vol. 2054. No. 1. AIP Publishing, 2019
-
[15]
A high-pressure x-ray photoelectron spectroscopy instrument for studies of industrially relevant catalytic reactions at pressures of several bars
Amann, Peter, et al. "A high-pressure x-ray photoelectron spectroscopy instrument for studies of industrially relevant catalytic reactions at pressures of several bars." Review of Scientific Instruments 90.10 (2019). 19/19
2019
-
[16]
Development of an in-vacuum x-ray microscope with cryogenic sample cooling for beamline P11 at PETRA III
Meents, Alke, et al. "Development of an in-vacuum x-ray microscope with cryogenic sample cooling for beamline P11 at PETRA III." X-Ray Nanoimaging: Instruments and Methods. Vol. 8851. SPIE, 2013
2013
-
[17]
Status of the crystallography beamlines at PETRA III
Burkhardt, Anja, et al. "Status of the crystallography beamlines at PETRA III." The European Physical Journal Plus 131 (2016): 1-9
2016
-
[18]
PETRA IV: the ultralow-emittance source project at DESY
Schroer, Christian G., et al. "PETRA IV: the ultralow-emittance source project at DESY." Journal of synchrotron radiation 25.5 (2018): 1277-1290
2018
Reviewed August 5, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.