{"id":"9d9bd460-c7fd-4818-b2ab-07222d321d7e","arxiv_id":"1908.02387","paper_version":2,"verdict":"ACCEPT","confidence":"MODERATE","novelty_score":6.0,"correctness_risk":"low","formal_verification":"none","parameter_count":2,"one_line_summary":"Three independent fusion plasma codes agreed closely on vertical displacement event growth rates, plasma motion, and wall and halo currents in a shared axisymmetric benchmark case.","lead":"Three computer codes that model what happens inside a fusion reactor were tested on the same scenario: hot plasma drifting vertically into the surrounding wall. The codes matched on the speed of the failure and on the electrical currents induced in the wall, giving engineers a cross-checked simulation toolkit for fusion device safety.","discovery_kind":"extension","skeptic_critique":{"model":"deepseek-v4-flash","headline":"JOREK reduced-MHD validity is asserted via an unshown 5% F criterion; the benchmark's strongest cross-verification claim needs a direct check in the late nonlinear phase.","rationale":"The paper is a careful benchmark with reusable supplementary files, documented linear scans, and independent code teams, so the central numerical agreement is credible. The most load-bearing uncertainty is not numerics but model equivalence: the full-MHD codes and the reduced-MHD JOREK model are not solving identical equations, and Section 7's Slip Motion Condition is presented as a post-hoc justification rather than a verified-in-simulation constraint. The manuscript states the 5% F deviation but does not show where or when it occurs, and the nonlinear comparison is strongest at late times where the assumption is least secure. The reader identified this same assumption as the weakest point; the present analysis agrees and sharpens it by noting the absence of a time-resolved F diagnostic or an error bound. For a verification benchmark, this is a reasonable condition rather than a fatal flaw, so the verdict should be conditional on supplying the missing diagnostic or a full-MHD reduced-MHD comparison.","tokens_in":10449,"tokens_out":8805,"duration_ms":111950,"concrete_test":"Add a time-dependent diagnostic of max(|F-F_vacuum|/F_vacuum) to the Section 6 runs in all three codes, and require that it stay below 5% through the halo-current comparison time (Zaxis=-1.23 m); if it does, the reduced-MHD concern is resolved, and if it does not, rerun JOREK with its full-MHD model to quantify the model discrepancy.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The benchmark's strongest claim is that the three codes cross-verify each other, which requires JOREK's reduced-MHD results to represent the same physics as the full-MHD models of NIMROD and M3D-C1. Section 7 states that this is justified by the Slip Motion Condition whenever F=RB_phi is close to F_vacuum, and asserts that in the presented simulations these differ by at most 5%. The manuscript, however, gives no time-resolved F diagnostic and derives no error bound connecting a 5% F deviation to errors in growth rates, plasma currents, or halo currents. The nonlinear comparison is made after the plasma touches the wall, when field-line compression and scrape-off currents are strongest; if F deviates beyond 5% during that phase, or if the reduced model omits a term that the full models retain, the late-time agreement in halo currents is not evidence of mutual verification. The paper's own caveat that the exact cause of the linear/nonlinear mismatch 'will need some further investigation' (Section 5) reinforces that model-equivalence is not fully pinned down.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"This paper presents an inter-code benchmark for axisymmetric vertical displacement event (VDE) simulations, comparing the MHD codes M3D-C1, NIMROD, and JOREK on a vertically unstable NSTX-like equilibrium enclosed by a rectangular resistive wall. The authors report linear VDE growth rates from M3D-C1 and NIMROD linear simulations and from the linear phase of axisymmetric nonlinear simulations of all three codes, recovering the expected linear scaling with wall resistivity in the appropriate regime. They then compare full nonlinear VDE evolutions (plasma position, toroidal currents, wall eddy currents, and halo currents) after applying a time shift to align first wall contact and after imposing an artificial thermal quench. The paper finds good (10-15%) agreement in linear growth rates and good qualitative agreement in nonlinear traces, and interprets the JOREK agreement in terms of the reduced MHD 'Slip Motion Condition' justified by a claimed maximum 5% deviation of F=RBphi from the vacuum value. The equilibrium, coil data, and parameter tables are provided as reusable benchmark input.","tokens_in":10672,"tokens_out":9972,"duration_ms":106636,"significance":"If the benchmark is valid, it provides a much-needed verification case for VDE simulations, which are critical for predicting disruption forces in ITER and future tokamaks. The paper is strong in its careful parameter specification, use of three independently developed codes, and candid discussion of caveats (artificial thermal quench, time shifting, and model differences). The supplementary files (geqdsk equilibrium, coil positions) make the case directly reusable by other groups, which is a valuable community contribution. However, the interpretation that JOREK's reduced-MHD results mutually verify the full-MHD codes rests on an unshown 5% F-vacuum proximity claim, and the time-shifting of nonlinear traces raises questions about what precisely is being compared. These issues do not invalidate the raw comparison but need to be addressed for the benchmark's cross-verification claim to be fully supported.","major_comments":[{"comment":"The statement that 'the total toroidal field differed from the vacuum toroidal field by a maximum of 5%' is central to the paper's claim that JOREK's reduced MHD model reproduces the full MHD models, yet it is not supported by any figure, table, or detailed calculation. This 5% bound is asserted without a time-resolved diagnostic, and no error bound connects a 5% deviation in F to the observed agreement in growth rates, plasma currents, or halo currents. Please provide a time-resolved diagnostic of F≡RBphi (or Bphi) at representative plasma locations (e.g., magnetic axis, outboard midplane, and edge) covering the entire nonlinear evolution, including the late phase when the plasma contacts the wall and halo currents are largest. In addition, explain why a 5% deviation is sufficient for the Slip Motion Condition to justify reduced MHD, and discuss whether this condition degrades at any point during the simulation.","section":"Section 7"},{"comment":"The nonlinear time traces are shifted so that the first wall-contact times coincide, but the raw times differ greatly: JOREK makes first wall contact at about 126 ms, NIMROD at about 87.4 ms, and M3D-C1 at about 91.5 ms. The paper attributes this to 'exponential dependency on the initial conditions' but does not state what initial perturbation or numerical noise was used in each code. Please report the initial perturbation amplitudes and show the unshifted traces (in the main text or supplementary material). Without this information, readers cannot assess whether the absolute timing of the VDE is part of the benchmark or whether the 'excellent agreement' in Fig. 8 is largely an artifact of the time alignment.","section":"Section 6"},{"comment":"The artificial thermal quench is imposed by multiplying the perpendicular heat diffusion coefficient by 500 and the particle diffusion coefficient by 20 when the plasma becomes limited by the wall. These are ad-hoc multipliers, yet no sensitivity study is provided. It would strengthen the benchmark to show, for at least one code, how the results (e.g., halo current or wall current) depend on the choice of these factors, or to state explicitly that the benchmark validates the codes' response to a prescribed thermal quench rather than predicting the quench itself. As it stands, the robustness of the excellent agreement to these choices is unclear.","section":"Section 6"}],"minor_comments":[{"comment":"The abstract uses 'excellent agreement' for the nonlinear simulations, but the linear growth rates show deviations up to 15% (Section 5). Consider using 'good' or 'favorable' consistently and quantifying the deviations in the abstract.","section":"Abstract and Section 5"},{"comment":"The panel showing the toroidal current inside the LCFS lacks a NIMROD trace, with no explanation in the text. Please state why NIMROD results are omitted for this quantity or add the trace.","section":"Figure 8(d)"},{"comment":"The definition of Te,eff = Te,edge - Te,off is given in the table caption, but the text should clarify that this offset is used only in the Spitzer resistivity evaluation, not in the temperature evolution equation. This is implied but never explicitly stated.","section":"Table 1 and Section 5"},{"comment":"The estimate that the outer ideal wall influences growth rates by less than 10% is stated without derivation or reference. Please provide a brief justification or cite a previous study for this estimate.","section":"Section 2"},{"comment":"For JOREK, the halo current is computed from the equilibrium relation j×B = ∇p. Since the plasma may not be in exact force balance during a VDE, please discuss the potential error introduced by this approximation.","section":"Section 6"},{"comment":"The notation v = ξγ is nonstandard; it would be clearer to write v = γξ or v = dξ/dt in the linear stability context.","section":"Section 7, Eq. (1)"},{"comment":"Reference [16] is an arXiv preprint; if a published version exists, please update it.","section":"References"}],"recommendation":"major_revision","confidential_remarks":"The author list includes developers of all three codes, which is natural for a benchmark but could raise concerns about the case being tailored to produce agreement. The paper gives no indication of curve-fitting to force agreement; the reported deviations (up to 15% in growth rates, visible differences in nonlinear traces) suggest the benchmark is not tuned. The missing F diagnostic and the time-shift transparency are, however, important for the paper's central cross-verification claim, so I recommend major revision rather than acceptance."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"This is the first documented VDE benchmark among M3D-C1, NIMROD, and JOREK, and it does what a benchmark should: it gives a common NSTX-like case, a rectangular resistive wall, clear parameter tables, and quantitative agreement levels. The linear growth-rate scans agree within a few percent over a wide range of wall resistivities, and the nonlinear time traces of axis position, plasma current, and wall/halo currents line up well. The authors also include the equilibrium and coil files as supplementary material, which makes the case reusable. Credit where due: this is a workmanlike verification exercise, not a new physics result, but it fills a real gap in the code-comparison literature and should be useful to anyone building or testing VDE models.\n\nThe main soft spot is the JOREK reduced-MHD validity. Section 7 says the Slip Motion Condition justifies reduced MHD when F=RB_phi is within 5% of the vacuum value, and the paper asserts that condition holds in these simulations. But it shows no time-resolved F diagnostic and no error bound connecting that 5% to errors in growth rates or halo currents. The nonlinear comparison extends past first wall contact, when field-line compression and scrape-off currents are strongest, so the late-time agreement could be less fundamental than it looks. This is a genuine gap, but it is not fatal: the linear-phase agreement and the qualitative nonlinear agreement stand on their own, and the paper already flags model differences as something to investigate. Two minor caveats: the time traces are shifted to align wall contact, and the thermal quench is artificial, but both are explained and are reasonable for a benchmark.\n\nA second weakness is the lack of convergence or uncertainty quantification. The paper compares polynomial orders in NIMROD and mentions element counts, but no systematic mesh-convergence study is reported. That is a common omission in code benchmarks, and it limits how strongly one can claim the codes agree at the continuum level. Still, the deviations are modest and mostly attributed to known model differences.\n\nWho this is for: plasma MHD code developers, VDE modelers, and people doing ITER disruption assessments. It is not a paradigm shift, but it is a solid, honest benchmark that deserves refereeing. I would accept it with minor revisions: add the time-resolved F check for JOREK, or at least soften the claim, and consider a short convergence appendix. The central verification claim holds and the paper is worth publishing.","headline":"A solid first VDE benchmark among M3D-C1, NIMROD, and JOREK; the reduced-MHD caveat is real but does not sink the paper.","tokens_in":730,"tokens_out":975,"would_cite":true,"duration_ms":28748,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":["52.30.-q","52.55.Fa","52.65.Kj"],"model":"deepseek-v4-flash","headline":"This paper establishes a reusable axisymmetric benchmark showing that three independent nonlinear MHD codes—M3D-C1, NIMROD, and JOREK—agree on vertical displacement event growth rates and wall currents.","keywords":["vertical displacement event","VDE benchmark","nonlinear MHD simulation","resistive wall","halo current","reduced MHD","slip motion condition","tokamak"],"falsifier":"Compute the same benchmark with a lower edge resistivity (higher edge temperature) so response currents form in the open-field-line region, and compare JOREK to M3D-C1 and NIMROD; if the growth rates diverge where halo response dominates, the slip motion justification is not general. Equivalently, a 3D nonlinear VDE run in which F deviates from F_vacuum by more than 5% before first wall contact would test whether reduced MHD remains valid exactly when asymmetric forces matter.","tokens_in":10273,"feed_emoji":"🧲","tokens_out":4777,"duration_ms":47961,"temperature":0.7,"pith_summary":"This paper establishes a benchmark case for vertical displacement events (VDEs), the vertical loss of control of a tokamak plasma toward the vessel wall, and uses it to compare three nonlinear MHD codes: M3D-C1, NIMROD, and JOREK. It claims that the linear VDE growth rates recovered from all three codes agree within about 10% across a range of wall resistivities, and that axisymmetric nonlinear simulations of a full VDE show close agreement in plasma position, plasma current, and eddy and halo currents in the wall. The practical payoff is a reusable verification case for any code aimed at VDE design studies. The paper also explains why JOREK, running a reduced MHD model, matches the full-MHD codes: the slip motion condition holds when the total toroidal field stays within 5% of the vacuum toroidal field.","feed_headline":"Three fusion codes agree on vertical displacement event dynamics","feed_subtitle":"A benchmark case with an NSTX equilibrium lets VDE codes check wall currents and halo forces.","key_machinery":"The load-bearing object is the benchmark case itself: a vertically unstable NSTX-like equilibrium inside an axisymmetric rectangular resistive wall, with defined temperature profiles, Spitzer resistivity, and heat and particle diffusion coefficients. The mechanism that explains the key agreement is the slip motion condition, v = -R²∇u×∇φ, which lets the plasma slide across the large toroidal field without doing work against it; when F=RBφ stays within 5% of the vacuum field, reduced MHD reproduces full MHD for the n=0 vertical instability. The codes' resistive-wall treatments differ—M3D-C1 embeds a thick wall in a single mesh, NIMROD uses a thin-wall vacuum coupling, and JOREK uses the STARWALL Green's function—so the agreement exercises the wall-response physics rather than a shared implementation.","core_discovery":"The central claim is that three independently developed nonlinear MHD codes—M3D-C1, NIMROD, and JOREK—reproduce each other's axisymmetric VDE dynamics well enough to serve as mutual verification. In the low-wall-resistivity, cold-open-field-line regime, all three recover the expected linear dependence of the VDE growth rate on wall resistivity; deviations stay around 3% for most cases and below 15% overall. For the full nonlinear evolution, time-shifted traces of the magnetic-axis position, toroidal currents, and wall and halo currents agree closely between the codes, even though M3D-C1 and NIMROD use full MHD while JOREK uses a reduced MHD model. The authors attribute this agreement to the slip motion condition: for the n=0 instability the plasma moves across the large toroidal field with F≡RBφ within 5% of the vacuum value, which is precisely the regime where reduced MHD is valid.","pith_inferences":["A natural next test is to run the same benchmark without the artificial thermal quench, to see whether the agreement persists through scrape-off and current-profile evolution rather than only at the chosen quench time.","If the slip motion condition degrades in future 3D simulations, JOREK may need the full-MHD STARWALL coupling for asymmetric VDEs; the 5% F deviation observed here gives a quantitative threshold to monitor.","The benchmark's rectangular-wall geometry could be adapted to test other codes' treatment of halo current closure through conducting structures, since halo width is self-consistently determined rather than prescribed."],"forward_implications":["The benchmark case, supplied with equilibrium and coil files, gives other VDE codes a standard test case for validating their linear growth rates and nonlinear evolution.","In the low-wall-resistivity, cold-edge regime, VDE growth rates should scale linearly with wall resistivity; codes that show a different scaling are likely missing wall-response physics.","For n=0 vertical stability, reduced MHD can stand in for full MHD when RBφ stays close to the vacuum toroidal field, enabling cheaper nonlinear VDE simulations.","The three-code agreement on halo currents supports using axisymmetric simulations to estimate vessel forces during the early, symmetric phase of a VDE."],"supporting_citations":[{"why":"Supplies the extended MHD equations and split-implicit time advance used for the M3D-C1 plasma region.","marker":"[10]"},{"why":"Validates the M3D-C1 multi-region resistive wall model against analytic resistive wall mode solutions, grounding the wall model.","marker":"[11]"},{"why":"Describes the NIMROD high-order finite element nonlinear MHD method used in the benchmark.","marker":"[7]"},{"why":"Provides the NIMROD thin-wall model for VDE computations that the benchmark employs.","marker":"[6]"},{"why":"Describes the JOREK-STARWALL coupling for resistive wall simulations used in JOREK runs.","marker":"[9]"},{"why":"Defines the JOREK reduced MHD model whose adequacy is a key question of the benchmark.","marker":"[17]"},{"why":"Supplies the nonlinear axisymmetric resistive MHD context linking large vacuum toroidal field to reduced model validity.","marker":"[18]"},{"why":"Defines the slip motion condition used to justify reduced MHD for the n=0 vertical instability.","marker":"[19]"}],"fun_headline_variants":["One VDE, three codes, all agree","VDE benchmark: 3 codes, tight agreement","Cross-code VDE test: excellent match","Three fusion codes confirm VDE dynamics"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The claim that JOREK's reduced MHD model captures the vertical instability rests on the toroidal field remaining close to its vacuum value (within 5% here); if the field deviates more during the nonlinear evolution, the JOREK agreement with full-MHD codes could be coincidental.","fun_headline_variants_meta":{"raw":{"variants":["One VDE, three codes, all agree","VDE benchmark: 3 codes, tight agreement","Cross-code VDE test: excellent match","Three fusion codes confirm VDE dynamics"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00035,"raw_usage":{"total_tokens":1904,"prompt_tokens":931,"completion_tokens":973,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":547,"completion_tokens_details":{"reasoning_tokens":916}},"tokens_in":547,"tokens_out":973,"duration_ms":10799,"temperature":1.0,"reasoning_tokens":916,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T14:46:40.897065+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Compute the same benchmark with a lower edge resistivity (higher edge temperature) so response currents form in the open-field-line region, and compare JOREK to M3D-C1 and NIMROD; if the growth rates diverge where halo response dominates, the slip motion justification is not general. Equivalently, a 3D nonlinear VDE run in which F deviates from F_vacuum by more than 5% before first wall contact would test whether reduced MHD remains valid exactly when asymmetric forces matter.","supporting_citations":[{"cited_title":"Multiple timescale calculations of sawteeth and other global macroscopic dynamics of tokamak plasmas,","cited_arxiv_id":null,"evidence_quote":"Supplies the extended MHD equations and split-implicit time advance used for the M3D-C1 plasma region."},{"cited_title":"Multi-region approach to free-boundary three-dimensional tokamak equilibria and resistive wall instabilities,","cited_arxiv_id":null,"evidence_quote":"Validates the M3D-C1 multi-region resistive wall model against analytic resistive wall mode solutions, grounding the wall model."},{"cited_title":"Nonlinear magnetohydrodynamics simulation using high-order finite elements,","cited_arxiv_id":null,"evidence_quote":"Describes the NIMROD high-order finite element nonlinear MHD method used in the benchmark."},{"cited_title":"Effects of asymmetries in computations of forced vertical displacement events,","cited_arxiv_id":null,"evidence_quote":"Provides the NIMROD thin-wall model for VDE computations that the benchmark employs."},{"cited_title":"Coupling JOREK and STARWALL codes for non-linear resistive- wall simulations,","cited_arxiv_id":null,"evidence_quote":"Describes the JOREK-STARWALL coupling for resistive wall simulations used in JOREK runs."},{"cited_title":"Non-linear MHD simulations of edge localized modes (ELMs),","cited_arxiv_id":null,"evidence_quote":"Defines the JOREK reduced MHD model whose adequacy is a key question of the benchmark."},{"cited_title":"Wigger, Development and Application of a Nonlinear Axisymmetric Resistive MHD-Code","cited_arxiv_id":null,"evidence_quote":"Supplies the nonlinear axisymmetric resistive MHD context linking large vacuum toroidal field to reduced model validity."},{"cited_title":"Stability of tokamaks with respect to slip motions,","cited_arxiv_id":null,"evidence_quote":"Defines the slip motion condition used to justify reduced MHD for the n=0 vertical instability."}],"review_version":1}