{"id":"dba56df9-5b66-4cce-8244-80ac0c843d79","arxiv_id":"1908.07747","paper_version":1,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":6.0,"correctness_risk":"low","formal_verification":"none","parameter_count":2,"one_line_summary":"In star cluster simulations, 0.3% to 5.3% of planets in solar-system-like architectures escape, with Uranus and Neptune most vulnerable; Jupiter protects inner planets unless directly perturbed.","lead":"This paper ran computer simulations of sun-like stars with six-planet solar systems inside star clusters to see how often planets get kicked out. It finds that Jupiter often shields the inner rocky planets unless Jupiter itself is hit, and that about 0.3% to 5.3% of planets escape within 50 million years.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Nearest-neighbour-only tidal model is the load-bearing approximation; in dense clusters unmodelled simultaneous perturbations could shift the small escape fractions and the Jupiter-barrier conclusion.","rationale":"The reader identified the nearest-neighbour approximation as the weakest assumption, and I agree. The paper's per-planet escape fractions are the central quantitative output; Table 3 gives values of 1.5% for Jupiter to 8.5% for Uranus, with 1σ errors of 0.9–2.0%. The Jupiter-barrier conclusion is built on the causal pattern that terrestrial escapes are usually preceded by a strong perturbation of Jupiter. Both inferences depend on the perturbation history being complete. The approximation of including only the nearest neighbour is stated in §3.2 and is inherited from Cai et al. (2017), but no sensitivity test is reported. In the densest models, the local density is high enough that the smooth tidal field is comparable to the nearest-neighbour term, and simultaneous encounters are not captured. The concern is not that the entire qualitative picture is wrong: the control runs in §3.3.1 show the isolated systems are stable, and the case studies in Section 3.4.3 are plausible. The concern is quantitative: rare escape events can be sensitive to small perturbations, and the quoted fractions have modest Poisson errors (e.g., 3 Jupiter escapes out of 200 in the reference model). A full-tidal-field or multi-neighbour rerun of one dense model would either confirm the approximation or show that the fractions move. The separate contradiction in conclusion (vi) — 'retention rate increases ... with semi-major axis' versus Table 3's increasing escape fractions — is a real internal inconsistency, but it is wording in a summary rather than the central quantitative claim, so I do not treat it as the primary attack. Overall, the conditional verdict stands: accept the qualitative mechanism, require a sensitivity test before relying on the exact escape fractions and the density-dependent Jupiter-barrier statement.","tokens_in":20878,"tokens_out":10110,"duration_ms":111720,"concrete_test":"Re-run the reference model C051E4 (200 host systems) with the same HDF5 star-cluster snapshots, but include the five closest stellar perturbers in the REBOUND integration instead of only the nearest neighbour, and recompute Table 3. If the per-planet escape fractions shift by more than their quoted Poisson errors, or if the ordering 'Jupiter lowest, Uranus/Neptune highest' changes, the nearest-neighbour approximation is load-bearing for the central claim. If the fractions are unchanged, the concern is settled.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central quantitative results — the per-planet escape fractions of 1.5–8.5% in the reference model C051E4 (Table 3) and the protective role of Jupiter (conclusion vii) — are computed in REBOUND with only the instantaneous nearest neighbouring star included as a perturber (§3.2, following Cai et al. 2017). The justification is that the tidal force of a perturber scales as r^-3, so the nearest neighbour dominates. In the dense N=10,000, rvir=1 pc models this is not self-evidently true. At the Plummer centre the mean nearest-neighbour distance is only about 5×10^3 AU, while the smooth cluster tidal field is comparable in magnitude: (4πGρ/3)a_p is a substantial fraction of the tidal acceleration from that single neighbour. More importantly, the second and third neighbours are at comparable distances and act simultaneously; the implementation switches to whichever star is closest, so overlapping encounters and the accumulated effect of several moderate encounters during one outer-planet secular cycle are not modelled. Because the quoted escape fractions are small, an unmodelled perturbation of order a few tens of per cent of the nearest-neighbour tidal term could change Jupiter/Saturn/Uranus escape counts by factors of order two and alter the inferred barrier mechanism. The paper states that this approximation is good in the majority of cases, but it provides no control calculation that includes the full cluster tidal field or several neighbours. A second, separate inconsistency is conclusion (vi), which says retention 'increases to some extent with semi-major axis' while Table 3 shows escape fractions increasing with semi-major axis; this does not break the central claim, but it weakens confidence in the summary wording.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The paper studies the dynamical evolution of Solar-system-like planetary systems (Earth, Mars, Jupiter, Saturn, Uranus, Neptune) embedded in star clusters with N=500, 5,000, and 10,000 stars, virial ratios Q=0.4, 0.5, and 0.6, evolved for 50 Myr. Cluster dynamics is computed with NBODY6++GPU and planetary dynamics with REBOUND, coupled by interpolating the nearest neighbouring star as the only external perturber of each planetary system. The main quantitative results are per-planet escape fractions (e.g., 1.5%-8.5% in the reference model C051E4, Table 3), the overall range 0.3%-5.3%, the observation that Jupiter is the least likely planet to escape and often acts as a dynamical barrier for the terrestrial planets, and the conclusion that planetary systems escaping the cluster at low speed tend to remain intact. The paper also characterises most encounters as tidal, hyperbolic, and adiabatic, and reports delayed planetary ejections occurring up to tens of Myr after a stellar encounter.","tokens_in":1637,"tokens_out":1802,"duration_ms":167074,"significance":"If the results survive the methodological checks below, the paper provides useful quantitative predictions for the dynamical processing of Solar-system analogues in star clusters: per-planet escape fractions, delayed ejections, and a falsifiable 'Jupiter barrier' mechanism that can be compared with exoplanet surveys and cluster observations. Strengths include the use of well-established integrators (REBOUND, NBODY6++GPU), an isolated-system control run (Figure 6) showing that internal dynamics alone does not produce ejections, well-specified Plummer/Kroupa initial conditions, and explicit binomial error bars on escape statistics. The escape fractions are direct simulation outputs rather than results of fitting to target outcomes, which is a further strength. The paper also clearly acknowledges the omission of primordial binaries and of Mercury and Venus as simplifying assumptions.","major_comments":[{"comment":"The central escape fractions and the Jupiter-barrier conclusion rest on modelling only the instantaneous nearest neighbouring star as an external perturber of each planetary system. The r^-3 scaling of the tidal acceleration makes this plausible in sparse environments, but in the N=10,000, rvir=1 pc models the smooth cluster tidal field and the second and third neighbours can jointly contribute a substantial fraction (tens of per cent) of the nearest-neighbour tidal term. The assertion in §3.2.1 that the three-body assumption is good 'in the majority of cases' is not quantified, and no control calculation is provided with the full cluster tidal field or with several neighbours included. Because the quoted escape fractions are small (Table 3: 1.5%-8.5% per planet), unmodelled perturbations of this order could change individual planet escape counts by factors of order two and alter the inferred protective role of Jupiter. I request either a control run with a full cluster tidal field (or at least the first few neighbours) or a quantitative estimate of the neglected terms in the dense models.","section":"§3.2, Tables 3–4, and Conclusion (vii)"},{"comment":"A planet is counted as an escaper when its eccentricity relative to the host star exceeds 0.995, which is below the parabolic limit e=1 and does not verify that the planet is actually unbound. A planet with 0.995<e<1 is formally bound and could return to pericentre, yet it would already be counted as an escaper and removed from the bound population. Since the per-planet escape fractions are small (e.g., Jupiter 1.5%, Uranus 8.5%), this threshold choice can change the reported rates and the relative ordering on which the Jupiter-barrier interpretation is based. Please provide a sensitivity test using e>1 or actual hyperbolic detection, and report how many events have eccentricity in the interval (0.995, 1] at the time of removal.","section":"§2.3 and Table 3"},{"comment":"The paper refers to an 'ensemble' but does not state the number of independent star-cluster realisations per model. Table 1 lists Nhosts=25, 125, or 200 planet-hosting stars, which appears to be the number of planetary systems within one Plummer realisation of each model. The error bars in Tables 2 and 3 therefore appear to be within-cluster binomial uncertainties and do not include cluster-to-cluster variance from different random realisations of the same (N, Q) model. Given the small number of escape events and the stochastic nature of cluster evolution and encounters, the trends in Figure 7 and the global 0.3%-5.3% range could shift with different cluster realisations. Please state explicitly how many independent cluster simulations were performed; if it is one per model, add several independent realisations for at least a subset of models and quantify the realisation-to-realisation scatter.","section":"§2.1–§2.2, Tables 1–3"}],"minor_comments":[{"comment":"The definition of the encounter strength parameter contains an internal inconsistency: the first expression uses (p/ap)^3 while the approximation in the same equation and the subsequent text use (p/ap)^{3/2}, consistent with Eq. (13). Please correct the exponent and check the related expression in Eq. (15).","section":"Eq. (10)"},{"comment":"The conclusion states that the retention rate increases with semi-major axis, but §3.4.1 and Figure 7 show that escape rates increase with semi-major axis; the word should presumably be 'decreases'.","section":"Conclusion (vi)"},{"comment":"The abstract contains a duplicated sentence: 'We investigate the evolution of planetary systems in star clusters' immediately follows 'Here, we numerically explore the evolution of planetary systems similar to our own Solar system in star clusters.'","section":"Abstract"},{"comment":"The caption does not define the error bars; please state explicitly that they are 1-sigma binomial uncertainties (or describe the statistic used).","section":"Figure 7 caption"},{"comment":"The phrase 'a set of seventh-order septic splines' is redundant because 'septic' already means seventh-order; please rephrase.","section":"§3.2"},{"comment":"The heading 'Fraction of escapers among all the planets that were initially present in the planetary systems anymore at time 50 Myr' is ungrammatical; please rephrase for clarity.","section":"Table 3 heading"}],"recommendation":"major_revision","confidential_remarks":"The three major comments identify load-bearing methodological gaps for the central claims: the nearest-neighbour-only tidal model, the e>0.995 escape criterion, and the unclear number of cluster realisations. These are fixable within the scope of the manuscript, so I recommend major revision rather than rejection. The paper would also benefit from an explicit data/code availability statement, since the quoted fractions depend on the non-public LonelyPlanets/h5nb6xx pipeline."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Short version: this is a useful, mostly careful simulation study that gives the first full-N-body numbers for how a Solar-system-analog six-planet architecture survives in star clusters. The per-planet escape fractions and the Jupiter-as-barrier result are new relative to Hao et al. 2013 and Cai et al. 2017. It deserves review, with one substantive request and one clear fix.\n\nWhat it does well: the method is explicit and standard for this group — NBODY6++GPU for the cluster, REBOUND for the planets, nearest-neighbor tidal perturber from the HDF5 output, Plummer clusters with Kroupa IMF, Solar-orbit tidal field. They run isolated-system controls that show no internal instability over 50 Myr, quote Poisson error bars, and include detailed case studies showing delayed ejections tens of Myr after an encounter. The qualitative picture — Jupiter protects the inner planets unless directly hit; Uranus/Neptune escape first — is convincing and consistent with earlier scattering work.\n\nSoft spots. The load-bearing approximation is nearest-neighbor-only tidal perturbation. In the N=10,000, r_vir=1 pc models, the second and third neighbors are at comparable distances and the smooth cluster tidal field is a nontrivial fraction of the nearest neighbor's r^-3 term. Because the escape fractions are small, an unmodeled few-tens-of-percent perturbation can plausibly change Uranus/Neptune escape counts by factors of order two. The paper asserts the approximation is good 'in the majority of cases' but provides no control simulation with the full field or multiple neighbors. That is the one thing I would want before trusting the dense-cluster numbers. It probably does not break the Jupiter-barrier mechanism, which rests on a qualitative dynamical channel rather than a precise rate, but it does put the quantitative escape fractions in the densest models on soft ground.\n\nSecond, conclusion (vi) as written is contradicted by Table 3 and by their own sentence in Section 3.3.2. It says the retention rate 'increases to some extent with semi-major axis,' but escape fractions increase with semi-major axis. That is a summary error that should be fixed.\n\nThe N=500 models have only 25 host systems, giving wide error bars; the authors acknowledge this, so I treat it as minor rather than fatal.\n\nBottom line: central argument holds up qualitatively; dense-cluster numbers need a sensitivity test. This paper will be useful to anyone working on planet formation in clusters or the origin of exoplanet diversity, and it deserves a proper referee rather than a desk reject. Send it out, ask for a control run or explicit justification of the nearest-neighbor approximation, and fix conclusion (vi).","headline":"Solid simulation study with new Solar-system escape fractions; dense-cluster numbers rest on a nearest-neighbor-only approximation that should be tested, and conclusion (vi) needs fixing.","tokens_in":21752,"tokens_out":3218,"would_cite":true,"duration_ms":32458,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Model open clusters eject 0.3%–5.3% of planets from Solar-system-like hosts within 50 Myr, while Jupiter shields the inner planets unless a star hits it directly.","keywords":["planetary dynamics","star clusters","stellar encounters","N-body simulations","Solar system analogues","free-floating planets","habitable zone","dynamical evolution"],"falsifier":"Re-run the densest model (10,000 stars, $r_{\\rm vir}=1$ pc, $Q=0.5$) with the tidal force of every cluster star included instead of only the nearest neighbour, and compare the total escape fraction and the per-planet escape rates. If the 5.3% all-planet escape fraction shifts by more than the stated $0.6\\%$ uncertainty, or if terrestrial ejections no longer require a prior Jupiter perturbation, the paper's central mechanism is contradicted by the simulation design itself.","tokens_in":20705,"feed_emoji":"🪐","tokens_out":7479,"duration_ms":67580,"temperature":0.7,"pith_summary":"This paper asks what happens to a Solar-system-like planetary system when its host star spends its youth inside an open star cluster, and answers with a numerical census. Simulating hundreds of copies of a six-planet system (Earth, Mars, Jupiter, Saturn, Uranus, and Neptune) around Solar-mass stars in clusters of 500–10,000 stars for 50 Myr, it finds that most systems survive but a measurable minority do not: between 0.3% and 5.3% of planets are ejected from their host stars, with Uranus and Neptune the most vulnerable and Jupiter the most resilient. The paper's central insight is that Jupiter acts as a dynamical barrier: it absorbs perturbations aimed at the inner system and protects the terrestrial planets, unless a passing star hits Jupiter itself. If correct, this means the Solar system's survival is not simply a matter of isolation but a consequence of its architecture, and that star-cluster processing can generate the wide diversity seen among exoplanet systems.","feed_headline":"Star clusters eject up to 5.3% of Solar-system-like planets","feed_subtitle":"Most six-planet systems survive 50 Myr; Jupiter's fate decides whether Earth-like planets stay put.","key_machinery":"The carrying mechanism is the dimensionless encounter strength $k_p \\approx (p/a_p)^{3/2}$, which compares a passing star's periastron distance $p$ to a planet's semi-major axis $a_p$: smaller $k_p$ means a stronger perturbation. Because the stellar tide falls as $r^{-3}$, the paper models each planetary system under the tidal force of only its nearest neighbouring star, while the cluster itself is evolved separately and the planets interact with each other through a full N-body integration. The encounter-strength scale converts cluster dynamics into per-planet perturbation rates, and it is what makes Jupiter (massive, moderately close in) a barrier while Uranus and Neptune (light, far out) are the first to go.","core_discovery":"The paper claims that in clusters with initial virial radii of 1 pc and 500–10,000 stars, the fate of a Solar-system analogue over 50 Myr is set mostly by rare close stellar encounters, and that the response splits along mass and semi-major axis. Uranus and Neptune escape most often, either directly when an encounter throws an ice giant out, or indirectly when a flyby excites their eccentricities and planet-planet scattering finishes the job tens of millions of years later. Jupiter escapes least often because it is massive enough that only a direct stellar encounter can eject it, and while Jupiter stays on a quiet orbit it shields Earth and Mars. In low-density clusters this shielding protects habitable-zone planets; in high-density clusters, a perturbed Jupiter becomes the agent that destabilizes and ejects the terrestrial planets. Systems that leave the cluster at low speed typically leave intact, while fast escapes are preceded by disruption, which the paper reads as a hint that the Solar system, if it formed in a cluster, left it slowly.","pith_inferences":["The nearest-neighbour-only approximation leaves a numerical avenue open: including all cluster-member tidal forces in the densest models could raise escape fractions and weaken the Jupiter-barrier effect; this is a test the paper does not perform.","A testable extension of the barrier picture is that exoplanet systems without a gas-giant shield should show systematically different inner-planet loss rates in cluster environments than Solar-system analogues.","The delayed-ejection channel implies that free-floating planets can appear around a cluster long after the encounter that destabilized them, so the age of a free-floating planet need not match the age of the last close encounter."],"forward_implications":["A Solar-system analogue that forms in a low-density cluster will usually keep all six planets for at least 50 Myr, with the outer ice giants as the dominant loss channels.","Terrestrial-planet survival is tied to Jupiter: if a stellar encounter leaves Jupiter's orbit intact, Earth and Mars are protected even when Uranus and Neptune are ejected.","Escape events can be delayed by tens of millions of years, so a cluster that has already dispersed can still be the source of free-floating planets from systems that were perturbed long before.","Clusters that start in virial equilibrium are the harshest for planetary survival, while sub- and super-virial clusters expand quickly and reduce encounter rates.","Identical initial planetary systems become observably diverse after 50 Myr of cluster processing, offering a dynamical explanation for the spread of exoplanet architectures."],"supporting_citations":[{"why":"Establishes the nearest-neighbour tidal-force method and the hybrid cluster/planetary-system integration scheme that this paper follows.","marker":"Cai et al. (2017)"},{"why":"Supplies the encounter-strength parameter $k_p$, the adiabatic/hyperbolic/tidal encounter classification, and the theoretical comparison used throughout.","marker":"Spurzem et al. (2009)"},{"why":"First showed stellar flybys can trigger planetary ejections long after the encounter; the paper confirms these delayed ejections in Solar-system-like architectures.","marker":"Malmberg et al. (2011)"},{"why":"Prior scattering experiments for four gas giants showed Jupiter is perturbed almost exclusively by stars while lower-mass planets are also affected by planet-planet interactions; this motivates the Jupiter-barrier hypothesis.","marker":"Hao et al. (2013)"},{"why":"Establishes the semi-major-axis dependence of planetary retention in open clusters, which the paper compares with its own escape-rate trends.","marker":"Zheng et al. (2015)"},{"why":"Provides single-planet escape probabilities as a function of semi-major axis in nearby clusters; used to benchmark the outer-planet escape rates.","marker":"Fujii & Hori (2019)"}],"fun_headline_variants":["Star cluster flybys fling ice giants but spare Jupiter","Jupiter's shielding dictates which planets survive in clusters","In star clusters, Jupiter protects or dooms Earth-like worlds","Up to 5.3% of planets flee star clusters; ice giants lead"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The entire calculation hangs on the assumption that the only stellar influence worth modeling is the tidal force of the nearest neighbouring star; if the accumulated pulls of many distant cluster stars, or the cluster's smooth potential, matter in the densest clusters, the quoted escape fractions and the Jupiter-barrier picture could change.","fun_headline_variants_meta":{"raw":{"variants":["Star cluster flybys fling ice giants but spare Jupiter","Jupiter's shielding dictates which planets survive in clusters","In star clusters, Jupiter protects or dooms Earth-like worlds","Up to 5.3% of planets flee star clusters; ice giants lead"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.00116,"raw_usage":{"total_tokens":4840,"prompt_tokens":1021,"completion_tokens":3819,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":637,"completion_tokens_details":{"reasoning_tokens":3747}},"tokens_in":637,"tokens_out":3819,"duration_ms":534073,"temperature":1.0,"reasoning_tokens":3747,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-14T11:57:20.565631+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Re-run the densest model (10,000 stars, $r_{\\rm vir}=1$ pc, $Q=0.5$) with the tidal force of every cluster star included instead of only the nearest neighbour, and compare the total escape fraction and the per-planet escape rates. If the 5.3% all-planet escape fraction shifts by more than the stated $0.6\\%$ uncertainty, or if terrestrial ejections no longer require a prior Jupiter perturbation, the paper's central mechanism is contradicted by the simulation design itself.","supporting_citations":[{"cited_title":"B., Heggie D","cited_arxiv_id":null,"evidence_quote":"First showed stellar flybys can trigger planetary ejections long after the encounter; the paper confirms these delayed ejections in Solar-system-like architectures."}],"review_version":1}