{"id":"f200eef0-0899-4c24-8de4-05a48baf30b0","arxiv_id":"2606.02696","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":5.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"HERMES is a multidimensional Bayesian framework that recovers correlations between stellar metallicity, planetary mass, and atmospheric metallicity from simulated Ariel-like surveys even with large intrinsic scatter.","lead":"HERMES is a new Bayesian hierarchical modeling tool built to extract population-level correlations across exoplanet properties such as stellar metallicity, planet mass, and atmospheric metallicity from large surveys. It is intended to support survey design and data interpretation for the Ariel mission by testing recovery of injected trends in simulated datasets.","discovery_kind":"new_method","skeptic_critique":{"model":"grok-4.3","headline":"Recovery shown only for author-injected trends; fidelity of those trends to real Ariel Tier 2 selection and population statistics untested","rationale":"The load-bearing concern is identical to the reader’s weakest assumption. Because the entire demonstration is simulation-based, the fidelity of the injected trends is the single point at which the central claim could fail to generalize to real Ariel data. The abstract-only review already flags this; the full-text simulation details would only strengthen or weaken the same assumption.","tokens_in":1706,"tokens_out":373,"duration_ms":22542,"concrete_test":"Re-generate the 400-planet Tier 2 surveys using an independent injection model whose mass–metallicity relation and scatter are taken from an external catalog (e.g., the NASA Exoplanet Archive RV+transit sample with its own selection function) rather than the authors’ “plausible” trends; re-fit with HERMES and check whether the posterior on the stellar–planetary metallicity correlation coefficient still recovers the injected value to within 1σ when intrinsic scatter is 1.2 dex.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The headline claim (robust recovery of the stellar–planetary metallicity correlation for ≥400 planets despite 1.2 dex scatter) is demonstrated exclusively on synthetic surveys in which the authors themselves inject the multidimensional trends into the Ariel Mission Candidate Sample. The abstract states only that “plausible” trends are injected and that parameter recovery succeeds; no quantitative validation is provided that the injected joint distributions of mass, stellar metallicity, planetary metallicity, and the survey selection function match the statistical structure expected from real Ariel Tier 2 observations (including any unmodeled covariances or selection biases). If the true population deviates from the injected model, the reported robustness does not necessarily transfer.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The paper introduces HERMES, a multidimensional hierarchical Bayesian framework for probing population-level correlations in exoplanet data, with a focus on the joint relation between stellar metallicity, planetary mass, and atmospheric metallicity. Starting from the Ariel Mission Candidate Sample, the authors select planets with masses and stellar metallicities, inject plausible multidimensional trends into simulated surveys of varying size and leverage, add intrinsic scatter and measurement noise, and demonstrate parameter recovery using independent Bayesian fits to each simulated survey. The central result is that an Ariel Tier 2 transit survey of at least 400 planets allows robust recovery of the stellar-planetary metallicity correlation even with 1.2 dex scatter; the work positions HERMES as a tool for survey design and science-yield forecasting.","tokens_in":1863,"tokens_out":523,"duration_ms":34334,"significance":"If the simulation assumptions hold, the framework offers a controlled way to forecast the detectability of multidimensional trends ahead of Ariel and similar missions, with the explicit demonstration that leverage remains predictive of precision even in the presence of scatter and multiple dimensions. The simulation-based validation with injected trends and noise provides a reproducible testbed for method performance, which is a constructive contribution to population-level exoplanet studies.","major_comments":[{"comment":"Abstract: the headline claim that HERMES 'robustly recovers the correlation between stellar and planetary metallicity' for an Ariel Tier 2 survey of at least 400 planets is demonstrated exclusively on synthetic surveys in which the authors themselves inject the multidimensional trends; no quantitative validation is provided that the injected joint distributions of mass, metallicity, and the survey selection function match the statistical structure or selection biases expected from real Ariel Tier 2 observations.","section":"Abstract"},{"comment":"Abstract (simulation description): the manuscript states that 'plausible multidimensional trends' are injected and that recovery succeeds, but does not report any sensitivity tests in which the fitted model is deliberately misspecified relative to the injection (e.g., different functional forms or additional unmodeled covariances); such tests are load-bearing for the claim of robustness when the true population may deviate from the authors' injection assumptions.","section":"Abstract"}],"minor_comments":[{"comment":"The abstract cites Edwards & Tinetti 2022 for the Mission Candidate Sample but does not indicate whether any updates to that catalog or additional selection cuts are applied; a brief clarification would improve reproducibility.","section":"Abstract"}],"recommendation":"major_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for the constructive feedback. The work is a controlled simulation study using the Ariel Mission Candidate Sample to demonstrate HERMES recovery performance ahead of real observations. We address the two major comments below and will revise the manuscript accordingly.","responses":[{"response":"We agree the demonstration is simulation-based. The injected trends and selection are drawn from the Ariel Mission Candidate Sample (Edwards & Tinetti 2022) combined with literature-informed relations for mass-metallicity trends. Because Ariel Tier 2 data do not yet exist, direct quantitative matching to real observations is not possible. We will revise the abstract and introduction to explicitly state that results are for synthetic surveys with injected trends and to frame the work as a forecasting tool rather than a claim of real-data validation.","revision_made":"yes","referee_comment":"[Abstract] Abstract: the headline claim that HERMES 'robustly recovers the correlation between stellar and planetary metallicity' for an Ariel Tier 2 survey of at least 400 planets is demonstrated exclusively on synthetic surveys in which the authors themselves inject the multidimensional trends; no quantitative validation is provided that the injected joint distributions of mass, metallicity, and the survey selection function match the statistical structure or selection biases expected from real Ariel Tier 2 observations."},{"response":"We acknowledge that misspecification tests would strengthen the robustness assessment. In the revised manuscript we will add a dedicated section (or appendix) containing recovery experiments under deliberate misspecification, including (i) fitting a linear relation when data were generated with a power-law form and (ii) omitting an injected covariance term. These will quantify bias and precision degradation under realistic model mismatch.","revision_made":"yes","referee_comment":"[Abstract] Abstract (simulation description): the manuscript states that 'plausible multidimensional trends' are injected and that recovery succeeds, but does not report any sensitivity tests in which the fitted model is deliberately misspecified relative to the injection (e.g., different functional forms or additional unmodeled covariances); such tests are load-bearing for the claim of robustness when the true population may deviate from the authors' injection assumptions."}],"tokens_in":1451,"tokens_out":462,"duration_ms":20388,"standing_objections":[]},"desk_editor":{"model":"grok-4.3","letter":"The core of this paper is a hierarchical Bayesian model called HERMES that targets correlations across stellar metallicity, planetary mass, and atmospheric metallicity. The authors take the Ariel Mission Candidate Sample, select planets with known masses and stellar metallicities, inject plausible trends plus scatter and noise, then recover the parameters across different sample sizes and leverage levels. They report that a Tier 2 survey of 400 or more planets can still pull out the stellar-planetary metallicity correlation even with 1.2 dex intrinsic scatter.\n\nWhat stands out is the explicit focus on survey design quantities like leverage and how those hold up in multiple dimensions. The simulations include measurement noise and astrophysical scatter, which is a reasonable step beyond simpler single-parameter tests. Hierarchical modeling itself is not new in exoplanet work, but framing it specifically around Ariel's expected data volume and selection gives a concrete forecasting tool.\n\nThe main limitation is that all recovery results come from trends the authors injected themselves. The abstract does not show that those injected joint distributions match the actual statistical structure or selection biases that real Ariel observations will have. Without that check, or without applying the method to any existing dataset, it is hard to know how much the reported robustness will carry over. The paper stops at simulation recovery rather than external validation.\n\nThis is aimed at teams planning Ariel analysis pipelines or similar population studies. Readers who need a ready-to-use code framework for multi-axis trend recovery in noisy survey data will find the methods and simulation results directly useful. It is worth sending to peer review because the application is timely for an active mission and the simulation tests address a practical question, even if later work will need to test against real data or more varied population assumptions.","headline":"HERMES is a packaged hierarchical Bayesian framework for multi-dimensional exoplanet trends that recovers injected signals in Ariel-style simulations, but the tests stay inside the authors' own forward models.","tokens_in":2351,"tokens_out":425,"would_cite":false,"duration_ms":13917,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"HERMES recovers the correlation between stellar and planetary metallicity from Ariel surveys of at least 400 planets despite 1.2 dex scatter.","keywords":["exoplanet atmospheres","Bayesian hierarchical modeling","metallicity correlations","population trends","survey simulation","atmospheric characterization","Ariel mission"],"falsifier":"Applying HERMES to actual Ariel Tier 2 data and recovering a stellar-planetary metallicity correlation strength that deviates significantly from the value obtained in matching simulated surveys of the same size.","tokens_in":2609,"feed_emoji":"🔭","tokens_out":732,"duration_ms":33816,"temperature":0.7,"pith_summary":"The paper introduces HERMES as a multidimensional Bayesian framework to extract population-level correlations from exoplanet atmospheric data. It tests the approach on simulated surveys built from the Ariel candidate sample by injecting known trends among stellar metallicity, planetary mass, and atmospheric metallicity, then attempting to recover those trends. Recovery of the stellar-planetary metallicity link succeeds for samples of 400 or more planets even when intrinsic scatter reaches 1.2 dex and measurement noise is included. This result is useful because upcoming large surveys will produce complex datasets, and the framework shows how to isolate meaningful trends amid the scatter. The tests also confirm that survey leverage continues to indicate how precisely trends can be measured when working in multiple dimensions at once.","feed_headline":"Tool recovers planet metallicity correlation in 400-planet surveys","feed_subtitle":"HERMES shows recovery succeeds for Ariel Tier 2 data even with 1.2 dex intrinsic scatter.","key_machinery":"HERMES, the hierarchical Bayesian framework that jointly models multidimensional population trends while accounting for measurement noise and intrinsic scatter.","core_discovery":"HERMES is a multidimensional Bayesian framework for probing population-level correlations across multiple axes of diversity. Starting from the Ariel Mission Candidate Sample, the authors select planets with known masses and stellar metallicities, inject plausible multidimensional trends, and generate simulated surveys with varying leverage, sample size, intrinsic astrophysical scatter, and measurement noise. By fitting independent Bayesian models to each survey they show that a Tier 2 transit survey of at least 400 planets allows robust recovery of the correlation between stellar and planetary metallicity despite intrinsic scatter in planetary abundances as large as 1.2 dex.","pith_inferences":["If applied to real observations, the same approach could test whether stellar composition directly shapes planetary atmospheric enrichment beyond what formation models predict.","Extending HERMES to additional variables such as orbital distance or host-star type could isolate which factors most influence atmospheric diversity.","The method might be adapted to other upcoming surveys to forecast the minimum sample size needed to detect weaker correlations.","Real data tests would reveal whether unmodeled selection biases alter the apparent strength of recovered trends."],"forward_implications":["A sample of at least 400 planets suffices to recover the stellar-planetary metallicity correlation in the presence of 1.2 dex scatter.","Survey leverage remains a reliable predictor of trend precision even when multiple dimensions and intrinsic scatter are present.","The framework can be used for survey design and science yield forecasting ahead of large atmospheric characterization missions.","Recovery of injected trends holds across a variety of sample sizes and leverage values when realistic noise is included."],"fun_headline_variants":["HERMES recovers stellar-planetary metallicity link in 400-planet Ariel surveys","Tool recovers multidimensional metallicity trends despite 1.2 dex scatter","HERMES shows leverage predicts trend precision across multiple dimensions","Bayesian model recovers metallicity correlation in Tier 2 transit data"],"cache_read_input_tokens":2112,"weakest_assumption_plain":"The multidimensional trends injected into the simulated surveys accurately capture the statistical structure and selection effects present in real exoplanet observations.","fun_headline_variants_meta":{"raw":{"variants":["HERMES recovers stellar-planetary metallicity link in 400-planet Ariel surveys","Tool recovers multidimensional metallicity trends despite 1.2 dex scatter","HERMES shows leverage predicts trend precision across multiple dimensions","Bayesian model recovers metallicity correlation in Tier 2 transit data"]},"model":"grok-4.3","cost_usd":0.00601,"raw_usage":{"total_tokens":2861,"prompt_tokens":699,"num_sources_used":0,"completion_tokens":70,"cost_in_usd_ticks":60099500,"prompt_tokens_details":{"text_tokens":699,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":2092,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":699,"tokens_out":70,"duration_ms":18063,"temperature":1.0,"reasoning_tokens":2092,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-06-28T12:23:29.691220+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"Applying HERMES to actual Ariel Tier 2 data and recovering a stellar-planetary metallicity correlation strength that deviates significantly from the value obtained in matching simulated surveys of the same size.","supporting_citations":[],"review_version":1}