{"id":"3d855355-c9c6-4418-9d19-21301f7e23e6","arxiv_id":"2501.01466","paper_version":2,"verdict":"REJECT","confidence":"LOW","novelty_score":4.0,"correctness_risk":"high","formal_verification":"none","parameter_count":0,"one_line_summary":"The paper argues that the magnetic evidence cited in a recent expert comment does not support hydride superconductivity, and that the field's claims rest on unverified or unavailable data.","lead":"A physicist re-examines the magnetization data behind high-pressure hydride superconductivity claims and argues they are experimental artifacts, not superconductivity. The comment disputes a recent manifesto by fifteen experts urging continued funding for the field.","discovery_kind":"replication","skeptic_critique":{"model":"deepseek-v4-flash","headline":"The claim that the 2015 raw diamagnetic signal in H3S is a pressure-cell background depends on the unverified assumption that the 2022 DAC background is identical to the 2015 one; absent raw data or a control, the central conclusion is not established.","rationale":"The paper's central claim is that the magnetic evidence highlighted by Ref. [1] does not support hydride superconductivity, and the strongest technical pillar is the comparison of 2015 and 2022 raw M(H) loops (Figs. 2-3). For that pillar to hold, the 2022 large diamagnetic background must be the same background that contaminated the 2015 run. The manuscript never establishes this. In fact, it reports large differences between the two runs and calls the 2022 apparatus 'more accurate'; those differences could be precisely because the background changed. The reader's weakest_assumption therefore identifies the load-bearing gap. No control experiment exists, and the original raw 2015 data are not available; the paper says so itself, both when asking for the data and in its concluding sentence. Without either, the assertion 'overwhelmingly probable' is an unsupported empirical premise. This does not mean the criticisms of data provenance are worthless; they are legitimate calls for transparency. But the strong Bayesian-sounding conclusion is not warranted. The reader's REJECT verdict with low confidence remains appropriate; my concern reinforces, rather than changes, that verdict.","tokens_in":6587,"tokens_out":3839,"duration_ms":37049,"concrete_test":"Obtain the original 2015 raw M(H) data from the authors or the archive, or run a control experiment with an empty (or non-superconducting) diamond-anvil cell at ~140 GPa and 100 K using the same coil/electronics: measure raw M versus H before any background subtraction. If the control reproduces the negative low-field virgin branch and similar loop seen in Fig. 1b, the 2015 signal is cell background and the paper's key inference holds; if the control background is small/positive or differs by more than the 2015 signal, the 2015 negative signal cannot be attributed to the cell. If raw 2015 data remain unavailable, the central claim is untestable and should not be stated as overwhelmingly probable.","verdict_should_be":"UNCHANGED","load_bearing_attack":"To dismiss the 2015 raw negative M(H) signal as cell background, the paper must assume that the large diamagnetic background seen in the 2022 'more accurate' measurements (Fig. 2, right) is the same background present in 2015. The paper provides no direct evidence for this identity. It notes the 2022 signal is five times larger and opposite in sign to the 2015 raw response, and that the 2022 measurements were explicitly described as significantly improved; these facts point toward a changed experimental background. If the 2015 cell/coil/sample had a different (e.g., paramagnetic or smaller) background, then the raw negative virgin curve in Fig. 1b could be a genuine sample response, and the assertion that Ref. [1]'s evidence is nullified fails. The paper itself concedes the relevant raw data are unavailable and that no empty-cell control experiment at the same T, P, and field has ever been reported. Thus the central inference rests on an empirical premise that is both unverified and currently unverifiable from the record.","agreement_with_reader":"agree"},"referee_report":{"model":"deepseek-v4-flash","summary":"The manuscript, authored by J. E. Hirsch, is a commentary that challenges the conclusion of a recently published Comment by Boebinger et al. [1] that hydride superconductivity is genuine. Hirsch argues that the magnetic evidence presented in [1], primarily based on 2015 magnetization data on H3S, is unreliable. He compares raw and background-subtracted hysteresis loops from the 2015 experiments with data from 2022 and concludes that the 2015 raw diamagnetic signal is a background artifact of the pressure cell, rather than evidence of superconductivity. He further claims, citing his own prior analysis, that the published 2022 data were 'manipulated or worse.' The paper ends with broader assertions about the lack of reproducible evidence and the motives of the community.","tokens_in":6821,"tokens_out":6837,"duration_ms":55200,"significance":"The paper raises a legitimate and important issue: the absence of raw data and control experiments in the hydride superconductivity literature is concerning, and the paper usefully documents inconsistencies between the 2015 and 2022 magnetization measurements. If the author's claims were substantiated, the paper would have profound implications for the field. However, the central argument rests on an unverified assumption that the 2022 pressure-cell background is identical to that in 2015, and the accusation of data manipulation is based on an unreviewed self-cited analysis. As a result, the paper's significance is limited by its reliance on unsubstantiated assertions rather than reproducible evidence.","major_comments":[{"comment":"The argument that the 2015 raw diamagnetic signal (Fig. 1d of Ref. [1]) is a pressure-cell background depends on the unstated assumption that the large diamagnetic background in the 2022 measurements (Fig. 2 right) is identical to the background in the 2015 experiment. This assumption is not justified: the text notes that the 2022 measurements are 'more accurate' and 'significantly improved,' which suggests changes in the sample or apparatus. Without an empty-cell control at the same conditions or a direct comparison of background signals, the possibility remains that the 2015 raw negative virgin curve is a genuine sample property. The author himself acknowledges that no such control exists. This is a load-bearing gap in the reasoning.","section":"Figs. 2 and 3"},{"comment":"The claim that the published 2022 data were 'manipulated or worse' is based entirely on Ref. [8], an arXiv preprint by the author and M. van Kampen that has not been peer-reviewed. The manuscript does not reproduce the analysis or present the raw data needed to verify it. A serious accusation of scientific misconduct must be supported by evidence within the paper or by a published correction. Citing an unreviewed preprint is insufficient and makes the claim unverifiable to the reader.","section":"Fig. 5"},{"comment":"The opening assertion that 'it is overwhelmingly probable that they are wrong' is not supported by the evidence presented. The paper documents apparent discrepancies between figures, but it does not provide a quantitative analysis or rule out alternative explanations, such as differences in sample preparation or measurement conditions. The strength of the conclusion far exceeds what the analysis can justify.","section":"Introduction"},{"comment":"The dismissal of the authors of Ref. [1] as lacking 'scientific validity' because they have not worked on hydrides is an ad hominem argument. Scientific claims should be judged on evidence, not on the credentials or prior field of the claimants. Similarly, the speculation about the community's motives and the implications for BCS theory is outside the scope of the data analysis and is not testable. Statements such as 'None of the myriad of theoretical predictions... have been realized' are not substantiated with a systematic review. These rhetorical elements should be removed or clearly separated from the technical critique.","section":"First and concluding paragraphs"}],"minor_comments":[{"comment":"The manuscript contains several typographical errors, including 'magnitute' and 'earler' (in the paragraphs following Fig. 2 and Fig. 6).","section":"General"},{"comment":"The paper does not describe how the data from the original publications were digitized; providing this information would allow readers to verify the comparisons.","section":"Figs. 1, 2, and 6"},{"comment":"The references [8] and [9] are not summarized in the text; a reader cannot evaluate the 'manipulated or worse' claim without consulting the external arXiv sources, which is not customary in a self-contained paper.","section":"Fig. 5"},{"comment":"The term 'raw data' is used in two different senses: as data before background subtraction and as the original digital files from the experiment. This ambiguity should be clarified early in the paper.","section":"Terminology"}],"recommendation":"reject","confidential_remarks":"The manuscript is a combative commentary that accuses other scientists of misconduct based on an unreviewed preprint. While it raises legitimate questions about data availability, it does not meet the standards of a scientific article because its central claims are unverifiable and its tone is inappropriate for a peer-reviewed journal. I recommend rejection."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Colleague,\n\nYou should know this paper before citing the Boebinger et al. 'hydride superconductivity is here to stay' comment as settled truth. Hirsch does real work here: he puts the 2015 H3S magnetization loops side by side with the same group's 2022 remeasurements on identical axis scales, and he flags two internal inconsistencies in the published M(T) and M(H) curves that the manifesto glosses over. The factor-of-three mismatch between the diamagnetic moment at 3 mT in M(T) and at 30 mT in M(H), and the ZFC/FC divergence starting about 100 K above Tc, are exactly the kind of thing that should have been addressed. His demand for raw data and for a control experiment with an empty pressure cell is fair.\n\nThe soft spot is the step from 'the magnetic evidence is weaker than claimed' to 'it is overwhelmingly probable that hydride superconductivity is wrong.' That step requires assuming the large diamagnetic background seen in the 2022 'more accurate' measurements is the same background that contaminated the 2015 cell. But Hirsch himself notes the 2022 signal is five times larger and opposite in sign, and the group described the new setup as significantly improved. Without the 2015 raw files or an empty-cell control, you cannot rule out that the 2015 raw negative virgin curve was a genuine sample response. The 'manipulated or worse' charge rests on an unreviewed self-cited arXiv analysis (Ref. 8), and no independent reproduction is provided. That is a serious accusation that needs a higher evidentiary bar.\n\nSo the paper's useful contribution is diagnostic, not decisive. Read it as a pointed call for transparency, not as a disproof. It deserves peer review because the specific quantitative comparisons are worth checking and the field needs this kind of scrutiny, but an editor should send it back for substantial revision of its tone and its unsupported extrapolations. For my own work, I wouldn't cite it yet, but I'd bring it to reading group to discuss what the 2015 curves can actually support.\n\nBest regards.","headline":"Hirsch makes some useful diagnostic points about the 2015 H3S magnetization data, but his central conclusion overreaches an unverified background assumption.","tokens_in":7328,"tokens_out":2766,"would_cite":false,"duration_ms":25630,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"The magnetic evidence for hydride superconductivity is pressure-cell background rather than sample property, this paper argues.","keywords":["hydride superconductivity","magnetic hysteresis","diamond anvil cell","background subtraction","high-pressure superconductivity","raw data","sulfur hydride","BCS electron-phonon theory"],"falsifier":"Release the 2015 raw magnetization files and independently subtract an empty-cell background at the same pressure and temperature; if the virgin curve still goes negative and the hysteresis loop retains its flux-trapping shape with magnitude scaling with field, the paper's dismissal of the signal is wrong.","tokens_in":6362,"feed_emoji":"🧲","tokens_out":8359,"duration_ms":76832,"temperature":0.7,"pith_summary":"This paper challenges the recent public declaration that high-pressure hydride superconductivity is genuine. It argues that the magnetization data cited as key evidence are dominated by pressure-cell background, not by the sample. By comparing the 2015 sulfur-hydride magnetization data with the same group's 2022 measurements on identical scales, the author shows inconsistencies in magnitude and shape, and notes that published 'raw' data do not match what was reportedly measured. If correct, the strongest magnetic support for the 203 K superconductivity claim collapses, and the remaining evidence lacks a control experiment.","feed_headline":"Hydride superconductivity's magnetic evidence is a background artifact","feed_subtitle":"A raw-data comparison suggests the 2015 diamagnetic signal was pressure-cell background.","key_machinery":"The central mechanism is a side-by-side comparison of raw magnetization-versus-field loops from 2015 and 2022, plotted on the same scales before and after linear background subtraction. This comparison shows that the supposedly superconducting loop shape is absent in the later data, that the raw diamagnetic response in 2022 is five times larger than the 2015 response and persists above 200 K, and that a published 'raw' loop does not match the reported measured data. The expected behavior for a superconducting hysteresis loop with flux trapping—magnetization increasing when the field is reduced, per Faraday's law—is used as the criterion that the 2015 published loop fails.","core_discovery":"The paper's central claim is that the magnetic evidence highlighted by the 2025 manifesto does not provide strong evidence for superconductivity in hydrides. The same group's 2022 measurements show a large diamagnetic background that persists above 200 K and is far too large to come from a superconducting sample, so it must be a property of the pressure cell; this background undermines the claim that the 2015 raw virgin curve going negative is evidence of superconductivity. The paper further demonstrates that the 2022 hysteresis loop crosses its own virgin curve, which is not expected for a superconducting sample, and that published 2022 data were not derived from measured data through scientifically accepted procedures. It concludes that the magnetic case for hydride superconductivity is unsupported and that no control experiment has ever been reported.","pith_inferences":["If this critique is right, other high-pressure hydride magnetization claims, including those for lanthanum hydrides, would need the same raw-data and background scrutiny before being accepted.","A concrete testable protocol follows: measure the magnetic response of an emptied or non-superconducting pressure cell under identical pressure, temperature, and field cycles; if a similar hysteresis loop appears, background contamination is confirmed for the whole family of measurements.","The author's framing suggests the dispute matters beyond hydrides because it bears on whether conventional electron-phonon theory can predict new superconducting materials; that larger question would be reopened if the magnetic evidence is really an artifact."],"forward_implications":["If the magnetic evidence is set aside, the 2015 claim of 203 kelvin superconductivity in sulfur hydride loses its central experimental support.","The assertion in the manifesto that hydride superconductivity is overwhelmingly probable is not supported by the data it cites.","The absence of control experiments means that no hydride magnetization loop should be accepted as evidence of superconductivity until the pressure-cell background is measured independently.","Linear background subtraction is insufficient when the background itself is large, temperature-dependent, and uncharacterized; future measurements must report raw data and background runs."],"supporting_citations":[{"why":"The manifesto being rebutted; it asserts hydride superconductivity is genuine and is the target of the whole argument.","marker":"[1]"},{"why":"The 2015 paper that first reported 203 K superconductivity in sulfur hydride; its published hysteresis loop is analyzed and found inconsistent with expected superconducting behavior.","marker":"[3]"},{"why":"Quoted to show that the 2015 paper required magnetic evidence to be published, which is why these particular magnetization data are load-bearing.","marker":"[4]"},{"why":"The 2022 report that finally published the 2015 magnetization data, including the M(T) and M(H) curves that the critique re-examines.","marker":"[5]"},{"why":"The 2022 'more accurate' magnetization measurements showing a large diamagnetic background persisting above 200 K, the key evidence that the 2015 signal was pressure-cell background.","marker":"[6]"},{"why":"The revaluation preprint giving what was reportedly measured in 2022; compared with [6] to show the published data do not match the measurements.","marker":"[7]"},{"why":"A prior analysis that demonstrates numerous discrepancies between published and measured 2022 data, supporting the claim of manipulation.","marker":"[8]"}],"fun_headline_variants":["Hydride superconductivity's magnetic evidence is background artifact","Magnetic case for hydride superconductivity collapses","Pressure cell, not superconductor, explains hydride signals","Background noise undermines hydride superconductivity claims","Hydride superconductivity evidence is pressure-cell artifact"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The argument assumes that the large diamagnetic background seen in the same group's 2022 measurements at the same temperature and pressure is the same background that contaminated the 2015 signal.","fun_headline_variants_meta":{"raw":{"variants":["Hydride superconductivity's magnetic evidence is background artifact","Magnetic case for hydride superconductivity collapses","Pressure cell, not superconductor, explains hydride signals","Background noise undermines hydride superconductivity claims","Hydride superconductivity evidence is pressure-cell artifact"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.001053,"raw_usage":{"total_tokens":4317,"prompt_tokens":737,"completion_tokens":3580,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":353,"completion_tokens_details":{"reasoning_tokens":3505}},"tokens_in":353,"tokens_out":3580,"duration_ms":27105,"temperature":1.0,"reasoning_tokens":3505,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-10T22:46:23.289260+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Release the 2015 raw magnetization files and independently subtract an empty-cell background at the same pressure and temperature; if the virgin curve still goes negative and the hysteresis loop retains its flux-trapping shape with magnitude scaling with field, the paper's dismissal of the signal is wrong.","supporting_citations":[{"cited_title":"has the main qualitative features expected of a superconducting hysteresis loop in the presence of flux trapping","cited_arxiv_id":null,"evidence_quote":"The manifesto being rebutted; it asserts hydride superconductivity is genuine and is the target of the whole argument."},{"cited_title":null,"cited_arxiv_id":null,"evidence_quote":"The 2015 paper that first reported 203 K superconductivity in sulfur hydride; its published hysteresis loop is analyzed and found inconsistent with expected superconducting behavior."},{"cited_title":"Conventional superconductivity at 203 kelvin at high pressures in the sulfur hydride system","cited_arxiv_id":null,"evidence_quote":"Quoted to show that the 2015 paper required magnetic evidence to be published, which is why these particular magnetization data are load-bearing."},{"cited_title":"Superconductivity at High Pressure","cited_arxiv_id":null,"evidence_quote":"The 2022 report that finally published the 2015 magnetization data, including the M(T) and M(H) curves that the critique re-examines."},{"cited_title":"High-temperature superconductivity in hydrides: experimental evidence and details","cited_arxiv_id":null,"evidence_quote":"The 2022 'more accurate' magnetization measurements showing a large diamagnetic background persisting above 200 K, the key evidence that the 2015 signal was pressure-cell background."},{"cited_title":"Magnetic field screening in hydrogen-rich high-temperature superconductors","cited_arxiv_id":null,"evidence_quote":"The revaluation preprint giving what was reportedly measured in 2022; compared with [6] to show the published data do not match the measurements."},{"cited_title":"Revaluation of the lower critical field in superconducting H$_3$S and LaH$_{10}$ (Nature Comm. 13, 3194, 2022)","cited_arxiv_id":"2408.12675","evidence_quote":"A prior analysis that demonstrates numerous discrepancies between published and measured 2022 data, supporting the claim of manipulation."}],"review_version":1}