{"id":"ce89eeef-a29f-4c47-8555-7a589d9ea78e","arxiv_id":"2411.14644","paper_version":1,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":6.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":3,"one_line_summary":"Raman imaging of single HKUST-1 crystals maps surface heterogeneity and shows intra-crystal spectral variability exceeding inter-crystal variability in the same batch.","lead":"This paper uses Raman micro-spectroscopy to map how vibrational signals vary across the surface of single HKUST-1 crystals and reports a reference table of peak positions and line widths. It matters because spatially resolved characterization like this gives materials scientists a direct way to see defects and contaminants in metal-organic framework crystals.","discovery_kind":"new_application","skeptic_critique":{"model":"deepseek-v4-flash","headline":"Within-crystal vs between-crystal variance comparison is confounded: the 100 intra-crystal spectra sample the whole surface including edges and defects, the 100 inter-crystal spectra sample only centers, with no replicate crystals or significance test.","rationale":"The paper is a well-documented spectroscopic characterization with public data and DFT support; the spatial heterogeneity observation itself is credible and important. However, the specific quantitative comparison that forms the abstract-level conclusion (within-crystal variability exceeds between-crystal variability) is structurally underdetermined. The design compares a full-surface map of one crystal to center points of many crystals. The authors do not report a p-value, confidence interval, or effect size, and the phrase 'heterogeneity can be high within the same crystal' is supported by the images but not by the statistical comparison as stated. The reader's weakest_assumption pointed to the single-crystal representativeness; my concern is closely related but more specific: the position confound alone can generate the observed ordering. I therefore recommend keeping the CONDITIONAL verdict, with a request for either a reanalysis restricted to matched sampling regions or a replicate-crystal experiment. The 2918 rel.cm-1 band assignment is honestly flagged and less central. The DFT mode assignment and public code availability are not load-bearing for the headline claim.","tokens_in":10914,"tokens_out":4414,"duration_ms":44926,"concrete_test":"Using the public Zenodo dataset, restrict the 100 intra-crystal spectra to positions within a central region comparable to the center-position measurement (e.g., 2 um radius from the crystal center), compute the standard deviation of the 1007 rel.cm-1 peak position, and compare it to the between-crystal standard deviation from Table 2 using a bootstrap confidence interval. If the central-region variance is not significantly larger than the between-crystal variance, the headline claim is an artifact of including edge and defect positions. If the effect persists, the claim still requires replicate crystals to establish generality.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central quantitative claim—\"spectral standard deviations are larger in case (a) than in case (b)\"—rests on a comparison that confounds two variables. Case (a) is 100 positions \"equally distributed across the crystal surface\" of a single crystal; case (b) is 100 spectra taken \"at the center positions of 100 different, single crystals.\" The intra-crystal set therefore includes edges, vertices and the defect-rich bottom vertex visible in Figure 1b-d, while the inter-crystal set contains only central regions. Larger standard deviations in case (a) could be caused by position sampling (surface effects, morphology, focus variation) rather than by a genuine crystal-versus-batch property. Only one crystal contributes the entire within-crystal distribution, so the ordering cannot be generalized without replicate crystals; and no significance test (F, Levene or bootstrap) is provided, despite Table 2 being offered as reference values. Because the 100 intra-crystal spectra are spatially autocorrelated, any naive independent-sample test would overstate significance. The secondary premise, that the 2918 rel.cm-1 band is a surface contaminant, is acknowledged by the authors as unconfirmed and is not required for the variance comparison.","agreement_with_reader":"partial"},"referee_report":{"model":"deepseek-v4-flash","summary":"The manuscript reports a Raman micro-spectroscopy study of single HKUST-1 crystals. It combines DFT-based simulations with experimental spectra to assign vibrational modes, including a previously unreported band at 3090 rel.cm−1, and uses mode-selective Raman imaging to visualize spatial heterogeneity across a single crystal. The authors then compare spectral peak positions and line widths obtained from 100 positions on one crystal with those from the center positions of 100 different crystals, concluding that within-crystal spectral variability can exceed between-crystal variability. They also apply PCA to reveal features not obvious in the mode-selective images and make their data and simulation code publicly available.","tokens_in":11138,"tokens_out":3755,"duration_ms":37530,"significance":"If the central claim is supported, the work is a useful contribution: it provides the first spatially resolved, mode-selective Raman images of single HKUST-1 crystals, offers reference values for batch-level spectral variability, and demonstrates that single-point or bulk measurements may underestimate local heterogeneity. The open data and code strengthen reproducibility. However, the headline quantitative claim—that within-crystal variability exceeds between-crystal variability—currently rests on a confounded comparison and lacks statistical testing, so the significance of the paper's main message is not yet established.","major_comments":[{"comment":"The central comparison between case (a), 100 positions equally distributed across the surface of a single crystal, and case (b), center positions of 100 different crystals, confounds two variables: spatial sampling location and crystal identity. Case (a) includes edges, vertices, and the defect-rich bottom vertex visible in Figure 1b–d, while case (b) samples only central regions. The larger standard deviations in case (a) could therefore arise from position-dependent effects such as surface morphology, focus variations, or edge scattering, rather than from a genuine within-crystal versus between-crystal property. Only one crystal contributes to the entire within-crystal distribution, so the ordering cannot be generalized without replicate crystals. Additionally, the 100 intra-crystal spectra are spatially autocorrelated, making any simple independent-sample test inappropriate. Please provide replicate within-crystal measurements, match the spatial sampling (e.g., compare centers only or use identical grids), and report a significance test such as Levene or a bootstrap that accounts for spatial correlation.","section":"Spectral Variability of Single-Crystal HKUST-1, Figure 3 and Table 2"},{"comment":"The statement that 'spectral standard deviations are larger in case (a) than in case (b)' is not supported by a quantitative table. Table 2 reports peak positions, line widths, and standard deviations only for case (b). Without the corresponding within-crystal standard deviations, the reader cannot evaluate the claim band by band. Please add a table or figure giving the within-crystal standard deviations for the same bands, including confidence intervals or a measure of uncertainty, so the comparison is transparent and reproducible.","section":"Spectral Variability of Single-Crystal HKUST-1, Table 2"},{"comment":"The interpretation of Figure 1f as showing 'the presence of contaminants' depends entirely on the assignment of the 2918 rel.cm−1 band to surface contaminants. The authors explicitly note that 'confirming the chemical identity of the adsorbant species would require further research which is beyond the scope of this paper.' This is an acknowledged limitation, yet the later text states that the image 'attests to the presence of contaminants present at the surface of the crystal,' which goes beyond the evidence. Please either soften the language to 'unidentified surface species' or provide independent confirmation, for example control spectra of the bare substrate, comparative measurements on cleaned crystals, or a complementary surface-sensitive technique.","section":"Mode-selective Raman Imaging, Figure 1f and the assignment in the section 'Single-crystal Raman spectrum of HKUST-1'"}],"minor_comments":[{"comment":"The text refers to 'Figures 1 (b–g)' when describing the Raman images, but the figure caption lists only panels (b–e). Correct the cross-reference or extend the figure to include the missing panels.","section":"Mode-selective Raman Imaging, figure cross-reference"},{"comment":"The preprocessing step clips the standard deviation at the 99th percentile to limit cosmic-ray influence. This can bias the reported standard deviations, especially for bands with intrinsically broad distributions. Please specify whether clipping was applied before or after the Lorentzian fitting and discuss its potential effect on the variance metrics that underpin the central comparison.","section":"Methods, Spectral Data Analysis"},{"comment":"The Lorentzian broadening width γ = 5.0 cm−1 used to generate simulated spectra is a free cosmetic parameter. A sentence on how the simulated spectra change with γ, or a justification for the chosen value, would strengthen the DFT-to-experiment comparison.","section":"Supporting Information, Equation (10)"},{"comment":"There are several typographical errors and style inconsistencies: 'distribtution' should be 'distribution', 'Zeonodo' should be 'Zenodo', 'principle components' should be 'principal components', and 'minization' should be 'minimization'.","section":"Throughout"},{"comment":"The 2918 rel.cm−1 band is listed as 'This Work' with no simulated mode. Since the assignment to a contaminant is explicitly unconfirmed, consider labeling this band 'unassigned surface species' rather than implying an established origin.","section":"Table 1"}],"recommendation":"major_revision","confidential_remarks":"The paper reports a genuinely interesting experiment and the authors have been commendably open with their data and code. My main concern is that the headline quantitative claim is built on a confounded comparison (one crystal, many surface positions versus many crystals, centers only) with no statistical test. This is fixable within the manuscript's scope by collecting a small number of replicate within-crystal datasets, matching the sampling regions, and adding an appropriate significance test. The contaminant assignment issue is secondary but should be reworded or supported. If these points are addressed, the paper would be suitable for publication."},"author_rebuttal":null,"desk_editor":{"model":"deepseek-v4-flash","letter":"Read this paper. The genuinely new thing is the mode-selective Raman imaging at 200 nm pixel resolution on single HKUST-1 crystals, plus the public data and code. The DFT work is careful, and the new assignment of the 3090 cm-1 band to an out-of-phase CH stretch is plausible. The paper gives clean peak positions and line widths that labs can use as reference values. That part is solid. Citation pattern is fine; the relevant prior work (Gentile, Fuchs, and the MOF Raman reviews) is properly acknowledged.\n\nThe soft spot is the central quantitative claim: \"spectral standard deviations are larger in case (a) than in case (b).\" The comparison is confounded. Case (a) is 100 positions spread over one full crystal, including edges, vertices, and a defect-rich bottom vertex. Case (b) is 100 spectra taken only at the centers of 100 crystals. Larger standard deviation in case (a) could just be sampling more diverse surface regions, not a property of within-crystal versus between-crystal variation. There is only one crystal providing the entire within-crystal distribution, and no F-test, Levene test, or bootstrap is reported. The stress-test note is right about this. It is an addressable flaw, not a fatal one.\n\nThe other flagged point, the 2918 cm-1 band assigned to surface contaminants, is honestly labeled as unconfirmed. That means Figure 1f should be read with that caveat, but it doesn't sink the paper. The DFT-to-experiment comparison is standard mode matching; the fixed Lorentzian width is cosmetic, not a circularity problem.\n\nThe paper is for anyone doing MOF quality control by Raman or mapping defects in microcrystalline materials. It deserves a serious referee. Ask for replicate crystals for the intra-crystal measurement and a proper significance test that accounts for spatial autocorrelation. Also ask the authors to either exclude or explicitly model edge and vertex positions so the comparison is apples to apples.","headline":"Useful reference-grade Raman imaging of single HKUST-1 crystals, but the headline within-vs-between-crystal comparison is not yet statistically supported.","tokens_in":11706,"tokens_out":1706,"would_cite":true,"duration_ms":17622,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"deepseek-v4-flash","headline":"Raman mapping of a single HKUST-1 crystal shows more spectral variation across its surface than across 100 crystals of the same batch.","keywords":["metal-organic frameworks","HKUST-1","Raman micro-spectroscopy","mode-selective imaging","single-crystal heterogeneity","density functional theory","principal component analysis","surface defects"],"falsifier":"Repeat the 100-position within-crystal Raman scan on at least five additional crystals from the same batch and compare the within-crystal standard deviations of peak positions and line widths with the between-crystal standard deviations. If any of the additional crystals shows within-crystal standard deviations not consistently larger than the between-crystal values, the claim that heterogeneity is high within the same crystal fails; a simple F-test on the variances would also settle whether the reported difference is statistically meaningful.","tokens_in":10725,"feed_emoji":"🔬","tokens_out":12422,"duration_ms":105259,"temperature":0.7,"pith_summary":"The paper reports the first diffraction-limited, mode-selective Raman imaging of single crystals of the metal-organic framework HKUST-1, mapping how different vibrational bands vary across the crystal surface. The central empirical finding is that 100 spectra taken at different positions on one crystal show larger standard deviations in peak position and line width than spectra taken at the centers of 100 different crystals from the same batch, even though the average spectra agree. Taken at face value, this means a single-point spectrum of a crystal can miss significant local heterogeneity, and batch-level comparisons based on one point per crystal understate the spread that exists inside each crystal. The authors also use density-functional-theory simulations to validate the Raman spectrum, identify a previously unreported 3090 cm$^{-1}$ band assigned to an out-of-phase C-H stretch of the linker, and show that principal-component analysis reveals a triangular surface region invisible in any single band image.","feed_headline":"One HKUST-1 crystal hides more spectral variation than 100 crystals","feed_subtitle":"Scanning 100 spots on a single MOF crystal shows larger variance than sampling 100 separate crystals.","key_machinery":"The central mechanism is mode-selective Raman imaging: a confocal Raman microscope raster-scans a diffraction-limited laser spot across the crystal, and the scattered intensity is integrated within narrow windows centered on specific vibrational modes (Cu-O stretches, ring breathing, C-H stretches), producing spatial maps of each mode. The quantitative comparison rests on Lorentzian curve fitting of 100 spectra per condition, from which peak positions and full widths at half maximum are extracted and their standard deviations compared between the one-crystal and the 100-crystal data sets. Density-functional-theory phonon calculations provide the mode assignments that justify which bands carry defect, contaminant, or linker information, and principal-component analysis is applied to the image data cube to expose features not visible in any single band.","core_discovery":"The core discovery is that spatial heterogeneity within a single HKUST-1 crystal can exceed the heterogeneity measured across a batch of crystals. When the authors average Raman spectra from 100 positions on one crystal and from the centers of 100 crystals of the same batch, the band positions match, but the standard deviations of the peak positions and line widths are larger in the within-crystal set. They interpret this as direct evidence that single-crystal surfaces are spectroscopically nonuniform, with defect- and contaminant-related bands (notably the low-frequency Cu-O modes and the 2918 cm$^{-1}$ band) showing the largest variability. Mode-selective images localize the variation: defect-related bands show intensity enhancements or reductions at the same spots, the contaminant band appears as a connected low-intensity region, and principal-component analysis uncovers a triangular roughly 10 micrometer region that no single band shows. The 3090 cm$^{-1}$ band, previously unreported, is assigned to the out-of-phase C-H stretch of the benzene ring in the trimesic linker, while the 2918 cm$^{-1}$ band is attributed to surface contaminants of unconfirmed identity.","pith_inferences":["If the within-crystal greater-than-between-crystal variance pattern holds for other MOFs, single-point quality control systematically misses the dominant source of spectral scatter; a multi-point-per-crystal sampling protocol would be the natural fix.","The triangular region that appears only in PCA components 3-6 may mark a growth sector or facet-dependent defect distribution; correlating Raman PCA maps with atomic-force microscopy on the same crystal could test this.","If the 2918 cm$^{-1}$ contaminant's chemical identity is confirmed, that band could become a non-destructive, spatially resolved cleanliness indicator for HKUST-1 surfaces."],"forward_implications":["Within a single HKUST-1 crystal, Raman spectra vary more across the surface than they vary between crystals of the same batch, so single-point measurements underestimate true local heterogeneity.","The reported peak positions and line widths can serve as a spectral reference for batch-level characterization of HKUST-1 in the lab.","The previously unreported 3090 cm$^{-1}$ band is assigned to the out-of-phase C-H stretch of the trimesic linker and can be used as an additional fingerprint mode.","The 2918 cm$^{-1}$ band, assigned to surface contaminants, is absent in some crystals of the same batch, indicating irregular contamination across crystals.","Principal component analysis of the Raman image data reveals a triangular roughly 10 micrometer surface region that is not visible in any single mode-selective image."],"supporting_citations":[{"why":"Supplies the assignments of defect-related and carboxyl Raman bands (e.g., 1705 cm$^{-1}$ and low-frequency Cu-O modes) that the mode-selective images and variability analysis rely on.","marker":"[5]"},{"why":"Attributes low-frequency Cu-site peak shifts to coordinated water molecules, used to explain the high within-crystal spectral variability below 400 cm$^{-1}$.","marker":"[9]"},{"why":"Documents spectral changes of HKUST-1 upon activation and adsorbate interaction, also cited for the water-sensitive low-frequency variability.","marker":"[12]"},{"why":"Provides the Lorentzian fitting software used to extract peak positions and line widths whose standard deviations form the within-crystal versus between-crystal comparison.","marker":"[16]"}],"fun_headline_variants":["Single HKUST-1 crystal beats batch in spectral variance","Raman imaging reveals uneven surfaces in HKUST-1 crystals","One crystal hides more spectral variation than a hundred","Spectral spread inside one HKUST-1 exceeds that of batch"],"cache_read_input_tokens":3200,"weakest_assumption_plain":"The key result assumes that the single crystal chosen for the 100-position scan is representative of the batch, because the paper compares one crystal's internal spread with the spread of 100 crystal centers and reports no significance test or replicate intra-crystal scans.","fun_headline_variants_meta":{"raw":{"variants":["Single HKUST-1 crystal beats batch in spectral variance","Raman imaging reveals uneven surfaces in HKUST-1 crystals","One crystal hides more spectral variation than a hundred","Spectral spread inside one HKUST-1 exceeds that of batch"]},"model":"deepseek-v4-flash","effort":"low","cost_usd":0.000681,"raw_usage":{"total_tokens":3126,"prompt_tokens":1011,"completion_tokens":2115,"prompt_tokens_details":{"cached_tokens":384},"prompt_cache_hit_tokens":384,"prompt_cache_miss_tokens":627,"completion_tokens_details":{"reasoning_tokens":2047}},"tokens_in":627,"tokens_out":2115,"duration_ms":15084,"temperature":1.0,"reasoning_tokens":2047,"cache_read_input_tokens":384,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-08-12T15:02:47.398739+00:00","model_set":{"reader":"deepseek-v4-flash"},"falsifier":"Repeat the 100-position within-crystal Raman scan on at least five additional crystals from the same batch and compare the within-crystal standard deviations of peak positions and line widths with the between-crystal standard deviations. If any of the additional crystals shows within-crystal standard deviations not consistently larger than the between-crystal values, the claim that heterogeneity is high within the same crystal fails; a simple F-test on the variances would also settle whether the reported difference is statistically meaningful.","supporting_citations":[{"cited_title":"Gentile, M","cited_arxiv_id":null,"evidence_quote":"Supplies the assignments of defect-related and carboxyl Raman bands (e.g., 1705 cm$^{-1}$ and low-frequency Cu-O modes) that the mode-selective images and variability analysis rely on."},{"cited_title":"Bae, S.H","cited_arxiv_id":null,"evidence_quote":"Attributes low-frequency Cu-site peak shifts to coordinated water molecules, used to explain the high within-crystal spectral variability below 400 cm$^{-1}$."},{"cited_title":"Prestipino, L","cited_arxiv_id":null,"evidence_quote":"Documents spectral changes of HKUST-1 upon activation and adsorbate interaction, also cited for the water-sensitive low-frequency variability."},{"cited_title":"Allen, and Antonino Ingargiola","cited_arxiv_id":null,"evidence_quote":"Provides the Lorentzian fitting software used to extract peak positions and line widths whose standard deviations form the within-crystal versus between-crystal comparison."}],"review_version":1}