{"id":"6943b970-7531-4b49-9295-4ce4a32d5a32","arxiv_id":"2606.10364","paper_version":1,"verdict":"UNVERDICTED","confidence":"LOW","novelty_score":3.0,"correctness_risk":"unknown","formal_verification":"none","parameter_count":0,"one_line_summary":"RAFT-Stereo outperforms SGBM on Middlebury but shows weaker edge alignment and higher reprojection error on Curiosity imagery, while geometry completion trades local accuracy for mesh connectivity in printable models.","lead":"The paper benchmarks stereo depth estimation and geometry completion methods on NASA Curiosity Mars rover images to create 3D printable terrain models. A smart generalist might read it to see the practical limits of applying Earth computer vision benchmarks to low-texture extraterrestrial data.","discovery_kind":"new_application","skeptic_critique":{"model":"grok-4.3","headline":"Photometric reprojection error and edge alignment are used as proxies for printable mesh quality without demonstrated correlation","rationale":"The reader's weakest_assumption directly identifies the same proxy-validity gap. Because the study is purely empirical and the full text (per the provided context) does not add an explicit correlation analysis or ablation linking the image-space metrics to mesh usability, the concern remains load-bearing and the UNVERDICTED stance is appropriate.","tokens_in":1657,"tokens_out":326,"duration_ms":8082,"concrete_test":"For the Curiosity image pairs, export the final OBJ meshes from both RAFT and SGBM pipelines using the same completion method (e.g., Poisson), then compare mesh-level metrics (number of connected components after watertight repair, total surface area, and Hausdorff distance to the alpha-shape baseline); if the ranking by these metrics reverses the ranking by reprojection error, the proxy does not support the claim.","verdict_should_be":"UNCHANGED","load_bearing_attack":"The central claim that Middlebury accuracy does not transfer rests on RAFT showing weaker edge alignment and higher photometric reprojection error on Curiosity images. These metrics are treated as direct indicators that the denser disparities will yield inferior printable meshes after completion. No quantitative link is established between the proxy values and downstream mesh properties (watertightness, connected-component count, or deviation after Poisson/alpha-shape completion). Because Martian scenes lack ground-truth geometry, the proxies must carry the full evidential weight; if they do not track final printability, the transfer-failure conclusion is unsupported.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.3","summary":"The manuscript evaluates a stereo reconstruction pipeline for generating 3D printable models of Martian terrain from NASA Curiosity rover imagery. It reports that RAFT-Stereo outperforms semi-global block matching (SGBM) on the Middlebury benchmark (disparity MAE reduced from 3.22 px to 0.73 px; valid coverage increased from 76.3% to 100%), but on Curiosity images RAFT produces denser disparities with weaker edge alignment and higher photometric reprojection error. Geometry completion methods (alpha shapes, Poisson reconstruction, deterministic diffusion-fill) are compared for tradeoffs between local fidelity and global connectivity, with the overall conclusion that standard methods can yield printable approximations but require stronger domain-specific validation because benchmark performance does not directly transfer.","tokens_in":1771,"tokens_out":399,"duration_ms":21562,"significance":"If the empirical findings hold, the work usefully documents the domain gap between terrestrial stereo benchmarks and low-texture, partially observed Martian scenes, with direct relevance to planetary exploration and additive manufacturing. Concrete Middlebury numbers and Curiosity observations are reported; the absence of fitted parameters or self-referential predictions is a strength of the purely empirical design.","major_comments":[{"comment":"Abstract: the central claim that Middlebury accuracy does not transfer rests on RAFT exhibiting weaker edge alignment and higher photometric reprojection error on Curiosity imagery. These metrics are treated as direct proxies for inferior printable mesh quality, yet no quantitative correlation is shown to downstream mesh properties (watertightness, connected-component count, or geometric deviation after Poisson/alpha-shape completion). Because Martian scenes lack ground-truth geometry, the proxy assumption carries the full evidential weight for the transfer-failure conclusion.","section":"Abstract"}],"minor_comments":[{"comment":"Abstract: no error bars, dataset sizes, or full pipeline details are supplied to support the transfer conclusion.","section":"Abstract"},{"comment":"Abstract: method acronyms (RAFT-Stereo, SGBM) and completion techniques should be defined on first use for clarity.","section":"Abstract"}],"recommendation":"major_revision","confidential_remarks":null},"author_rebuttal":{"model":"grok-4.3","summary":"We thank the referee for highlighting this important point regarding our use of proxy metrics. We address the concern directly below.","responses":[{"response":"We agree that a direct quantitative correlation between the stereo metrics and final mesh properties would provide stronger support for the domain-gap claim. Edge alignment and photometric reprojection error were chosen as they are standard, literature-established indicators of disparity quality that affect point-cloud fidelity and downstream meshing. Because no ground-truth geometry exists for the Curiosity scenes, geometric deviation cannot be measured. We will revise the manuscript to add quantitative mesh statistics (watertightness rate and connected-component count) comparing RAFT-Stereo and SGBM outputs on the Martian imagery, and we will update the abstract to explicitly state that the cited metrics function as proxies in the absence of ground truth.","revision_made":"partial","referee_comment":"[Abstract] Abstract: the central claim that Middlebury accuracy does not transfer rests on RAFT exhibiting weaker edge alignment and higher photometric reprojection error on Curiosity imagery. These metrics are treated as direct proxies for inferior printable mesh quality, yet no quantitative correlation is shown to downstream mesh properties (watertightness, connected-component count, or geometric deviation after Poisson/alpha-shape completion). Because Martian scenes lack ground-truth geometry, the proxy assumption carries the full evidential weight for the transfer-failure conclusion."}],"tokens_in":1340,"tokens_out":325,"duration_ms":28615,"standing_objections":["Direct quantitative correlation to geometric deviation after mesh completion, as no ground-truth 3D geometry is available for Curiosity imagery."]},"desk_editor":{"model":"grok-4.3","letter":"The paper's main point is that stereo algorithms that win on standard benchmarks do not carry that advantage over to Martian rover images when judged by edge alignment and photometric reprojection error, and that geometry completion methods each have different strengths for producing printable meshes.\n\nIt does a clear job of running the comparison. The Middlebury numbers are specific and show RAFT cutting MAE from 3.22 px to 0.73 px with full coverage. On the Curiosity images the observation that RAFT's denser maps lose edge fidelity and increase reprojection error is a direct, useful data point about domain shift in low-texture terrain. The completion experiments lay out the practical tradeoff: alpha shapes keep local accuracy but stay fragmented, Poisson gives connected meshes at the cost of added surfaces, and diffusion sits in between but depends on the input stereo quality. The claim that standard methods can still yield printable approximations is stated plainly.\n\nThe soft spot is the reliance on those two proxies to argue that benchmark accuracy does not transfer. The paper does not show how edge alignment or reprojection error actually affect final mesh properties such as watertightness, connected-component count, or deviation after completion. Without ground truth on Mars, the proxies carry the conclusion, yet no quantitative link is provided. Dataset sizes and error bars are also missing from the reported results, which limits how firmly the transfer claim can be read.\n\nThis is for researchers who need to turn limited rover imagery into physical terrain models or who work on stereo in planetary settings. It supplies targeted empirical guidance rather than new algorithms. The concrete comparisons and pipeline description are enough to justify sending it for peer review, though the proxy-to-printability step would need tightening.","headline":"Benchmarks show RAFT-Stereo beats SGBM on Middlebury but produces worse edge alignment and reprojection error on Curiosity images, with a useful but proxy-based comparison of mesh completion methods.","tokens_in":2215,"tokens_out":425,"would_cite":false,"duration_ms":15118,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.3","headline":"Stereo methods that beat benchmarks on Middlebury show weaker edge alignment and higher reprojection error on Curiosity images for printable Martian terrain.","keywords":["stereo reconstruction","Martian terrain","3D printing","depth estimation","geometry completion","RAFT-Stereo","Curiosity rover"],"falsifier":"Finding a stereo algorithm that simultaneously achieves low Middlebury error and strong edge alignment plus low reprojection error on Curiosity imagery would falsify the claim that benchmark gains fail to transfer.","tokens_in":2558,"feed_emoji":"🪐","tokens_out":629,"duration_ms":16485,"temperature":0.7,"pith_summary":"The paper tests a pipeline that turns NASA Curiosity rover photos into watertight 3D meshes suitable for printing. RAFT-Stereo cuts disparity error sharply on the Middlebury test set relative to semi-global block matching, yet the same denser maps produce poorer edge matches and larger photometric errors when applied to real Martian scenes. Geometry completion steps then trade local accuracy for global connectivity depending on whether alpha shapes, Poisson reconstruction, or a diffusion baseline is used. The central finding is that success on standard benchmarks does not guarantee usable results for low-texture, irregular rover terrain.","feed_headline":"Stereo benchmarks fail to transfer to Mars terrain models","feed_subtitle":"RAFT-Stereo beats Middlebury numbers yet shows weaker edges and higher error on Curiosity images for printable meshes.","key_machinery":"The end-to-end pipeline of stereo disparity estimation (RAFT-Stereo versus SGBM), followed by geometry completion (alpha shapes, Poisson reconstruction, or diffusion fill), and export to watertight OBJ meshes.","core_discovery":"On Middlebury, RAFT-Stereo reduces disparity MAE from 3.22 px to 0.73 px and raises valid coverage to 100 percent over SGBM, but on Curiosity imagery the denser RAFT disparities exhibit weaker edge alignment and higher photometric reprojection error; geometry completion then reveals a fidelity-connectivity tradeoff in which alpha shapes keep accurate fragments, Poisson yields coherent but extrapolated surfaces, and diffusion fill sits between the two while remaining sensitive to input quality.","pith_inferences":["Mars-specific fine-tuning of depth networks could close the observed gap between benchmark and flight performance.","Incorporating rover wheel odometry or orbital DEM constraints might reduce the fragmentation seen with alpha shapes.","Physical printing and fit-testing of the meshes would provide a direct test of whether digital metrics predict real-world usability."],"forward_implications":["Standard stereo algorithms require domain adaptation for low-texture Martian surfaces before they can reliably feed printable models.","Choice of completion method directly controls whether the output mesh is locally accurate or globally connected.","Photometric reprojection error can serve as a practical check on reconstruction quality when ground-truth depth is unavailable.","Printable approximations of Martian terrain are feasible with current tools but remain unreliable without rover-specific validation."],"fun_headline_variants":["RAFT-Stereo wins on Middlebury yet loses on Martian images","Mars terrain exposes limits of stereo benchmark transfers","Printable Mars models highlight stereo edge and error issues","Curiosity imagery shows RAFT-Stereo edge alignment weaknesses"],"cache_read_input_tokens":2112,"weakest_assumption_plain":"Photometric reprojection error and edge alignment measured on Curiosity images are valid proxies for whether the resulting disparities will produce usable printable 3D meshes.","fun_headline_variants_meta":{"raw":{"variants":["RAFT-Stereo wins on Middlebury yet loses on Martian images","Mars terrain exposes limits of stereo benchmark transfers","Printable Mars models highlight stereo edge and error issues","Curiosity imagery shows RAFT-Stereo edge alignment weaknesses"]},"model":"grok-4.3","cost_usd":0.004367,"raw_usage":{"total_tokens":2178,"prompt_tokens":647,"num_sources_used":0,"completion_tokens":63,"cost_in_usd_ticks":43674500,"prompt_tokens_details":{"text_tokens":647,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":1468,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":647,"tokens_out":63,"duration_ms":10024,"temperature":1.0,"reasoning_tokens":1468,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-06-27T14:05:44.569663+00:00","model_set":{"reader":"grok-4.3"},"falsifier":"Finding a stereo algorithm that simultaneously achieves low Middlebury error and strong edge alignment plus low reprojection error on Curiosity imagery would falsify the claim that benchmark gains fail to transfer.","supporting_citations":[],"review_version":1}