{"id":"b2df6f77-492d-43bd-a53b-a1673e91323c","arxiv_id":"2607.02722","paper_version":1,"verdict":"CONDITIONAL","confidence":"HIGH","novelty_score":5.0,"correctness_risk":"medium","formal_verification":"none","parameter_count":6,"one_line_summary":"Unweighted EnbPI coverage falls from 95% to 70.13% under real CALCE drive-cycle shift; weighted EnbPI recovers only to 72.42%, with F1 telemetry used only as unsupervised OOD flags.","lead":"Lab-calibrated conformal thermal bounds for EV cells lose ~25 points of coverage under a real highway/hot-ambient shift; density-ratio weighting recovers only ~2 points. The paper is an honest stress test of conformal domain adaptation on real battery and F1 data, not a claimed full fix.","discovery_kind":"new_application","skeptic_critique":{"model":"grok-4.5","headline":"Surrogate ΔT labels with unfitted C and h make the reported coverage numbers only as meaningful as the lumped model itself.","rationale":"The Reader correctly isolates the physics-derived ΔT surrogate (unfitted C and h) as the weakest assumption and already assigns CONDITIONAL with high confidence. My stress-test confirms that this is indeed the single most load-bearing concern for the strongest claim: every reported coverage figure is defined with respect to that surrogate residual, so physical fidelity of the lumped model is a necessary condition for interpreting the 70%\to72% result as evidence about real lab-to-track thermal transfer. No stronger internal inconsistency or methodological error appears; the paper is unusually careful about real data, verified in-distribution coverage, and honest reporting of the partial fix. The concrete sensitivity/re-fit test would settle whether the concern actually moves the numbers. Because the Reader already flags the same issue and recommends CONDITIONAL pending measured temperature or richer correction, no verdict change is warranted. Agreement is therefore full.","tokens_in":10280,"tokens_out":707,"duration_ms":6500,"concrete_test":"Re-run the entire Section 5.2 pipeline (unweighted and weighted EnbPI coverage on FUDS vs US06/45°C) after replacing the literature C and h with values obtained by least-squares fit of the same first-order model to any publicly available A123/LFP cell surface-temperature time series under comparable dynamic profiles (or, if none exists, a controlled sensitivity sweep over C ∈ [2000,10000] J/K and h ∈ [0.2,1.5] W/K). If either the 70.13%\to72.42% recovery or the absolute coverage gap changes by more than a few points, the surrogate assumption is load-bearing for the headline numbers.","verdict_should_be":"CONDITIONAL","load_bearing_attack":"The paper's central empirical claim is that unweighted EnbPI coverage falls from a verified ~95% in-distribution to 70.13% under a real CALCE FUDS\to US06/45°C shift, with weighted reweighting recovering only to 72.42%. That claim is measured exclusively against a physics-derived temperature-increment target ΔT (Section 3.2). Two of the four lumped-model parameters (thermal mass C = 5000 J/K, dissipation h = 0.5 W/K) are literature-typical values never fit to any thermocouple channel; only R_int is estimated from voltage sag and T_amb is taken from the documented test condition. Limitations item 1 states this explicitly. Consequently the coverage percentages are coverage of the surrogate residual process, not of measured cell temperature. If the fixed C/h pair systematically mis-scales heat capacity or cooling under the 20°C ambient difference and different load statistics of US06, both the absolute coverage levels and the modest 2.3-point weighted recovery become artifacts of the surrogate rather than evidence about real thermal transfer. The in-distribution sanity check (94.998%) only confirms that the conformal machinery is correctly implemented on the same surrogate; it does not validate physical fidelity. This is the single most load-bearing modeling assumption underwriting the strongest claim.","agreement_with_reader":"agree"},"referee_report":{"model":"grok-4.5","summary":"The paper studies lab-to-track transfer of thermal uncertainty bounds for EV powertrains via conformal prediction. It implements EnbPI (Xu & Xie, 2021) on real CALCE A123 SP20 cycler data under FUDS (room temperature), verifies near-nominal 95% in-distribution coverage, and evaluates under a genuine covariate shift to US06 at 45°C, where unweighted coverage falls to 70.13%. A weighted EnbPI that reweights leave-one-out ensemble residuals by a classifier-estimated density ratio (Tibshirani et al., 2019) recovers coverage only to 72.42%. The same ensemble-disagreement diagnostic is applied unsupervised to real 2023 F1 telemetry (Monza, Silverstone), producing elevated flag rates without thermal ground truth. The authors conclude that conformal domain adaptation is only a partial solution and list limitations explicitly.","tokens_in":10645,"tokens_out":1274,"duration_ms":10606,"significance":"If the empirical coverage numbers are accepted as meaningful, the paper supplies a useful, carefully scoped negative-to-partial result: lab-calibrated EnbPI does not transfer under a real drive-cycle and ambient shift, and standard density-ratio reweighting recovers only a few points. Strengths include exclusive use of real CALCE and FastF1 data (no simulated deployment labels), correct in-distribution sanity check, honest reporting of the residual coverage gap, and a public analysis pipeline. The applied combination of EnbPI with weighted conformal prediction for battery thermal transfer is a concrete empirical contribution even without a new joint theorem. The work is limited by the surrogate nature of the thermal target and by the modest size of the weighted recovery, so its significance is primarily as a carefully documented case study rather than a solved method.","major_comments":[{"comment":"Section 3.2 and Limitations item 1: The central coverage claims (70.13% unweighted, 72.42% weighted under US06/45°C) are measured exclusively against a physics-derived ΔT target. Thermal mass C = 5000 J/K and dissipation h = 0.5 W/K are literature-typical values never fit to any thermocouple; only R_int is estimated from voltage sag. Coverage is therefore of the surrogate residual process, not of measured cell temperature. Under a 20°C ambient difference and different load statistics, fixed C/h can systematically mis-scale heat capacity or cooling, making both absolute coverage levels and the 2.3-point recovery potentially artifacts of the surrogate. A sensitivity sweep over plausible C and h (or an explicit statement that results are conditional on this fixed lumped model) is needed for the numbers to support claims about real thermal transfer.","section":null},{"comment":"Section 4.2 and Section 5.2: The paper composes EnbPI leave-one-out residuals with estimated density-ratio weights but states that no new joint coverage guarantee is derived. Under simultaneous temporal dependence and estimated (not known) weights, the weighted-exchangeability argument of Tibshirani et al. does not automatically transfer. The residual gap after reweighting is consistent with this gap. Either a short argument that the composition inherits approximate validity under the paper’s mixing assumptions, or an explicit caveat that the 72.42% figure is purely empirical, should be added so the central claim is not over-read as a validated weighted-EnbPI procedure.","section":null},{"comment":"Section 5.4: The F1 application rescales a two-parameter throttle/brake×speed load-fraction onto the lab cell current range and reports flag rates of 65.6% (Monza) and 58.0% (Silverstone). The paper correctly labels this unsupervised and unvalidated, yet the abstract and conclusion still present elevated flags as part of the transfer story. Because the proxy is acknowledged to fail consistently across circuits (DRS association reverses), the F1 numbers should be demoted to a brief exploratory appendix or removed from the abstract so they do not dilute the load-bearing CALCE shift result.","section":null}],"minor_comments":[{"comment":"Section 3.2: The discrete thermal ODE and the exact definition of the target ΔT are described in prose but never written as a numbered equation; adding the update rule would make the surrogate fully reproducible from the text alone.","section":null},{"comment":"Section 4.1: Hyperparameters of the Random Forest ensemble (n_estimators=50, max_depth=10) and the rolling-power-variance window (30 samples) appear without ablation or justification; a short sensitivity note would strengthen the methods section.","section":null},{"comment":"Section 5.1: Report R^{2} and MSE with units or relative scale so the reader can judge whether the small absolute MSE is informative given the cell format.","section":null},{"comment":"References: The arXiv version of Xu & Xie is cited alongside the ICML version; a single canonical citation is preferable.","section":null},{"comment":"Appendix A: The GitHub link is welcome; ensure the repository pin or commit hash is frozen so the exact numbers in Section 5 remain reproducible after any future code changes.","section":null}],"recommendation":"major_revision","confidential_remarks":"The manuscript is a clear improvement over an earlier circular version the authors themselves describe. The honesty about the partial recovery is a genuine strength. The main risk for the journal is that the coverage numbers will be cited as evidence about real cell thermal transfer when they are, strictly, coverage of an unfitted lumped-model surrogate. Requiring the sensitivity analysis (or a clear conditional framing) before acceptance would protect both the authors and the literature. Scope is applied ML / conformal methods for energy systems; fit is reasonable if the surrogate limitation is handled carefully."},"author_rebuttal":null,"desk_editor":{"model":"grok-4.5","letter":"The useful part of this paper is the measurement, not a new theorem. On real CALCE A123 data, FUDS-calibrated unweighted EnbPI hits its 95% in-distribution target and then falls to 70.13% on a genuine second condition (US06 at 45°C). Density-ratio reweighting of the leave-one-out ensemble residuals (classifier trick, Tibshirani-style) only lifts that to 72.42%. They report the gap instead of papering over it, ship the pipeline, and keep the F1 telemetry strictly unsupervised with inconsistent circuit associations. That combination of real shift + modest numbers + explicit scoping is rarer than it should be.\n\nWhat is new is the applied composition and the evaluation design. EnbPI and weighted conformal under covariate shift are both prior art; the authors correctly disclaim joint theory. The contribution is showing how badly a lab-calibrated time-series conformal bound can fail under a measured drive-cycle/ambient shift, and how little a global density-ratio fix buys you. The in-distribution sanity check and the code appendix make the ML side reproducible.\n\nThe soft spot that actually matters is the target. There is no thermocouple channel. ΔT comes from a first-order lumped model; R_int is estimated from voltage sag and T_amb is the documented test condition, but C = 5000 J/K and h = 0.5 W/K are literature-typical constants never fit to temperature. Coverage is therefore coverage of the surrogate residual process. The 20°C ambient jump and different load statistics could make both the absolute levels and the 2.3-point recovery partly artifacts of those fixed parameters. The authors list this first in Limitations, so it is not hidden, but it is load-bearing for any claim about real thermal transfer. Secondary issues (marginal not conditional coverage, approximate weights, single cell/chemistry, two-circuit F1 sample) are already stated and do not sink the empirical point.\n\nThis is for people who care about conformal methods under real sensor shift or about honest uncertainty for EV thermal models. It is not a deployment recipe and not a theory paper. I would send it to referees: the experiment is clean enough and the reporting disciplined enough that the field benefits from the stress test, even if the physical fidelity of the labels needs tightening. Worth a look if you work on either conformal domain adaptation or battery thermal surrogates; not something I would build on without measured temperature.","headline":"Honest real-shift stress test of EnbPI plus density-ratio weighting on CALCE; coverage collapse is real, recovery is tiny, and labels are surrogate ΔT.","tokens_in":11243,"tokens_out":612,"would_cite":false,"duration_ms":6287,"reading_group":"maybe","serious_thinker":"yes","would_accept_peer_review":true},"rs_alignment":null,"lean_confirmation":null,"pith_extraction":{"msc":[],"pacs":[],"model":"grok-4.5","headline":"Lab-calibrated thermal uncertainty bounds for EV cells lose a quarter of their coverage under real highway and temperature shift; density-ratio weighting recovers only a few points.","keywords":["conformal prediction","covariate shift","EnbPI","battery thermal modeling","lab-to-field transfer","density-ratio weighting","EV powertrains","time-series uncertainty"],"falsifier":"Obtain a public or proprietary CALCE-style dataset that includes a real thermocouple channel under both FUDS and US06/45 °C conditions; recompute empirical coverage of the identical weighted EnbPI intervals against the measured temperature increments rather than the physics-derived surrogate.","tokens_in":11099,"feed_emoji":"🔋","tokens_out":640,"duration_ms":5658,"temperature":0.7,"pith_summary":"High-performance electric powertrains derate when temperatures climb, yet internal cell temperatures are almost never measured outside the lab. Models trained on laboratory drive cycles therefore face a classic covariate shift when they meet real-world load profiles and ambient temperatures. This paper shows that a standard time-series conformal method (EnbPI) that hits its promised 95 percent coverage on lab data falls to about 70 percent under a genuine measured shift to a hotter highway cycle. Reweighting the same leave-one-out residuals by a classifier-estimated density ratio recovers only another couple of percentage points. The same calibrated ensemble, applied as an unsupervised flagger to public Formula 1 telemetry, lights up far more often than the 5 percent lab baseline, though without any thermal ground truth the flags remain exploratory. The work therefore establishes both the practical value and the clear remaining gap of conformal domain adaptation for lab-to-track thermal transfer.","feed_headline":"Lab thermal bounds lose 25 points of coverage under real EV shift","feed_subtitle":"Density-ratio weighting recovers only ~2 points; Formula-1 flags stay exploratory","key_machinery":"Weighted EnbPI: leave-one-out residuals from a bootstrap Random-Forest ensemble are reweighted by an estimated density ratio (odds from a domain classifier) before the conformal quantile is taken, combining temporal non-exchangeability handling with covariate-shift correction.","core_discovery":"Under a genuine measured covariate shift from CALCE FUDS room-temperature calibration data to US06 at 45 °C, unweighted EnbPI coverage drops from a verified 95 percent in-distribution to 70.13 percent; a weighted EnbPI that multiplies the leave-one-out ensemble residuals by a classifier density ratio recovers coverage only to 72.42 percent—a real but partial correction that does not restore nominal validity.","pith_inferences":[],"forward_implications":[],"fun_headline_variants":["EnbPI thermal coverage drops 25 points under real EV shift","Weighted EnbPI recovers only 2 points of lost thermal coverage","Lab-to-US06 shift cuts conformal EV bounds from 95% to 70%","Density-ratio weighting lifts coverage to 72% under EV covariate shift","Conformal domain adaptation partially fixes lab-to-track thermal bounds"],"cache_read_input_tokens":128,"weakest_assumption_plain":"The temperature-increment targets used for coverage are produced by a first-order lumped thermal model whose thermal mass and dissipation coefficients are literature defaults, not fitted to any measured thermocouple channel.","fun_headline_variants_meta":{"raw":{"variants":["EnbPI thermal coverage drops 25 points under real EV shift","Weighted EnbPI recovers only 2 points of lost thermal coverage","Lab-to-US06 shift cuts conformal EV bounds from 95% to 70%","Density-ratio weighting lifts coverage to 72% under EV covariate shift","Conformal domain adaptation partially fixes lab-to-track thermal bounds"]},"model":"grok-4.5","effort":"low","cost_usd":0.003252,"raw_usage":{"total_tokens":1216,"prompt_tokens":915,"num_sources_used":0,"completion_tokens":79,"cost_in_usd_ticks":32520000,"prompt_tokens_details":{"text_tokens":915,"audio_tokens":0,"image_tokens":0,"cached_tokens":256},"completion_tokens_details":{"audio_tokens":0,"reasoning_tokens":222,"accepted_prediction_tokens":0,"rejected_prediction_tokens":0}},"tokens_in":915,"tokens_out":79,"duration_ms":3002,"temperature":1.0,"reasoning_tokens":222,"cache_read_input_tokens":256,"cache_creation_input_tokens":0},"cache_creation_input_tokens":0},"created_at":"2026-07-12T07:29:50.317948+00:00","model_set":{"reader":"grok-4.5"},"falsifier":"Obtain a public or proprietary CALCE-style dataset that includes a real thermocouple channel under both FUDS and US06/45 °C conditions; recompute empirical coverage of the identical weighted EnbPI intervals against the measured temperature increments rather than the physics-derived surrogate.","supporting_citations":[],"review_version":1}