REVIEW 2 major objections 5 minor 18 references
Signed visual evidence extracted during a single prefill pass ranks wrong closed multimodal answers better than confidence alone, with a mean error-AP gain of 0.134.
Reviewed by Pith at T0; open to challenge. T0 means a machine referee read the full paper against a public rubric. the ladder, T0–T4 →
T0 review · deepseek-v4-flash
2026-08-01 03:37 UTC pith:ZRNYIV3Q
load-bearing objection A strong empirical detector paper with an honest scope statement and a real but contained caveat about the local readout's sign fidelity. the 2 major comments →
Witness Evidence Portfolios: Single-Prefill Risk Detection for Closed Multimodal Answers
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
The central claim is that internal signed decision evidence—an estimate, layer by layer, of which visual tokens increase or decrease the predicted candidate's margin—contains risk information beyond the candidate margin alone. Concretely, WEP projects layer-wise attention/value readouts onto a one-vs-competitors direction to get signed source-token contributions, transports text-mediated contributions back into image space through question-token binding maps, and then summarizes the signed evidence with two route families: provenance (how much evidence overlaps question-bound witnesses relative to a uniform visual reference) and concentration (how narrowly or diffusely supportive or contradi
What carries the argument
The engine is the signed source-token readout C_{\ell,y}(s) = \sum_h \langle \tilde d_y, W_O^{h}(A^{h}(t,s)V^{h}(s)) \rangle, which estimates, at layer \ell, how much source token s pushes the readout toward candidate y versus its competitors. The paper proves an exact first-order completeness identity: summing over source tokens recovers the bias-free attention update's projection along the candidate direction, though this identity decomposes only a local directional derivative, not the full network. To make this spatial, question tokens define visual witness maps P_Q, S, O (with S=O=P_Q as fallback), and text-mediated contributions are transported to image space via question-token binding.
Load-bearing premise
The whole method rests on the assumption that the per-layer estimate of which image tokens push for or against the predicted answer is a true reflection of why the model answered that way; if a layer's local readout diverges from the final decision evidence, the provenance and concentration signals lose their meaning and the AP gain could vanish on other models.
What would settle it
On a held-out transformer MLLM, compute the signed source-token readout at each layer, patch the top-supporting and top-contradicting visual tokens back into that same layer, run the remaining blocks, and compare the sign of the final-logit margin change against the readout sign. If the sign-agreement rate falls well below the 94.6–97.2% range the paper reports for its three backbones, or if the evidence-shuffle null (permuting readouts across images while fixing confidence and labels) still yields positive AP gains, the local readout is not tracking final decision evidence and WEP's central c
If this is right
- Deployments can rank closed answers by error risk using the exact same forward pass that produced the answer, with no second model, image perturbation, or backward pass.
- At fixed review budgets of 1%, 5%, and 10% of the queue, WEP concentrates errors earlier: average review precision improves by roughly +0.196, +0.206, and +0.179, with image-cluster intervals that remain positive.
- Provenance and concentration encode complementary failure modes; nested family selection (+0.134) beats either family alone (+0.129 and +0.124) and a joint route pool (+0.128).
- In the zero-target-label leave-dataset-out setting, fixing the provenance family still transfers (+0.095 mean AP over confidence), so the signal is not overfit to one benchmark's label statistics.
- The final score remains inspectable: each selected route is a named layer/sign scalar, so a reviewer can see which evidence channel pushed an answer up or down the queue.
Where Pith is reading between the lines
- We infer that the same signed-evidence construction can extend to open-ended generation if free-form answers are first segmented into verifiable claims, each assigned a finite candidate set; the paper only tests closed finite candidates.
- We infer that the concentration family could serve as a general-purpose 'evidence diffusion' diagnostic for other structured inputs, such as video or audio tokens, where spatial or temporal spread of contradicting evidence might flag hallucinations.
- We infer that WEP's routes could be used as a training signal for grounding objectives: penalizing answers whose signed evidence provenance misses question-bound witnesses may reduce hallucination at the source.
- We infer that the method's success hinges on the local readout approximation holding across architectures; if future backbones show lower closure fidelity, the provenance route may need layer-specific recalibration.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. This paper proposes Witness Evidence Portfolios (WEP), a single-prefill white-box risk detector for closed multimodal answers. From one instrumented forward pass, WEP computes per-layer signed contributions of source tokens to the predicted candidate margin (Eq. 4), transports these into visual space, and builds two route families: question-bound provenance (global overlap and question-residual) and signed concentration. A nested image-grouped validation selects one family, a sparse top-k route set, and a single fusion weight, all fitted on a calibration slice and evaluated out-of-fold. On three MLLMs and four binary-answer benchmarks, WEP improves mean error AP by 0.134 over candidate confidence, with positive gains on all 12 model–dataset pairs and strictly positive image-cluster bootstrap intervals on 10 pairs. The paper includes extensive controls: 50-seed algorithmic stability, leave-dataset-out transfer, evidence shuffles, label-permutation nulls, local closure audits, end-to-end patching, and comparisons with matched-budget learned selectors.
Significance. If the reported gains hold, WEP offers a practical and unusually well-validated signal for auditing, abstaining, or routing closed multimodal answers without perturbing the input or changing decoding. The evaluation is a model of care: predictions are evaluated image-grouped out-of-fold; uncertainty is quantified by image-cluster bootstrap and 50-seed algorithmic reselection; the evidence shuffle and label-permutation nulls check for artifacts; and transfer is tested without target labels. The ablations isolate the contribution of signs, transport, question residuals, and family selection. The main risk is interpretive: the method's headline narrative—signed visual evidence that supports or contradicts the answer—depends on the local readout C_{ℓ,y}(s), and the paper's own patching audit shows only partial and depth-dependent sign fidelity to final logits. This does not undermine the ranking result (the signed-vs-unsigned gap is large), but it requires either more evidence or a more cautious framing.
major comments (2)
- [Eqs. (4)–(5), 'Estimated Decision Evidence'; Table 20] Central claim that WEP identifies tokens supporting/contradicting the prediction rests on sign of C_{ℓ,y}(s). Eq. (5) is exact only for the bias-free attention update; the text concedes it is a local directional derivative, not the full network. Table 17 establishes local fidelity, but Table 20's end-to-end patching shows final-margin effects in only 13/18 fixed depth tests, with sign reversals at some depths (InternVL AMBER-D: L24 −0.048, L30 −0.030, L35 +0.010). Thus per-token, per-layer sign fidelity to final logits is not established, while route names, concentration semantics, and Fig. 6 audits depend on it. The ranking result and signed-vs-unsigned ablation (+0.134 vs +0.014) survive, but the mechanism claim overreaches. Please add a per-token ablation-versus-final-margin check for selected layers or explicitly scope claims to 'locally signed readouts.'
- [Supplementary Table 12; 'Calibration and Provenance-Route Stability'] WEP's stated advantage includes 'sparse, named routes' that make the risk score inspectable. However, Table 12 shows the selected provenance route sets have low pairwise Jaccard overlap across held-out folds (0.424 for Qwen, 0.567 overall; 25.7 unique routes on average), and Table 13 shows substantial variation in family choice and residual slots under 50 seeds. The final score is stable, but the specific named routes are not. If auditability is a contribution, the paper should either report route-level stability (e.g., frequency of each route in the selected portfolios) or soften the inspectability claims. Without this, the reader cannot tell whether a reported 'dominant route' for an example is a reproducible signal or a fold-specific artifact.
minor comments (5)
- [Abstract; Table 1] The abstract's 'all 12 gains positive' refers to the full-label, nested-selection setting. Low-label (+0.069/+0.107 at 100/250 labels) and zero-target transfer (+0.095) are smaller. Consider adding a qualifier to the abstract.
- [Table 8] The rows 'No subject/object split' and 'Question-only' are numerically identical in many cells; clarify whether they are the same ablation under different names or whether the difference is too small to be visible.
- [Table 20] Specify what fraction of total layers the early/middle/late choices correspond to for each backbone; the layer indices (L21–L35) are not directly comparable across models.
- [Related Work] Consider replacing the LessWrong reference 'Riggs, Nanda et al. 2024' with a peer-reviewed publication on logit-lens decompositions, if one exists.
- [Supplement, 'Exact operational definitions'] The fixed hyperparameters λ_sink=1.0 and the evidence-attenuation floor 0.05 are not varied; a small sensitivity analysis would help rule out tuning artifacts.
Circularity Check
No significant circularity: the risk score is built from forward-pass evidence features and evaluated out-of-fold; no equation reduces the predicted risk to the fitted labels.
full rationale
WEP's derivation chain is self-contained. The evidence estimate C_{l,y}(s) in Eq. (4) is defined from attention weights, value vectors, and an unembedding direction; Eq. (5) is an exact algebraic identity for the local attention update and is explicitly qualified by the paper: 'This identity decomposes a local directional derivative, not the complete nonlinear network.' The final risk score in Eq. (12) is a standardized fusion of confidence with a mean of selected route scalars; selection of the route family, portfolio size k, and fusion weight beta is performed on calibration folds, and all reported AP values are out-of-fold. Thus the predicted error ranking is not the fitting label by construction. The paper also provides evidence-shuffle, label-permutation, and leave-dataset-out transfer controls that separate the AP gain from score-scale artifacts or route-search freedom. The skeptical concern that C may be only a proxy for final decision evidence is a validity/robustness question, not a circularity in the derivation; the paper separately tests this with end-to-end patching and reports mixed but nonzero effects. No load-bearing self-citation chain or imported uniqueness theorem is used to force the method's choice.
Axiom & Free-Parameter Ledger
free parameters (6)
- fusion weight β =
positive; selected from grid {-3.00,...,3.00} step 0.25; all 60 final selections positive
- portfolio size k =
selected from {1,2,3,5,8,13,21,36}, exact per-fold values not reported
- route family F* =
provenance 2094/3000 and concentration 906/3000 reseeded outer folds
- top-k route set P_k =
mean 15.6 selected routes for provenance; residual slots 47.1% under 50 seeds
- entity sink subtraction weight λ_sink =
1.0
- evidence attenuation floor =
0.05
axioms (6)
- domain assumption Additive attention/value readout faithfully decomposes candidate-margin decision evidence.
- domain assumption Question-token attention/value binding marks where the question is visually referenced.
- domain assumption Source-to-visual transport maps text-token evidence into image space without distorting sign.
- domain assumption Benchmark labels in the calibration slice are correct and the closed yes/no set is the decision space.
- domain assumption Histogram intersection of evidence with witness maps measures support/contradiction.
- domain assumption Uniform visual reference is an appropriate baseline for generic evidence overlap.
invented entities (2)
-
Signed visual evidence maps E_{ℓ,y}(v)
independent evidence
-
Question-bound witness maps P_Q, S, O
independent evidence
read the original abstract
Reliable deployment of multimodal large language models (MLLMs) requires deciding whether a confident visual answer should be trusted, reviewed, or routed to a stronger system. Confidence scores capture candidate margins, but not where the estimated signed visual readouts associated with those margins come from or how they are distributed. We study inference-time risk detection for closed visual answers using the same white-box prefill path that produces the answer. Witness Evidence Portfolios (WEP) first estimates, layer by layer, which visual contributions support or contradict the predicted candidate. It summarizes these contributions through two interpretable route families: question-related evidence provenance and signed evidence concentration. Nested grouped validation chooses the more reliable family and a sparse top-k route portfolio, which is fused with candidate confidence. WEP needs no image perturbation, decoding change, backward pass, or external verifier. Across three MLLMs and four binary-answer benchmarks, WEP improves mean error AP by 0.134. All 12 model--dataset gains are positive, and image-cluster bootstrap intervals are strictly positive on 10 pairs. WEP targets white-box closed-answer systems and uses a labeled calibration slice.
Figures
Reference graph
Works this paper leans on
-
[4]
Transformer Circuits Thread
AMathematicalFrameworkforTransformerCircuits. Transformer Circuits Thread. Favero, A.; Zancato, L.; Trager, M.; Choudhary, S.; Perera, P.;Achille,A.;Swaminathan,A.;andSoatto,S.2024. Multi- ModalHallucinationControlbyVisualInformationGround- ing. InProceedings of the IEEE/CVF Conference on Com- puter Vision and Pattern Recognition. Gal, Y.; and Ghahramani, Z
2024
-
[5]
Point” is the fraction of examples whose maximum-witness tokencenterliesinsidethetargetbox,comparedwiththebox-arearandomexpectation.“Mass
These counts should not bereadastherawsizesoftheupstreambenchmarkreleases. Expanded Main Results Table5expandsthecompactmain-papersummarywithper- cell review precision alongside the final nested AP results. Metric Confidence WEP∆ AURC↓0.214 0.179 -0.035 E-AURC↓0.147 0.112 -0.035 Acc.@90% coverage↑0.707 0.727 +0.020 Error recall@5% review↑0.096 0.135 +0.03...
2026
-
[6]
InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
HallusionBench: An Advanced Di- agnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Models. InPro- ceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Guo,C.;Pleiss,G.;Sun,Y.;andWeinberger,K.Q.2017. On Calibration of Modern Neural Networks. InProceedings of the International Conferen...
2017
-
[7]
InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive De- coding. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Li, Y.; Du, Y.; Zhou, K.; Wang, J.; Zhao, W. X.; and Wen, J.-R.2023. EvaluatingObjectHallucinationinLargeVision- Language Models. InProceedings of the 2023 Conference o...
2023
-
[9]
InFindings of the As- sociation for Computational Linguistics: ACL 2025,14949– 14965.Vienna,Austria:AssociationforComputationalLin- guistics
VADE: Visual Attention Guided Hal- lucinationDetectionandElimination. InFindings of the As- sociation for Computational Linguistics: ACL 2025,14949– 14965.Vienna,Austria:AssociationforComputationalLin- guistics. Riggs, L.; Nanda, N.; et al
2025
-
[10]
LessWrong
Logit Prisms: Decom- posingTransformerOutputsforMechanisticInterpretability. LessWrong. Rohrbach, A.; Hendricks, L. A.; Burns, K.; Darrell, T.; and Saenko,K.2018. ObjectHallucinationinImageCaptioning. InProceedings of the Conference on Empirical Methods in Natural Language Processing. Sarkar,A.;Li,Y.;Cheng,J.;Mishra,S.K.;andVasconcelos, N
2018
-
[12]
In Findings of the Association for Computational Linguistics: ACL 2024, 14379–14391
Unsupervised Real-Time Hallucination Detection based on the Internal States of Large Language Models. In Findings of the Association for Computational Linguistics: ACL 2024, 14379–14391. Sundararajan, M.; Taly, A.; and Yan, Q
2024
-
[13]
Wang, P.; Xiao, T.; He, T.; Han, Z.; Zhang, Z.; and Shou, M
AMBER: An LLM-Free Multi- Dimensional Benchmark for MLLMs Hallucination Eval- uation.arXiv preprint arXiv:2311.07397. Wang, P.; Xiao, T.; He, T.; Han, Z.; Zhang, Z.; and Shou, M. Z
-
[14]
Wang,X.;Pan,J.;Ding,L.;andBiemann,C.2024
A Survey of Multimodal Hallucination Evalua- tion and Detection.arXiv preprint arXiv:2507.19024. Wang,X.;Pan,J.;Ding,L.;andBiemann,C.2024. Mitigat- ing Hallucinations in Large Vision-Language Models with Instruction Contrastive Decoding. InFindings of the Asso- ciation for Computational Linguistics: ACL 2024, 15840– 15853. Wang, Z.; Aniri; Chen, T.; Zhang...
arXiv 2024
-
[16]
arXiv preprint arXiv:2310.16045
Woodpecker: Halluci- nation Correction for Multimodal Large Language Models. arXiv preprint arXiv:2310.16045. Zhang, C.; Sun, C.; Jiang, X.; Li, W.; and Tian, X. 2026a. Prefill-Time Intervention for Mitigating Hallucination in Large Vision-Language Models. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 25293–25303. Zh...
-
[17]
Attention Never Lie: Visual Attention Defocus Reveals and Rectifies Hallucina- tions in MLLMs. InProceedings of the IEEE/CVF Confer- ence on Computer Vision and Pattern Recognition Findings, 8897–8906. Zhao,J.;Zhang,F.;Sun,X.;Feng,C.;andTan,Z.2025. Tell ModelWheretoLook:VisualGroundingAttentionImproves VLMs’ Perception.arXiv preprint arXiv:2511.20032. Sup...
Pith/arXiv arXiv 2025
-
[2016]
InProceedings of the International Conference on Machine Learning
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. InProceedings of the International Conference on Machine Learning. Gautam,S.;Riegler,M.A.;andHalvorsen,P.2025.HEDGE: Hallucination Estimation via Dense Geometric Entropy for VQA with Vision-Language Models.arXiv preprint arXiv:2511.12693. Geifman,Y.;andEl-Yaniv,R.2017. S...
arXiv 2025
-
[2019]
InProceedings of the Conference on Empirical Methods in Natural Language Processing
Attention is not not Explanation. InProceedings of the Conference on Empirical Methods in Natural Language Processing. Xu,Z.;Wang,Z.;Wu,J.;Lu,J.;andWang,X.2025. Causal- HalBench:UncoveringLargeVision-LanguageModels’Ob- ject Hallucinations Through Causal Intervention.arXiv preprint arXiv:2511.10268. Yin,S.;Fu,C.;Zhao,S.;Xu,T.;Wang,H.;Sui,D.;Shen,Y.; Li, K....
arXiv 2025
-
[2021]
A Gentle Intro- duction to Conformal Prediction and Distribution-Free Un- certainty Quantification.arXiv preprint arXiv:2107.07511. Bai, S.; et al
-
[2023]
InTransactions of the Association for Computa- tional Linguistics
Visual Spatial Reasoning. InTransactions of the Association for Computa- tional Linguistics. Liu, H.; Li, C.; Li, Y.; and Lee, Y. J. 2024a. Improved Baselines with Visual Instruction Tuning. InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Liu,H.;Li,C.;Wu,Q.;andLee,Y.J.2023.VisualInstruction Tuning.Advances in Neural In...
2023
-
[2024]
InInternational Conference on Learning Representations
INSIDE: LLMs’ Internal States Re- tain the Power of Hallucination Detection. InInternational Conference on Learning Representations. Chen,Z.;etal.2025. InternVL3.5:AdvancingOpen-Source MultimodalModelsinVersatility,Reasoning,andEfficiency. arXiv preprint arXiv:2508.18265. Dancette, C.; Whitehead, S.; Maheshwary, R.; Vedantam, R.;Scherer,S.;Chen,X.;Cord,M....
Pith/arXiv arXiv 2025
-
[2025]
Belrose,N.;Furman,Z.;Smith,L.;Halawi,D.;Ostrovsky,I.; McKinney, L.; Biderman, S.; and Steinhardt, J
Qwen3-VL Technical Report.arXiv preprint arXiv:2511.21631. Belrose,N.;Furman,Z.;Smith,L.;Halawi,D.;Ostrovsky,I.; McKinney, L.; Biderman, S.; and Steinhardt, J
-
[2026]
InInternational Confer- ence on Learning Representations
Leveraging Data to Say No: Memory Augmented Plug-and-PlaySelectivePrediction. InInternational Confer- ence on Learning Representations. Selvaraju, R. R.; Cogswell, M.; Das, A.; Vedantam, R.; Parikh,D.;andBatra,D.2017. Grad-CAM:VisualExplana- tionsfromDeepNetworksviaGradient-BasedLocalization. InProceedings of the IEEE International Conference on Computer ...
2017
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.