Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning

Julian Perry; Surasakdi Siripong; Thanakorn Phonchai

REVIEW 5 major objections 4 minor 1 cited by

Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning

T0 review · 5 major / 4 minor · reviewed 2026-08-10 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read A training pipeline that dynamically retrieves and aligns external knowledge with visual and textual embeddings improves vision-language reasoning on four benchmarks.

desk verdict A knowledge-augmented LVLM method built from standard components, with reported results that cannot be traced to the described system because the implementation is unspecified. read the letter →

arxiv 2501.08597 v1 pith:LUHQPM55 submitted 2025-01-15 cs.CL

Julian Perry , Surasakdi Siripong , Thanakorn Phonchai This is my paper · ORCID

classification cs.CL

keywords knowledgeintegrationlargevision-languagemodelsvisualquestionansweringretrievalcontrastivealignmentdynamicadaptorentailmentmultimodalreasoning

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper argues that large vision-language models underperform on knowledge-intensive tasks because they cannot draw on external knowledge during training, and that a three-part mechanism—a knowledge encoder, a task-relevant retrieval step, and a lightweight dynamic adaptor—can close that gap. It claims that this pipeline, called AKGP-LVLM, outperforms existing knowledge-enhanced and graph-based models on OK-VQA, FVQA, SNLI-VE, and NLVR2, with the largest gains on question answering. This would mean that structured and unstructured knowledge can be folded into vision-language models without retraining the whole backbone, making knowledge-intensive visual reasoning more practical.

What carries the argument

The load-bearing machinery is the knowledge-guided pretraining plus fine-tuning loop. A graph neural network encodes knowledge graphs into embeddings $k_i$; cosine similarity picks the single most relevant embedding $k^*$ for a multimodal representation $m$; a sigmoid gating mechanism merges $m$ and $k^*$; a contrastive loss aligns them in a shared space; and a dynamic knowledge adaptor maps the fused representation to task-specific predictions. The named component is the Dynamic Knowledge Adaptor, a lightweight module that selectively updates task-specific layers so external knowledge is injected without full re-training.

What would settle it

Reproduce the Section 3 pipeline on the four public datasets with a standard vision-language backbone and check whether the reported accuracies (OK-VQA 41.82, FVQA 57.05, SNLI-VE 77.32, NLVR2 74.65) and the ablation increments appear; the claim fails if the contrastive alignment loss alone does not add roughly the reported 1.97 points over retrieval on OK-VQA.

Watch

Extended reading notes

Core claim

The central claim is that AKGP-LVLM, a two-stage training framework, dynamically incorporates external knowledge into large vision-language models and thereby sets new state-of-the-art accuracy on four benchmarks: 41.82 on OK-VQA, 57.05 on FVQA, 77.32 on SNLI-VE, and 74.65 on NLVR2. The pipeline first pretrains with a contrastive alignment loss that pulls retrieved knowledge embeddings toward multimodal embeddings, then fine-tunes with a task-adaptive loss through a dynamic knowledge adaptor that updates task-specific layers. The paper reports that every component contributes, with the contrastive alignment loss giving the largest single gain, and that human annotators rate the model's answers more correct and more relevant than the strongest baseline's.

Load-bearing premise

The load-bearing premise is that the method described in Section 3 was fully implemented and that the scores in Tables 1–3 came from that exact implementation; the paper gives no backbone model, hyperparameter values, evaluation protocol, or code to confirm it.

Editorial extensions

If this is right

The OK-VQA ablation attributes 1.84 points to the knowledge encoder, 0.95 more to retrieval, and 1.97 more to contrastive alignment, for a total 4.56-point gain over LXMERT.
Training time stays near the baseline, with the paper reporting only about 12% overhead over LXMERT, so the gains do not require a large compute budget.
The same pipeline improves visual entailment and multimodal reasoning benchmarks, indicating the mechanism transfers beyond question answering.
Human annotators rated the model's answers at 82.3% correctness and 85.6% relevance, above GKN's 74.5% and 78.2%.
The knowledge retrieval step is task-aware, so the model is designed to ignore irrelevant knowledge rather than absorbing everything from the knowledge base.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

A testable extension is to replace single-best knowledge retrieval with a small retrieved set and measure whether multi-hop and ambiguous questions improve, since the paper lists those as current failure modes.
If the gains reproduce, the contrastive alignment loss is the component most worth porting to other retrieval-augmented multimodal systems, since it contributes the largest single ablation gain.
Because the paper does not name its backbone, an independent check would run the same pipeline on several open vision-language models to see whether the benefit is tied to one architecture.
The retrieval-and-adaptor design implies that knowledge bases can be swapped or expanded without retraining the whole model, which is a practical route to keeping deployed systems current.

Share X Bluesky LinkedIn Reddit HN

Signed reviews

No signed human review yet.

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

Here's my read on arXiv:2501.08597. The paper is a knowledge-retrieval + adapter recipe for LVLMs: a GNN encodes a knowledge graph, cosine retrieval selects relevant facts, a contrastive loss aligns embeddings, and a lightweight adaptor updates task layers. The writing is clear and the related work is appropriate, but the experimental section never identifies the underlying LVLM, the knowledge graph, the GNN construction, the hyperparameters (lambda_1, lambda_2, tau, number of negatives), or the evaluation protocol, and no code is released. As a result, the numbers in Tables 1-3 are not connected to the described method. That's a load-bearing flaw.

What's new? The specific combination might be marginally different from KRISP and GKN, but each component is standard, and there is no conceptual insight beyond those cited baselines. The ablation on OK-VQA is a nice structural touch, but it just decomposes known pieces. The human evaluation is too thin to add anything.

The reporting also has a couple of avoidable slips: the intro calls a 4.56 absolute-point gain over LXMERT a '4.56% improvement' (it's about 12% relative), and the experimental section mentions BLEU for generation tasks while all four benchmarks are accuracy-based. Those are minor compared to the missing implementation details, but they reinforce the impression of carelessness.

In short, the evidence in the paper cannot support the central claim. The method is not novel enough to overlook the missing details, and the missing details are not a matter of page limits—they're the information a reader needs to trust the numbers. I would not send this to a serious referee in its current state. If the authors release code, checkpoints, and a full training config, it might become a borderline paper for a lower-tier venue. For now, it's a desk reject.

Referee Report

5 major / 4 minor

Summary. The paper proposes AKGP-LVLM, a framework that integrates external structured and unstructured knowledge into large vision-language models via a knowledge encoder, a retrieval mechanism, and a dynamic adaptor. The authors report state-of-the-art results on OK-VQA (41.82), FVQA (57.05), SNLI-VE (77.32), and NLVR2 (74.65), with an ablation study on OK-VQA and a human evaluation claiming superior correctness and relevance over a baseline. The central claims are that each component contributes positively and that the method is efficient, robust, and scalable.

Significance. If fully specified and verified, the framework addresses a real problem—injecting task-relevant external knowledge into LVLMs—and the proposed two-stage training plus gated retrieval is a plausible design. The paper is clearly structured, provides equations for the main components, compares against three baselines, includes an ablation, and reports an error analysis. However, the contribution is currently unassessable: the method is described only abstractly, and the experimental validation lacks the details needed to reproduce or verify the reported numbers. As submitted, the paper reads as a high-level proposal rather than a validated empirical study.

major comments (5)

[§3.1, Eqs. (1)-(7); §4.1] The central claim in Table 1 depends on a fully specified model, but the text never identifies the LVLM that implements fv and ft, the cross-modal fusion gfusion, the graph neural network in Eq. (4), or the knowledge graph used for retrieval. The retrieval mechanism in Eq. (5) is also underspecified: no candidate set, no index, and no negative-sampling procedure are described. Because these components are load-bearing, a reader cannot tell whether the reported OK-VQA/FVQA/SNLI-VE/NLVR2 numbers were produced by the described method or by an unstated implementation.
[§4.1, Tables 1-3] Hyperparameters are said to be tuned separately for each dataset, but no values or ranges are given for λ1, λ2, τ, or N, and no learning rate, optimizer, batch size, or training schedule is reported. There is also no number of runs, no variance, no significance test, and no statement of whether baseline numbers are re-implemented or taken from original papers. The observed gains (e.g., 1.47 points over GKN on OK-VQA) are therefore not shown to be statistically meaningful.
[§3.2, Eq. (8); §4.5] The Dynamic Knowledge Adaptor is defined only as an abstract function ftask(m', k*; Θa). The paper does not state which layers are 'task-specific', how the adaptor is inserted into the LVLM, or why it is lightweight. Consequently the efficiency claim in §4.5 (training time only 12% longer than LXMERT) has no architectural or empirical support.
[§4.4, Table 3] The human evaluation reports only two aggregate percentages. There is no information about the number of annotators, the number of items, how they were sampled, the instructions given, or inter-annotator agreement, and no statistical test is applied. The claim of 'superior correctness and relevance' is therefore not established.
[§3.1, Eq. (7)] The contrastive alignment loss omits the positive pair from the denominator: the sum runs over N negatives only, so the loss is not a normalized softmax over candidates. Please clarify whether the positive sample is included in the candidate set and give the exact denominator; otherwise the objective, as written, differs from the standard contrastive loss used to justify the alignment stage.

minor comments (4)

[§1, §4.3] The abstract and intro call the OK-VQA gain '4.56% improvement' and the NLVR2 gain '3.34% improvement'; these are absolute percentage-point differences (37.26 to 41.82 is 4.56 points, or 12.2% relative), not percent improvements. The same issue appears in §4.5 for the 0.87% and 0.75% figures.
[§4.1] The setup says BLEU scores are used for generation tasks, but none of the four benchmarks is a generation task and no BLEU result appears in the paper.
[References] Reference [11] duplicates reference [8], and the baseline referred to as GKN does not match the title of reference [2] (VQA-GNN).
[§3.4] The two-stage training strategy does not state whether Lalign is re-used during fine-tuning or whether Ltotal in Eq. (11) is the only objective in stage 2; please clarify the loss schedule.

Circularity Check

0 steps flagged · score 0.0 of 10

No circular derivation is present; the reported benchmark gains are empirical results rather than consequences of the paper's equations.

full rationale

I find no circular step in the paper. Equations (1)-(11) define generic encoders, cosine-similarity retrieval, a contrastive alignment loss, a task loss, and a weighted total loss; none of these expressions is defined in terms of the reported OK-VQA, FVQA, SNLI-VE, or NLVR2 numbers. The ablation table is arithmetically consistent with the baseline and incremental accuracy gains, and each component is a configuration variant rather than a fitted parameter renamed as a prediction. The paper contains no self-citations by the authors, and no uniqueness theorem or prior result is imported to force the method's choices. Concerns about missing backbone details, unreported hyperparameter values, and per-dataset tuning bear on reproducibility and verifiability, but they do not constitute circularity because the paper does not claim to derive predictions from fitted quantities. Therefore the appropriate circularity score is 0.

Assumptions & free parameters 3 free parameters · 4 assumptions · 1 invented entities

The central claim rests on the empirical setup. The ledger shows several unstated modeling assumptions and hyperparameters, and one new module without isolated validation. This is a high burden for a paper that claims SOTA.

free parameters (3)

lambda_1 (alignment loss weight)
Introduced in Eq. (11); tuned per dataset but values not reported.
lambda_2 (task loss weight)
Introduced in Eq. (11); tuned per dataset but values not reported.
temperature tau
Introduced in Eq. (7); temperature for contrastive loss, values not reported.

assumptions (4)

domain assumption The pretrained visual and textual encoders provide meaningful embeddings that can be aligned with knowledge embeddings.
Invoked in Eqs. (1)-(3) without verification for the chosen backbone.
domain assumption The knowledge graph (ConceptNet or Wikidata) contains relevant and correct knowledge for the four benchmarks.
Section 3.1 says knowledge graphs are used but does not specify which graph, node features, or filtering.
domain assumption Cosine similarity retrieval selects task-relevant knowledge.
Eq. (5) uses argmax cosine similarity without comparison to other retrieval methods.
domain assumption Two-stage training (pretrain with Lalign then fine-tune with Ltotal) improves performance relative to other schemes.
Section 3.4 states this strategy without experiments comparing alternatives.

invented entities (1)

Dynamic Knowledge Adaptor
purpose: Selectively updates task-specific layers using multimodal and knowledge embeddings (Eq. 8).
The ablation in Table 2 does not isolate this component, so there is no independent evidence of its contribution.

how reviews work

0 comments

Cite this review

Pith. "Pith review of Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning." pith.science (2026). https://pith.science/paper/LUHQPM55

@misc{pith2026250108597,
  author       = {Pith},
  title        = {Pith review of: Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/LUHQPM55}},
  note         = {Machine review of arXiv:2501.08597}
}

read the original abstract

Large Vision-Language Models (LVLMs) have demonstrated impressive capabilities in multimodal tasks, but their performance is often constrained by the lack of external knowledge integration, limiting their ability to handle knowledge-intensive tasks such as visual question answering and reasoning. To address this challenge, we propose a novel method, Adaptive Knowledge-Guided Pretraining for Large Vision-Language Models (AKGP-LVLM), which dynamically incorporates structured and unstructured knowledge into LVLMs during pretraining and fine-tuning. Our approach employs a knowledge encoder to represent external knowledge, a retrieval mechanism to select task-relevant information, and a dynamic adaptor to align multimodal and knowledge representations effectively. We evaluate our method on four benchmark datasets, demonstrating significant performance improvements over state-of-the-art models. Furthermore, human evaluations highlight the superior correctness and relevance of our model's outputs. Extensive analyses confirm the robustness, efficiency, and scalability of AKGP-LVLM, making it a compelling solution for real-world knowledge-intensive tasks.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

Mitigating Hallucinations via Inter-Layer Consistency Aggregation in Large Vision-Language Models
cs.LG 2025-05 conditional novelty 5.0 of 10

DCLA reduces hallucinations by correcting each transformer layer's hidden state toward an exponentially weighted average of earlier layers, gated by a cosine-similarity threshold.

Reference graph

Works this paper leans on

24 extracted references · 12 canonical work pages · cited by 1 Pith paper

[1]

In: IEEE Conference on Computer Vision and Pattern Recognition, CVP R 2021, virtual, June 19-25, 2021

Marino, K., Chen, X., Parikh, D., Gupta, A., Rohrbach, M.: KRISP: integrating implicit and symbolic knowledge for open-domain knowledge -based VQA. In: IEEE Conference on Computer Vision and Pattern Recognition, CVP R 2021, virtual, June 19-25, 2021. pp. 14111–14121. Computer Vision Foundat ion / IEEE (2021). https://doi.org/10.1109/CVPR46437.2021.01389 D...

arXiv 2021
[2]

In: Proceedings of the IEEE/CVF International Conference on Co mputer Vision

Wang, Y., Yasunaga, M., Ren, H., Wada, S., Leskovec, J.: Vq a-gnn: Reasoning with multimodal knowledge via graph neural networks for visual q uestion answering. In: Proceedings of the IEEE/CVF International Conference on Co mputer Vision. pp. 21582–21592 (2023)

work page 2023
[3]

In: Pro- ceedings of the 2021 Conference of the North American Chapte r of the Associa- tion for Computational Linguistics: Human Language Techno logies

Zhou, Y., Geng, X., Shen, T., Zhang, W., Jiang, D.: Improvi ng zero-shot cross- lingual transfer for multilingual question answering over knowledge graph. In: Pro- ceedings of the 2021 Conference of the North American Chapte r of the Associa- tion for Computational Linguistics: Human Language Techno logies. pp. 5822–5834 (2021)

work page 2021
[4]

In: Chaudhuri, K., Jegelka, S., Song , L., Szepesvári, C., Niu, G., Sabato, S

Das, R., Godbole, A., Naik, A., Tower, E., Zaheer, M., Haji shirzi, H., Jia, R., McCallum, A.: Knowledge base question answering by case -based rea- soning over subgraphs. In: Chaudhuri, K., Jegelka, S., Song , L., Szepesvári, C., Niu, G., Sabato, S. (eds.) International Conference on M achine Learn- ing, ICML 2022, 17-23 July 2022, Baltimore, Maryland, U...

work page 2022
[5]

In: Moens, M., Huang, X., Spec ia, L., Yih, S.W

Das, R., Zaheer, M., Thai, D., Godbole, A., Perez, E., Lee, J.Y., Tan, L., Polymenakos, L., McCallum, A.: Case-based reasoning for na tural language queries over knowledge bases. In: Moens, M., Huang, X., Spec ia, L., Yih, S.W. (eds.) Proceedings of the 2021 Conference on Empirical Meth ods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta...

2021
[6]

CoRR abs/2404.10226 (2024)

Barezi, E.J., Kordjamshidi, P.: Find the gap: Knowl- edge base reasoning for visual question answering. CoRR abs/2404.10226 (2024). https://doi.org/10.48550/ARXIV.2404.10226, https://doi.org/10.48550/arXiv.2404.10226

arXiv doi:10.48550/arxiv.2404.10226 2024
[7]

In : Proceedings of the AAAI Conference on Artiﬁcial Intelligence

Zhou, Y., Shen, T., Geng, X., Tao, C., Shen, J., Long, G., Xu , C., Jiang, D.: Fine-grained distillation for long document retrieval. In : Proceedings of the AAAI Conference on Artiﬁcial Intelligence. vol. 38, pp. 19732–1 9740 (2024)

2024
[8]

In: 8th Internationa l Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, Apr il 26-30, 2020

Cohen, W.W., Sun, H., Hofer, R.A., Siegler, M.: Scalable n eural methods for rea- soning with a symbolic knowledge base. In: 8th Internationa l Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, Apr il 26-30, 2020. Open- Review.net (2020), https://openreview.net/forum?id=BJlguT4YPr

work page 2020

Show all 24 references

[9]

In: Proceedings of the 60th Annual Meeting o f the Association for Computational Linguistics (Volume 1: Long Papers)

Zhou, Y., Shen, T., Geng, X., Long, G., Jiang, D.: Claret: P re-training a correlation-aware context-to-event transformer for even t-centric generation and classiﬁcation. In: Proceedings of the 60th Annual Meeting o f the Association for Computational Linguistics (Volume 1: Lo...

2022
[10]

In: Proceedings of the ACM Web Conference 2022

Zhou, Y., Geng, X., Shen, T., Long, G., Jiang, D.: Eventbe rt: A pre-trained model for event correlation reasoning. In: Proceedings of the ACM Web Conference 2022. pp. 850–859 (2022)

2022
[11]

In: 8th Internationa l Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, Apr il 26-30, 2020

Cohen, W.W., Sun, H., Hofer, R.A., Siegler, M.: Scalable neural methods for rea- soning with a symbolic knowledge base. In: 8th Internationa l Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, Apr il 26-30, 2020. Open- Review.net (2020), https://openr...

2020
[12]

In: Proceedings of the 17th Conference of the Eu ropean Chapter of the Association for Computational Linguistics

Zhou, Y., Long, G.: Multimodal event transformer for ima ge-guided story ending generation. In: Proceedings of the 17th Conference of the Eu ropean Chapter of the Association for Computational Linguistics. pp. 3434–3444 (2023) 12 J. Perry et al

2023
[13]

In: Duh, K., Gómez-A dorno, H., Bethard, S

Zhao, W., Liu, Y., Niu, T., Wan, Y., Yu, P.S., Joty, S., Zho u, Y., Yavuz, S.: DIVKNOWQA: assessing the reasoning ability of llms via open -domain question answering over knowledge base and text. In: Duh, K., Gómez-A dorno, H., Bethard, S. (eds.) Findings of the Association fo...

2024 doi
[14]

In: International Conference on Machine Learning

Sun, H., Verga, P., Dhingra, B., Salakhutdinov, R., Cohe n, W.W.: Reasoning over virtual knowledge bases with open predicate relations. In: International Conference on Machine Learning. pp. 9966–9977. PMLR (2021)

2021
[15]

Expert systems with applications 141, 112948 (2020)

Chen, X., Jia, S., Xiang, Y.: A review: Knowledge reasoni ng over knowledge graph. Expert systems with applications 141, 112948 (2020)

2020
[16]

Alonso-Jiménez, J.A., Aranda-Corral, G.A., Borrego-D íaz, J., Fernández- Lebrón, M.M., Hidalgo-Doblado, M.: A logic-algebraic tool for reason- ing with knowledge-based systems. J. Log. Algebraic Method s Program. 101, 88–109 (2018). https://doi.org/10.1016/J.JLAMP.2018.09.001,...

2018 doi
[17]

Zhang, P., Dong, X., Zang, Y., Cao, Y., Qian, R., Chen, L., Guo, Q., Duan, H., Wang, B., Ouyang, L., Zhang, S., Zhang, W., Li, Y., Gao, Y. , Sun, P., Zhang, X., Li, W., Li, J., Wang, W., Yan, H., He, C., Zhang, X., Chen, K., Dai, J., Qiao, Y., Lin, D., Wang, J.: Internlm-xcomp...

2024 doi arXiv
[18]

arXiv preprint arXiv:2308.12966 1(2), 3 (2023)

Bai, J., Bai, S., Yang, S., Wang, S., Tan, S., Wang, P., Lin , J., Zhou, C., Zhou, J.: Qwen-vl: A versatile vision-language model for understand ing, localization, text reading, and beyond. arXiv preprint arXiv:2308.12966 1(2), 3 (2023)

2023 arXiv
[19]

In: ICASSP 2021-2021 IEEE Inter national Conference on Acoustics, Speech and Signal Processing (ICASSP)

Zhou, Y., Tao, W., Zhang, W.: Triple sequence generative adversarial nets for unsu- pervised image captioning. In: ICASSP 2021-2021 IEEE Inter national Conference on Acoustics, Speech and Signal Processing (ICASSP). pp. 75 98–7602. IEEE (2021)

2021
[20]

IEEE Transactions on Pattern Analysis and Machine I ntelligence (2024)

Zhang, J., Huang, J., Jin, S., Lu, S.: Vision-language mo dels for vision tasks: A survey. IEEE Transactions on Pattern Analysis and Machine I ntelligence (2024)

2024
[21]

arXiv preprin t arXiv:2410.19732 (2024)

Zhou, Y., Rao, Z., Wan, J., Shen, J.: Rethinking visual de pendency in long-context reasoning for large vision-language models. arXiv preprin t arXiv:2410.19732 (2024)

2024 arXiv
[22]

In: Findings of the Association for Comput ational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11- 16, 2024

Zhou, Y., Li, X., Wang, Q., Shen, J.: Visual in-context le arning for large vision- language models. In: Findings of the Association for Comput ational Linguistics, ACL 2024, Bangkok, Thailand and virtual meeting, August 11- 16, 2024. pp. 15890– 15902. Association for Computat...

2024
[23]

CoRR abs/2405.10292 (2024)

Zhai, Y., Bai, H., Lin, Z., Pan, J., Tong, S., Zhou, Y., Suh r, A., Xie, S., LeCun, Y., Ma, Y., Levine, S.: Fine-tuning large vision- language models as decision-making agents via reinforcement learni ng. CoRR abs/2405.10292 (2024). https://doi.org/10.48550/ARXIV.2405.10292, h...

2024 doi arXiv
[24]

, Hou, L., Li, J., Dong, Y., Tang, J.: Cogcom: Train large vision-la nguage models diving into details through chain of manipulations

Qi, J., Ding, M., Wang, W., Bai, Y., Lv, Q., Hong, W., Xu, B. , Hou, L., Li, J., Dong, Y., Tang, J.: Cogcom: Train large vision-la nguage models diving into details through chain of manipulations. CoRR abs/2402.04236 (2024). https://doi.org/10.48550/ARXIV.2402.04236, https://d...

2024 doi arXiv

Pith tools

Reviewed August 10, 2026 · model on record in the stance chip above.

[1] [1]

In: IEEE Conference on Computer Vision and Pattern Recognition, CVP R 2021, virtual, June 19-25, 2021

Marino, K., Chen, X., Parikh, D., Gupta, A., Rohrbach, M.: KRISP: integrating implicit and symbolic knowledge for open-domain knowledge -based VQA. In: IEEE Conference on Computer Vision and Pattern Recognition, CVP R 2021, virtual, June 19-25, 2021. pp. 14111–14121. Computer Vision Foundat ion / IEEE (2021). https://doi.org/10.1109/CVPR46437.2021.01389 D...

arXiv 2021

[2] [2]

In: Proceedings of the IEEE/CVF International Conference on Co mputer Vision

Wang, Y., Yasunaga, M., Ren, H., Wada, S., Leskovec, J.: Vq a-gnn: Reasoning with multimodal knowledge via graph neural networks for visual q uestion answering. In: Proceedings of the IEEE/CVF International Conference on Co mputer Vision. pp. 21582–21592 (2023)

work page 2023

[3] [3]

In: Pro- ceedings of the 2021 Conference of the North American Chapte r of the Associa- tion for Computational Linguistics: Human Language Techno logies

Zhou, Y., Geng, X., Shen, T., Zhang, W., Jiang, D.: Improvi ng zero-shot cross- lingual transfer for multilingual question answering over knowledge graph. In: Pro- ceedings of the 2021 Conference of the North American Chapte r of the Associa- tion for Computational Linguistics: Human Language Techno logies. pp. 5822–5834 (2021)

work page 2021

[4] [4]

In: Chaudhuri, K., Jegelka, S., Song , L., Szepesvári, C., Niu, G., Sabato, S

Das, R., Godbole, A., Naik, A., Tower, E., Zaheer, M., Haji shirzi, H., Jia, R., McCallum, A.: Knowledge base question answering by case -based rea- soning over subgraphs. In: Chaudhuri, K., Jegelka, S., Song , L., Szepesvári, C., Niu, G., Sabato, S. (eds.) International Conference on M achine Learn- ing, ICML 2022, 17-23 July 2022, Baltimore, Maryland, U...

work page 2022

[5] [5]

In: Moens, M., Huang, X., Spec ia, L., Yih, S.W

Das, R., Zaheer, M., Thai, D., Godbole, A., Perez, E., Lee, J.Y., Tan, L., Polymenakos, L., McCallum, A.: Case-based reasoning for na tural language queries over knowledge bases. In: Moens, M., Huang, X., Spec ia, L., Yih, S.W. (eds.) Proceedings of the 2021 Conference on Empirical Meth ods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta...

2021

[6] [6]

CoRR abs/2404.10226 (2024)

Barezi, E.J., Kordjamshidi, P.: Find the gap: Knowl- edge base reasoning for visual question answering. CoRR abs/2404.10226 (2024). https://doi.org/10.48550/ARXIV.2404.10226, https://doi.org/10.48550/arXiv.2404.10226

arXiv doi:10.48550/arxiv.2404.10226 2024

[7] [7]

In : Proceedings of the AAAI Conference on Artiﬁcial Intelligence

Zhou, Y., Shen, T., Geng, X., Tao, C., Shen, J., Long, G., Xu , C., Jiang, D.: Fine-grained distillation for long document retrieval. In : Proceedings of the AAAI Conference on Artiﬁcial Intelligence. vol. 38, pp. 19732–1 9740 (2024)

2024

[8] [8]

In: 8th Internationa l Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, Apr il 26-30, 2020

Cohen, W.W., Sun, H., Hofer, R.A., Siegler, M.: Scalable n eural methods for rea- soning with a symbolic knowledge base. In: 8th Internationa l Conference on Learn- ing Representations, ICLR 2020, Addis Ababa, Ethiopia, Apr il 26-30, 2020. Open- Review.net (2020), https://openreview.net/forum?id=BJlguT4YPr

work page 2020