REVIEW 4 cited by
Image-embodied Knowledge Representation Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Entity images could provide significant visual information for knowledge representation learning. Most conventional methods learn knowledge representations merely from structured triples, ignoring rich visual information extracted from entity images. In this paper, we propose a novel Image-embodied Knowledge Representation Learning model (IKRL), where knowledge representations are learned with both triple facts and images. More specifically, we first construct representations for all images of an entity with a neural image encoder. These image representations are then integrated into an aggregated image-based representation via an attention-based method. We evaluate our IKRL models on knowledge graph completion and triple classification. Experimental results demonstrate that our models outperform all baselines on both tasks, which indicates the significance of visual information for knowledge representations and the capability of our models in learning knowledge representations with images.
Forward citations
Cited by 4 Pith papers
-
Two-dimensional Taxonomy for N-ary Knowledge Representation Learning Methods
A survey of n-ary knowledge representation learning methods proposes a two-dimensional taxonomy based on modeling technique and entity role/position awareness.
-
HERGC: Heterogeneous Experts Representation and Generative Completion for Multimodal Knowledge Graphs
HERGC combines a multimodal expert-based retriever with a fine-tuned LLM re-ranker to achieve state-of-the-art multimodal knowledge graph completion on MKG-W, MKG-Y, and DB15K.
-
Complementarity-driven Representation Learning for Multi-modal Knowledge Graph Completion
MoCME combines expert-network fusion weighted by estimated mutual information and entropy-based negative sampling, and reports state-of-the-art multi-modal knowledge graph completion on five benchmarks.
-
Towards Structure-aware Model for Multi-modal Knowledge Graph Completion
TSAM combines token-level fusion of visual and textual data with structure-anchored contrastive learning, outperforming prior multi-modal KGC models on DB15K, MKG-W, and MKG-Y.
Discussion (0). Sign in to comment.