REVIEW 4 cited by
Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Knowledge Graph Completion with Pre-trained Multimodal Transformer and Twins Negative Sampling
read the original abstract
Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus, knowledge graph completion (KGC) is of great importance to predict the missing triples in the existing KGs. As for the existing KGC methods, embedding-based methods rely on manual design to leverage multimodal information while finetune-based approaches are not superior to embedding-based methods in link prediction. To address these problems, we propose a VisualBERT-enhanced Knowledge Graph Completion model (VBKGC for short). VBKGC could capture deeply fused multimodal information for entities and integrate them into the KGC model. Besides, we achieve the co-design of the KGC model and negative sampling by designing a new negative sampling strategy called twins negative sampling. Twins negative sampling is suitable for multimodal scenarios and could align different embeddings for entities. We conduct extensive experiments to show the outstanding performance of VBKGC on the link prediction task and make further exploration of VBKGC.
Forward citations
Cited by 4 Pith papers
-
MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion
M2GDT, an align-then-diffuse framework with relation-adaptive routing, MLLM-anchored alignment, and a graph diffusion transformer, improves multimodal knowledge graph completion on MKG-W, MKG-Y, and DB15K over prior s...
-
Time Imprint: Learning Time-Aware Representations in Multi-Modal Knowledge Graphs
Treating time as an entity-level modality with median-K timestamp selection, attention pooling, and three-stage temporal injection yields large link-prediction gains on the hardest multi-modal ambiguity cases.
-
RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion
RADD decouples retrieval and reranking in multi-modal KGC via a relation-aware KGE retriever and conditional discrete denoiser, reporting state-of-the-art results on three benchmarks.
-
RADD: Retrieval-Augmented Discrete Diffusion for Multi-Modal Knowledge Graph Completion
A retrieve-then-rerank framework using a KGE shortlist and a discrete diffusion reranker reports SOTA MMKGC scores, but the diffusion mechanism is underspecified and not isolated from a generic reranker.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.