REVIEW 1 cited by
Modular and Parameter-Efficient Multimodal Fusion with Prompting
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
Recent research has made impressive progress in large-scale multimodal pre-training. In the context of the rapid growth of model size, it is necessary to seek efficient and flexible methods other than finetuning. In this paper, we propose to use prompt vectors to align the modalities. Our method achieves comparable performance to several other multimodal fusion methods in low-resource settings. We further show that our method is modular and parameter-efficient for processing tasks involving two or more data modalities.
Forward citations
Cited by 1 Pith paper
-
EPIC: Efficient Prompt Interaction for Text-Image Classification
EPIC uses similarity-gated cross-modal prompt interactions in frozen CLIP to improve text-image classification accuracy while training about 1% of parameters.
Discussion (0). Sign in to comment.