Pith. sign in

REVIEW 2 cited by

Worst of Both Worlds: Biases Compound in Pre-trained Vision-and-Language Models

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2104.08666 v2 pith:MVTJV3JH submitted 2021-04-18 cs.CL

classification cs.CL
keywords biasesmodelsdemonstratelanguagemultimodalpre-trainedanalysisanalyzed
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Numerous works have analyzed biases in vision and pre-trained language models individually - however, less attention has been paid to how these biases interact in multimodal settings. This work extends text-based bias analysis methods to investigate multimodal language models, and analyzes intra- and inter-modality associations and biases learned by these models. Specifically, we demonstrate that VL-BERT (Su et al., 2020) exhibits gender biases, often preferring to reinforce a stereotype over faithfully describing the visual scene. We demonstrate these findings on a controlled case-study and extend them for a larger set of stereotypically gendered entities.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. From Individuals to Interactions: Benchmarking Gender Bias in Multimodal Large Language Models from the Lens of Social Relationship

    cs.CL 2025-06 conditional novelty 6.0 of 10

    Dual-character narrative prompts reveal gender biases in six multimodal LLMs that are largely invisible in single-character evaluations, and GENRES provides a structured benchmark to measure them.

  2. Multimodal Political Bias Identification and Neutralization

    cs.CY 2025-06 unverdicted novelty 4.0 of 10

    A proposed multimodal pipeline to identify and reduce political bias in news text and images remains unvalidated: the report presents architecture and qualitative examples, without quantitative results for most components.

Pith tools