REVIEW 5 cited by
Survey of Cultural Awareness in Language Models: Text and Beyond
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Survey of Cultural Awareness in Language Models: Text and Beyond
read the original abstract
Large-scale deployment of large language models (LLMs) in various applications, such as chatbots and virtual assistants, requires LLMs to be culturally sensitive to the user to ensure inclusivity. Culture has been widely studied in psychology and anthropology, and there has been a recent surge in research on making LLMs more culturally inclusive in LLMs that goes beyond multilinguality and builds on findings from psychology and anthropology. In this paper, we survey efforts towards incorporating cultural awareness into text-based and multimodal LLMs. We start by defining cultural awareness in LLMs, taking the definitions of culture from anthropology and psychology as a point of departure. We then examine methodologies adopted for creating cross-cultural datasets, strategies for cultural inclusion in downstream tasks, and methodologies that have been used for benchmarking cultural awareness in LLMs. Further, we discuss the ethical implications of cultural alignment, the role of Human-Computer Interaction in driving cultural inclusion in LLMs, and the role of cultural alignment in driving social science research. We finally provide pointers to future research based on our findings about gaps in the literature.
Forward citations
Cited by 5 Pith papers
-
Which Institutional Frameworks Do Chatbots Assume? Auditing Jurisdictional Defaults in Multilingual LLMs
LLMs default to U.S. frameworks for English prompts and China frameworks for Chinese prompts on jurisdiction-underspecified legal-administrative queries, with the pattern holding across all seven tested models.
-
ExCAM: Explainable Cultural Awareness Metrics
ExCAM is a new explainable metric for cultural awareness in LLMs, trained on the ExCAM40k dataset derived from nine existing benchmarks with added synthetic errors, achieving up to 80% error detection accuracy.
-
Occupational Prompting Reveals Cultural Bias in Large Language Models
Occupational prompting of open-weight LLMs elicits structured value patterns in Inglehart-Welzel cultural space, extending prior nationality-based cultural bias evaluations.
-
Prompt Programming for Cultural Bias and Alignment of Large Language Models
Automatically optimized prompts (DSPy) reduce survey-measured cultural distance for open-weight LLMs more often than manual cultural prompting, with MIPROv2 and a large proposer model giving the most consistent gains.
-
Afrispeech Semantics: Evaluating Audio Semantic Reasoning in Spoken Language Models Across Domains and Accents
Audio language models are benchmarked on five semantic and paralinguistic reasoning tasks to reveal limitations in handling spoken audio evidence, accent variation, and domain shifts.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.