REVIEW 7 cited by
Benchmarking Machine Translation with Cultural Awareness
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
Signed reviews
read the original abstract
Translating culture-related content is vital for effective cross-cultural communication. However, many culture-specific items (CSIs) often lack viable translations across languages, making it challenging to collect high-quality, diverse parallel corpora with CSI annotations. This difficulty hinders the analysis of cultural awareness of machine translation (MT) systems, including traditional neural MT and the emerging MT paradigm using large language models (LLM). To address this gap, we introduce a novel parallel corpus, enriched with CSI annotations in 6 language pairs for investigating Culturally-Aware Machine Translation--CAMT. Furthermore, we design two evaluation metrics to assess CSI translations, focusing on their pragmatic translation quality. Our findings show the superior ability of LLMs over neural MTs in leveraging external cultural knowledge for translating CSIs, especially those lacking translations in the target culture.
Forward citations
Cited by 7 Pith papers
-
DECA: A Near-Core LLM Decompression Accelerator Grounded on a 3D Roofline Model
A near-core decompression accelerator plus a 3D roofline model speeds up compressed LLM matrix multiplication by up to 4x in simulation.
-
Building Large-Scale English-Romanian Literary Translation Resources with Open Models
LoRA-fine-tuning a 12B open model on 15,000 GPT-o3 fable translations yields rubric scores close to GPT-o3 (4.83 vs 4.92) for English-to-Romanian literary translation at roughly one percent of the API cost.
-
Towards Style Alignment in Cross-Cultural Translation
LLMs systematically reduce politeness, intimacy, and formality variation in translation, and a retrieval-augmented prompting method that supplies native style exemplars improves style alignment without hurting content...
-
"I Apologize For Not Understanding Your Policy": Exploring the Specification and Evaluation of User-Managed Access Control Policies by AI Virtual Assistants
Current virtual assistants handle explicitly stated access control rules fairly well but often fail on inference-based and default-deny policy decisions, a pattern consistent across the three tested domains.
-
Exploring Large Language Models for Multimodal Sentiment Analysis: Challenges, Benchmarks, and Future Directions
On two Twitter multimodal aspect-based sentiment benchmarks, zero-shot/few-shot LLMs like Llama2, LLaVA, and ChatGPT score 7 to 16 F1 points below supervised baselines and take orders of magnitude longer to run.
-
RED: Unleashing Token-Level Rewards from Holistic Feedback via Reward Redistribution
RED assigns token-level rewards by taking the difference of a sequence reward model's scores on adjacent prefixes, improving RLHF training without additional reward-model training.
-
Enhancing Entertainment Translation for Indian Languages using Adaptive Context, Style and LLMs
CASAT adds session segmentation, retrieval-augmented plot summaries, and style statistics to LLM prompts for context-aware entertainment translation into Indian languages.
Discussion (0). Continue with ORCID to comment.