Pith. sign in

REVIEW 2 cited by

How to Design Translation Prompts for ChatGPT: An Empirical Study

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2304.02182 v2 pith:T3GRQBIK submitted 2023-04-05 cs.CL

classification cs.CL
keywords chatgpttranslationpromptstranslationslanguageabilitiescommercialempirical
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

The recently released ChatGPT has demonstrated surprising abilities in natural language understanding and natural language generation. Machine translation relies heavily on the abilities of language understanding and generation. Thus, in this paper, we explore how to assist machine translation with ChatGPT. We adopt several translation prompts on a wide range of translations. Our experimental results show that ChatGPT with designed translation prompts can achieve comparable or better performance over commercial translation systems for high-resource language translations. We further evaluate the translation quality using multiple references, and ChatGPT achieves superior performance compared to commercial systems. We also conduct experiments on domain-specific translations, the final results show that ChatGPT is able to comprehend the provided domain keyword and adjust accordingly to output proper translations. At last, we perform few-shot prompts that show consistent improvement across different base prompts. Our work provides empirical evidence that ChatGPT still has great potential in translations.

Discussion (0). Sign in to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Benchmarking the Detection of LLMs-Generated Modern Chinese Poetry

    cs.CL 2025-09 conditional novelty 6.0 of 10

    A new modern Chinese poetry detection benchmark shows most current AI-text detectors are unreliable, particularly when LLMs imitate a human style.

  2. ViDove: A Translation Agent System with Multimodal Context and Memory-Augmented Reasoning

    cs.AI 2025-07 conditional novelty 4.0 of 10

    A multimodal, memory-augmented multi-agent system for video subtitling and translation, plus a new 17-hour benchmark, reports large BLEU/SubER gains on its own benchmark but not consistently on existing benchmarks.

Pith tools