Pith. sign in

REVIEW 2 cited by

PhoGPT: Generative Pre-training for Vietnamese

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2311.02945 v3 pith:WTINJLIY submitted 2023-11-06 cs.CL

classification cs.CL
keywords modelphogptphogpt-4bvietnamesebasechatgenerativemodels
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We open-source a state-of-the-art 4B-parameter generative model series for Vietnamese, which includes the base pre-trained monolingual model PhoGPT-4B and its chat variant, PhoGPT-4B-Chat. The base model, PhoGPT-4B, with exactly 3.7B parameters, is pre-trained from scratch on a Vietnamese corpus of 102B tokens, with an 8192 context length, employing a vocabulary of 20480 token types. The chat variant, PhoGPT-4B-Chat, is the modeling output obtained by fine-tuning PhoGPT-4B on a dataset of 70K instructional prompts and their responses, along with an additional 290K conversations. In addition, we also demonstrate its superior performance compared to previous open-source models. Our PhoGPT models are available at: https://github.com/VinAIResearch/PhoGPT

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 2 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. ConnectED: A Curriculum-Aligned AI System for Vietnamese Instructional Lesson Planning and Student Learning

    cs.HC 2026-06 conditional novelty 5.0 of 10

    A Vietnamese education LLM (Qwen3-8B + SFT/DPO) with an ADDIE-style lesson-planning workflow reports 87% exam accuracy and 30–45 min prep, with small satisfaction surveys.

  2. ViBidirectionMT-Eval: Machine Translation for Vietnamese-Chinese and Vietnamese-Lao language pair

    cs.CL 2025-01 reject novelty 4.0 of 10

    A shared-task report and dataset release for four Vietnamese-Chinese and Vietnamese-Lao translation directions, with human post-editing scores used for official rankings.

Pith tools