REVIEW 2 cited by
PLATO-2: Towards Building an Open-Domain Chatbot via Curriculum Learning
Not yet reviewed by Pith; the record is open.
This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.
SPECIMEN: schema-true, not a live event
T0 review · schema-true
One-sentence machine reading of the paper's core claim.
pith:XXXXXXXX · record.json · timestamp
read the original abstract
To build a high-quality open-domain chatbot, we introduce the effective training process of PLATO-2 via curriculum learning. There are two stages involved in the learning process. In the first stage, a coarse-grained generation model is trained to learn response generation under the simplified framework of one-to-one mapping. In the second stage, a fine-grained generative model augmented with latent variables and an evaluation model are further trained to generate diverse responses and to select the best response, respectively. PLATO-2 was trained on both Chinese and English data, whose effectiveness and superiority are verified through comprehensive evaluations, achieving new state-of-the-art results.
Forward citations
Cited by 2 Pith papers
-
Improving Linguistic Diversity of Large Language Models with Possibility Exploration Fine-Tuning
Possibility Exploration Fine-Tuning (PEFT) conditions LLMs on a random possibility number and trains with unlikelihood to generate diverse, controllable responses without added latency, as shown on dialogue and story tasks.
-
Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges
A broad but error-prone survey of LLM and MLLM architectures, training methods, benchmarks, and challenges.
Discussion (0). Continue with ORCID to comment.