Pith sign in

REVIEW 1 cited by

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2407.05449 v2 pith:BTVVCIKF submitted 2024-07-07 cs.CL cs.AI

SmurfCat at PAN 2024 TextDetox: Alignment of Multilingual Transformers for Text Detoxification

classification cs.CL cs.AI
keywords detoxificationmultilingualtextfinalalignmentcompetitiondataevaluation
verification ladder T0 review T1 audit T2 compute T3 formal T4 reserved
0 comments
read the original abstract

This paper presents a solution for the Multilingual Text Detoxification task in the PAN-2024 competition of the SmurfCat team. Using data augmentation through machine translation and a special filtering procedure, we collected an additional multilingual parallel dataset for text detoxification. Using the obtained data, we fine-tuned several multilingual sequence-to-sequence models, such as mT0 and Aya, on a text detoxification task. We applied the ORPO alignment technique to the final model. Our final model has only 3.7 billion parameters and achieves state-of-the-art results for the Ukrainian language and near state-of-the-art results for other languages. In the competition, our team achieved first place in the automated evaluation with a score of 0.52 and second place in the final human evaluation with a score of 0.74.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score.

  1. The Tatoxa System for Text Detoxification in Low-Resource Languages: The Case of Tatar

    cs.CL 2026-06 unverdicted novelty 6.0

    Tatoxa outperforms open and commercial LLMs for Tatar text detoxification using a new dataset, with native Tatar training beating cross-lingual transfer from Russian.