Ofa: A framework of initializing unseen subword embeddings for efficient large-scale multilingual continued pretraining, 2023 a

Yihong Liu, Peiqin Lin, Mingyang Wang, Hinrich Schütze · 2023 · arXiv 2311.08849

1 Pith paper cite this work. Polarity classification is still indexing.

1 Pith paper citing it

representative citing papers

cs.CL · 2024-04-03 · unverdicted · novelty 4.0

Four MAFT-based PLMs for Angolan languages report 12.3-point gains over AfroXLMR-base and 3.8-point gains over OFA baselines on downstream tasks.

Showing 1 of 1 citing paper.

ANGOFA: Leveraging OFA Embedding Initialization and Synthetic Data for Angolan Language Model cs.CL · 2024-04-03 · unverdicted · none · ref 13
Four MAFT-based PLMs for Angolan languages report 12.3-point gains over AfroXLMR-base and 3.8-point gains over OFA baselines on downstream tasks.