Open source AI will not democratize access on its own, so the paper argues open models must be embedded in publicly funded and governed public AI infrastructure.
GPT-SW3: An Autoregressive Language Model for the Nordic Languages
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
This paper details the process of developing the first native large generative language model for the Nordic languages, GPT-SW3. We cover all parts of the development process, from data collection and processing, training configuration and instruction finetuning, to evaluation and considerations for release strategies. We hope that this paper can serve as a guide and reference for other researchers that undertake the development of large generative models for smaller languages.
fields
cs.CY 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
If open source is to win, it must go public
Open source AI will not democratize access on its own, so the paper argues open models must be embedded in publicly funded and governed public AI infrastructure.