A 187M-parameter Japanese ModernBERT was trained on the public llm-jp corpus with 8192-token context and released with code, showing modest downstream performance but useful checkpoint-level analyses.
https://huggingface.co/ku-nlp/ deberta-v3-base-japanese
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
llm-jp-modernbert: A ModernBERT Model Trained on a Large-Scale Japanese Corpus with Long Context Length
A 187M-parameter Japanese ModernBERT was trained on the public llm-jp corpus with 8192-token context and released with code, showing modest downstream performance but useful checkpoint-level analyses.