Hy-MT2: A Family of Fast, Efficient and Powerful Multilingual Translation Models in the Wild
Pith reviewed 2026-05-22 06:58 UTC · model grok-4.3
The pith
Hy-MT2 is a family of three multilingual translation models that outperform both open-source systems and commercial APIs across real-world tasks while supporting efficient device deployment.
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
Core claim
Hy-MT2 models achieve strong results on general, business, domain-specific, and instruction-following translation tasks, with the 7B and 30B variants outperforming listed open-source models in fast-thinking mode and the 1.8B variant surpassing listed commercial APIs overall.
What carries the argument
The Hy-MT2 model family with its three size variants (1.8B, 7B, 30B-A3B MoE) optimized for multilingual translation and instruction following.
Load-bearing premise
The multi-dimensional evaluations accurately measure real-world performance without undisclosed data selection or test-set overlap that would inflate gains over baselines.
What would settle it
An independent test on previously unseen real-world business or domain-specific translation examples in which the Hy-MT2 models no longer outperform the compared open-source models or commercial APIs.
Figures
read the original abstract
Hy-MT2 is a family of fast-thinking multilingual translation models designed for complex real-world scenarios. It includes three model sizes: 1.8B, 7B, and 30B-A3B (MoE), all of which support translation among 33 languages and effectively follow translation instructions in multiple languages. For on-device deployment, with AngelSlim 1.25-bit extreme quantization, the 1.8B model requires only 440 MB of storage and improves inference speed by 1.5x. Multi-dimensional evaluations show that Hy-MT2 delivers outstanding performance across general, real-world business, domain-specific, and instruction-following translation tasks. The 7B and 30B models outperform open-source models such as DeepSeek-V4-Pro and Kimi K2.6 in fast-thinking mode, while the lightweight 1.8B model also surpasses mainstream commercial APIs from providers such as Microsoft and Doubao overall.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The manuscript introduces Hy-MT2, a family of fast-thinking multilingual translation models in three sizes (1.8B, 7B, and 30B-A3B MoE) supporting translation across 33 languages with instruction-following capabilities. It emphasizes on-device efficiency via AngelSlim 1.25-bit quantization (440 MB storage and 1.5x speed-up for the 1.8B model) and reports superior performance over open-source models (DeepSeek-V4-Pro, Kimi K2.6) and commercial APIs (Microsoft, Doubao) across general, real-world business, domain-specific, and instruction-following tasks based on multi-dimensional evaluations.
Significance. If the reported evaluations hold under rigorous, reproducible conditions without undisclosed test-set curation or training-data overlap, the work would offer a practical advance in efficient multilingual MT suitable for real-world and resource-constrained settings. The scaling to MoE, combined with extreme quantization, addresses deployment needs that many prior open models overlook.
major comments (1)
- [Abstract and Evaluation sections] The central performance claims (7B/30B outperforming DeepSeek-V4-Pro and Kimi K2.6; 1.8B surpassing Microsoft and Doubao) rest entirely on the assertion of 'multi-dimensional evaluations' across four task categories, yet no section supplies the exact test sets, prompt sources, metrics, baseline implementation details, or contamination checks. This absence directly undermines verification of the headline superiority results.
minor comments (1)
- [Abstract] The phrase 'fast-thinking mode' appears in the abstract without prior definition or reference to a specific inference setting or comparison protocol.
Simulated Author's Rebuttal
We thank the referee for their thorough review and for highlighting the need for greater transparency in our evaluation methodology. We agree that detailed documentation of test sets, prompts, metrics, baselines, and contamination checks is essential to substantiate the performance claims and enable independent verification. We will revise the manuscript to address this concern directly.
read point-by-point responses
-
Referee: [Abstract and Evaluation sections] The central performance claims (7B/30B outperforming DeepSeek-V4-Pro and Kimi K2.6; 1.8B surpassing Microsoft and Doubao) rest entirely on the assertion of 'multi-dimensional evaluations' across four task categories, yet no section supplies the exact test sets, prompt sources, metrics, baseline implementation details, or contamination checks. This absence directly undermines verification of the headline superiority results.
Authors: We acknowledge that the current manuscript does not provide sufficient detail on the evaluation protocol. In the revised version, we will expand the Evaluation section with a new subsection that explicitly lists: (1) the exact test sets and their sources for each of the four task categories (general, real-world business, domain-specific, and instruction-following); (2) the prompt templates and sources used for instruction-following tasks; (3) the primary and secondary metrics (e.g., BLEU, COMET, human preference scores) with computation details; (4) baseline implementation specifics, including API versions or reproduction steps for DeepSeek-V4-Pro, Kimi K2.6, Microsoft Translator, and Doubao; and (5) the procedures followed to detect and mitigate training-data contamination. Where possible, we will release evaluation scripts and dataset references to support reproducibility. revision: yes
Circularity Check
No significant circularity in derivation chain
full rationale
The paper presents a family of multilingual translation models (1.8B, 7B, 30B-A3B MoE) with quantization details and reports performance on general, business, domain-specific, and instruction-following tasks. No equations, self-definitional quantities, or fitted parameters renamed as predictions appear. Claims rest on external benchmark evaluations rather than quantities defined in terms of the paper's own inputs. No self-citation chains, uniqueness theorems, or ansatzes are invoked to force results. The derivation chain is self-contained and empirical.
Axiom & Free-Parameter Ledger
Reference graph
Works this paper leans on
-
[1]
Bitdistiller: Unleashing the potential of sub-4-bit llms via self-distillation , author=. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=
- [2]
-
[3]
On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes , author=. 2024 , eprint=
work page 2024
-
[4]
Advances in Neural Information Processing Systems , volume=
ParetoQ: Improving scaling laws in extremely low-bit LLM quantization , author=. Advances in Neural Information Processing Systems , volume=
-
[5]
MiniLLM: Knowledge Distillation of Large Language Models , author=. 2025 , eprint=
work page 2025
-
[6]
Thinking Machines Lab: Connectionism , year =
Kevin Lu and Thinking Machines Lab , title =. Thinking Machines Lab: Connectionism , year =
-
[7]
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers , author=. 2023 , eprint=
work page 2023
- [8]
- [9]
- [10]
- [11]
-
[12]
DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models , author=. 2025 , eprint=
work page 2025
-
[13]
Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAs , author=. 2025 , eprint=
work page 2025
- [14]
-
[15]
Tower+: Bridging Generality and Translation Specialization in Multilingual LLMs , author=. 2025 , eprint=
work page 2025
-
[16]
Seed-X: Building Strong Multilingual Translation LLM with 7B Parameters , author=. 2025 , eprint=
work page 2025
-
[17]
Multilingual Machine Translation with Open Large Language Models at Practical Scale: An Empirical Study , author=. 2025 , eprint=
work page 2025
- [18]
- [19]
-
[21]
Brown and John Cocke and Stephen Della Pietra and Vincent J
Peter F. Brown and John Cocke and Stephen Della Pietra and Vincent J. Della Pietra and Frederick Jelinek and John D. Lafferty and Robert L. Mercer and Paul S. Roossin , title =. Comput. Linguistics , volume =. 1990 , timestamp =
work page 1990
-
[22]
Brown and Stephen Della Pietra and Vincent J
Peter F. Brown and Stephen Della Pietra and Vincent J. Della Pietra and Robert L. Mercer , title =. Comput. Linguistics , volume =. 1993 , timestamp =
work page 1993
-
[23]
Bleu: A method for automatic evaluation of machine translation
Kishore Papineni and Salim Roukos and Todd Ward and Wei. Bleu: a Method for Automatic Evaluation of Machine Translation , booktitle =. 2002 , url =. doi:10.3115/1073083.1073135 , timestamp =
-
[24]
Ilya Sutskever and Oriol Vinyals and Quoc V. Le , editor =. Sequence to Sequence Learning with Neural Networks , booktitle =. 2014 , url =
work page 2014
-
[25]
Neural Machine Translation by Jointly Learning to Align and Translate , booktitle =
Dzmitry Bahdanau and Kyunghyun Cho and Yoshua Bengio , editor =. Neural Machine Translation by Jointly Learning to Align and Translate , booktitle =. 2015 , url =
work page 2015
-
[26]
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation
Google's neural machine translation system: Bridging the gap between human and machine translation , author=. arXiv preprint arXiv:1609.08144 , year=
work page internal anchor Pith review Pith/arXiv arXiv
-
[27]
Advances in neural information processing systems , volume=
Attention is all you need , author=. Advances in neural information processing systems , volume=
-
[28]
Wenhao Zhu and Hongyi Liu and Qingxiu Dong and Jingjing Xu and Shujian Huang and Lingpeng Kong and Jiajun Chen and Lei Li , editor =. Multilingual Machine Translation with Large Language Models: Empirical Results and Analysis , booktitle =. 2024 , url =. doi:10.18653/V1/2024.FINDINGS-NAACL.176 , timestamp =
-
[29]
Tom Kocmi and Eleftherios Avramidis and Rachel Bawden and Ondrej Bojar and Anton Dvorkovich and Christian Federmann and Mark Fishel and Markus Freitag and Thamme Gowda and Roman Grundkiewicz and Barry Haddow and Marzena Karpinska and Philipp Koehn and Benjamin Marie and Christof Monz and Kenton Murray and Masaaki Nagata and Martin Popel and Maja Popovic a...
-
[30]
Jianhui Pang and Fanghua Ye and Derek Fai Wong and Dian Yu and Shuming Shi and Zhaopeng Tu and Longyue Wang , title =. Trans. Assoc. Comput. Linguistics , volume =. 2025 , url =. doi:10.1162/TACL\_A\_00730 , timestamp =
work page internal anchor Pith review doi:10.1162/tacl 2025
-
[31]
https://arxiv.org/ abs/2301.08745
Wenxiang Jiao and Wenxuan Wang and Jen. Is ChatGPT. CoRR , volume =. 2023 , url =. doi:10.48550/ARXIV.2301.08745 , eprinttype =. 2301.08745 , timestamp =
-
[32]
Multicultural Education Review , volume =
Cong Lin and Liz Jackson , title =. Multicultural Education Review , volume =. 2021 , publisher =
work page 2021
-
[33]
Tencent Minority-Mandarin Translation System , booktitle =
Hu, Bojie and Han, Ambyer and Zhang, Zheyang and Huang, Shen and Ju, Qi , editor =. Tencent Minority-Mandarin Translation System , booktitle =. 2019 , pages =
work page 2019
-
[34]
DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning , author=. 2025 , eprint=
work page 2025
-
[35]
FastCuRL: Curriculum Reinforcement Learning with Stage-wise Context Scaling for Efficient Training R1-like Reasoning Models , author=. 2025 , eprint=
work page 2025
-
[36]
DeepCoder: A Fully Open-Source 14B Coder at O3-mini Level , author=
- [37]
-
[38]
MT-R1-Zero: Advancing LLM-based Machine Translation via R1-Zero-like Reinforcement Learning , author=. 2025 , eprint=
work page 2025
-
[39]
SSR-Zero: Simple Self-Rewarding Reinforcement Learning for Machine Translation , author=. 2025 , eprint=
work page 2025
-
[40]
TAT-R1: Terminology-Aware Translation with Reinforcement Learning and Word Alignment , author=. 2025 , eprint=
work page 2025
-
[41]
Yubo Wang and Xueguang Ma and Ge Zhang and Yuansheng Ni and Abhranil Chandra and Shiguang Guo and Weiming Ren and Aaran Arulraj and Xuan He and Ziyan Jiang and Tianle Li and Max Ku and Kai Wang and Alex Zhuang and Rongqi Fan and Xiang Yue and Wenhu Chen , editor =. MMLU-Pro:. Advances in Neural Information Processing Systems 38: Annual Conference on Neura...
work page 2024
-
[42]
SuperGPQA: Scaling LLM Evaluation across 285 Graduate Disciplines
M. SuperGPQA: Scaling. CoRR , volume =. 2025 , url =. doi:10.48550/ARXIV.2502.14739 , eprinttype =. 2502.14739 , timestamp =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2502.14739 2025
-
[43]
The Eleventh International Conference on Learning Representations,
Freda Shi and Mirac Suzgun and Markus Freitag and Xuezhi Wang and Suraj Srivats and Soroush Vosoughi and Hyung Won Chung and Yi Tay and Sebastian Ruder and Denny Zhou and Dipanjan Das and Jason Wei , title =. The Eleventh International Conference on Learning Representations,. 2023 , url =
work page 2023
-
[44]
GPQA: A Graduate-Level Google-Proof Q&A Benchmark
David Rein and Betty Li Hou and Asa Cooper Stickland and Jackson Petty and Richard Yuanzhe Pang and Julien Dirani and Julian Michael and Samuel R. Bowman , title =. CoRR , volume =. 2023 , url =. doi:10.48550/ARXIV.2311.12022 , eprinttype =. 2311.12022 , timestamp =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2311.12022 2023
-
[45]
Training Verifiers to Solve Math Word Problems
Karl Cobbe and Vineet Kosaraju and Mohammad Bavarian and Mark Chen and Heewoo Jun and Lukasz Kaiser and Matthias Plappert and Jerry Tworek and Jacob Hilton and Reiichiro Nakano and Christopher Hesse and John Schulman , title =. CoRR , volume =. 2021 , url =. 2110.14168 , timestamp =
work page internal anchor Pith review Pith/arXiv arXiv 2021
-
[46]
9th International Conference on Learning Representations,
Dan Hendrycks and Collin Burns and Steven Basart and Andy Zou and Mantas Mazeika and Dawn Song and Jacob Steinhardt , title =. 9th International Conference on Learning Representations,. 2021 , url =
work page 2021
-
[47]
Federico Cassano and John Gouwar and Daniel Nguyen and Sydney Nguyen and Luna Phipps. MultiPL-E:. 2023 , url =. doi:10.1109/TSE.2023.3267446 , timestamp =
- [48]
-
[49]
Angelika Romanou and Negar Foroutan and Anna Sotnikova and Zeming Chen and Sree Harsha Nelaturu and Shivalika Singh and Rishabh Maheshwary and Micol Altomare and Mohamed A. Haggag and Imanol Schlag and Marzieh Fadaee and Sara Hooker and Antoine Bosselut and Snegha A and Alfonso Amayuelas and Azril Hafizi Amirudin and Viraat Aryabumi and Danylo Boiko and M...
work page 2025
-
[50]
No Language Left Behind: Scaling Human-Centered Machine Translation , author=. 2022 , eprint=
work page 2022
-
[51]
Daniel Deutsch and Eleftheria Briakou and Isaac Caswell and Mara Finkelstein and Rebecca Galor and Juraj Juraska and Geza Kovacs and Alison Lui and Ricardo Rei and Jason Riesa and Shruti Rijhwani and Parker Riley and Elizabeth Salesky and Firas Trabelsi and Stephanie Winkler and Biao Zhang and Markus Freitag , year=. 2502.12404 , archivePrefix=
-
[52]
xCOMET: Transparent Machine Translation Evaluation through Fine-grained Error Detection , author=. 2023 , eprint=
work page 2023
-
[53]
Large Language Models Are State-of-the-Art Evaluators of Translation Quality
Kocmi, Tom and Federmann, Christian. Large Language Models Are State-of-the-Art Evaluators of Translation Quality. Proceedings of the 24th Annual Conference of the European Association for Machine Translation. 2023
work page 2023
-
[54]
CometKiwi: IST-Unbabel 2022 Submission for the Quality Estimation Shared Task , author=. 2022 , eprint=
work page 2022
-
[55]
Rishabh Agarwal and Avi Singh and Lei Zhang and Bernd Bohnet and Luis Rosias and Stephanie C. Y. Chan and Biao Zhang and Ankesh Anand and Zaheer Abbas and Azade Nova and John D. Co. Many-Shot In-Context Learning , booktitle =. 2024 , url =
work page 2024
-
[56]
Can Many-Shot In-Context Learning Help LLMs as Evaluators?
Mingyang Song and Mao Zheng and Xuan Luo , editor =. Can Many-Shot In-Context Learning Help LLMs as Evaluators?. Proceedings of the 31st International Conference on Computational Linguistics,. 2025 , url =
work page 2025
-
[57]
Niklas Muennighoff and Zitong Yang and Weijia Shi and Xiang Lisa Li and Li Fei. s1: Simple test-time scaling , journal =. 2025 , url =. doi:10.48550/ARXIV.2501.19393 , eprinttype =. 2501.19393 , timestamp =
work page internal anchor Pith review Pith/arXiv arXiv doi:10.48550/arxiv.2501.19393 2025
-
[58]
A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well? , author=. 2025 , eprint=
work page 2025
-
[59]
Chain-of-Thought Prompting Elicits Reasoning in Large Language Models , author=. 2023 , eprint=
work page 2023
-
[61]
Colin Raffel and Noam Shazeer and Adam Roberts and Katherine Lee and Sharan Narang and Michael Matena and Yanqi Zhou and Wei Li and Peter J. Liu , title =. arXiv e-prints , year =
-
[62]
A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages
Ortiz Su 'a rez, Pedro Javier and Romary, Laurent and Sagot, Benoit. A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020
work page 2020
-
[63]
Pedro Javier. Asynchronous pipelines for processing huge corpora on medium to low resource infrastructures , series =. doi:10.14618/ids-pub-9021 , url =
- [64]
-
[65]
Proceedings of the First Conference on Machine Translation , month =
Buck, Christian and Koehn, Philipp , title =. Proceedings of the First Conference on Machine Translation , month =. 2016 , address =
work page 2016
-
[66]
RegMix: Data Mixture as Regression for Language Model Pre-training , author=. 2025 , eprint=
work page 2025
-
[68]
In: Haddow, B., Kocmi, T., Koehn, P., Monz, C
Lavie, Alon and Hanneman, Greg and Agrawal, Sweta and Kanojia, Diptesh and Lo, Chi-Kiu and Zouhar, Vil \'e m and Blain, Frederic and Zerva, Chrysoula and Avramidis, Eleftherios and Deoghare, Sourabh and Sindhujan, Archchana and Wang, Jiayi and Adelani, David Ifeoluwa and Thompson, Brian and Kocmi, Tom and Freitag, Markus and Deutsch, Daniel. Findings of t...
-
[69]
A Survey on Quantization Methods for Optimization of Deep Neural Networks , year=
Kulkarni, Uday and Hosamani, Abhishek S and Masur, Abhishek S and Hegde, Shashank and Vernekar, Ganesh R and Siri Chandana, K , booktitle=. A Survey on Quantization Methods for Optimization of Deep Neural Networks , year=
-
[71]
Using a new analytic measure for the annotation and analysis of MT errors on real data
Lommel, Arle and Burchardt, Aljoscha and Popovi \'c , Maja and Harris, Kim and Avramidis, Eleftherios and Uszkoreit, Hans. Using a new analytic measure for the annotation and analysis of MT errors on real data. Proceedings of the 17th Annual Conference of the European Association for Machine Translation. 2014
work page 2014
-
[72]
Freitag, Markus and Rei, Ricardo and Mathur, Nitika and Lo, Chi-kiu and Stewart, Craig and Foster, George and Lavie, Alon and Bojar, Ond r ej. Results of the WMT 21 Metrics Shared Task: Evaluating Metrics with Expert-based Human Evaluations on TED and News Domain. Proceedings of the Sixth Conference on Machine Translation. 2021
work page 2021
- [73]
-
[74]
Generalizing Verifiable Instruction Following , author=. 2025 , journal=
work page 2025
-
[76]
M a XIFE : Multilingual and Cross-lingual Instruction Following Evaluation
Liu, Yile and Ma, Ziwei and Jiang, Xiu and Hu, Jinglu and ChangJing, ChangJing and Li, Liang. M a XIFE : Multilingual and Cross-lingual Instruction Following Evaluation. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2025
work page 2025
- [78]
-
[79]
DeepMind. Introducing gemini 3. https://blog.google/products/gemini/gemini-3-collection/, 2025. Accessed: 2025-12-29
work page 2025
-
[80]
Bitdistiller: Unleashing the potential of sub-4-bit llms via self-distillation
Dayou Du, Yijia Zhang, Shijie Cao, Jiaqi Guo, Ting Cao, Xiaowen Chu, and Ningyi Xu. Bitdistiller: Unleashing the potential of sub-4-bit llms via self-distillation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp.\ 102--116, 2024
work page 2024
-
[81]
Markus Freitag, Ricardo Rei, Nitika Mathur, Chi-kiu Lo, Craig Stewart, George Foster, Alon Lavie, and Ond r ej Bojar. Results of the WMT 21 metrics shared task: Evaluating metrics with expert-based human evaluations on TED and news domain. In Loic Barrault, Ondrej Bojar, Fethi Bougares, Rajen Chatterjee, Marta R. Costa-jussa, Christian Federmann, Mark Fis...
work page 2021
-
[82]
Multi-if: Benchmarking llms on multi-turn and multilingual instructions following
Yun He, Di Jin, Chaoqi Wang, Chloe Bi, Karishma Mandyam, Hejia Zhang, Chen Zhu, Ning Li, Tengyu Xu, Hongjiang Lv, et al. Multi-if: Benchmarking llms on multi-turn and multilingual instructions following. arXiv preprint arXiv:2410.15553, 2024
-
[83]
Sherry: Hardware-efficient 1.25-bit ternary quantization via fine-grained sparsification
Hong Huang, Decheng Wu, Qiangqiang Hu, Guanghua Yu, Jinhai Yang, Jianchen Zhu, Xue Liu, and Dapeng Wu. Sherry: Hardware-efficient 1.25-bit ternary quantization via fine-grained sparsification. arXiv preprint arXiv:2601.07892, 2026
-
[84]
Tom Kocmi, Ekaterina Artemova, Eleftherios Avramidis, Rachel Bawden, Ond r ej Bojar, Konstantin Dranch, Anton Dvorkovich, Sergey Dukanov, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, Barry Haddow, Marzena Karpinska, Philipp Koehn, Howard Lakougna, Jessica Lundin, Christof Monz, Kenton Murray, Masaaki Nagata, Stefano Perrella, Lorenzo Pro...
-
[85]
M a XIFE : Multilingual and cross-lingual instruction following evaluation
Yile Liu, Ziwei Ma, Xiu Jiang, Jinglu Hu, ChangJing ChangJing, and Liang Li. M a XIFE : Multilingual and cross-lingual instruction following evaluation. In Wanxiang Che, Joyce Nabende, Ekaterina Shutova, and Mohammad Taher Pilehvar (eds.), Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp.\...
work page 2025
-
[86]
Paretoq: Improving scaling laws in extremely low-bit llm quantization
Zechun Liu, Changsheng Zhao, Hanxian Huang, Sijia Chen, Jing Zhang, Jiawei Zhao, Scott Roy, Lisa Jin, Yunyang Xiong, Yangyang Shi, et al. Paretoq: Improving scaling laws in extremely low-bit llm quantization. Advances in Neural Information Processing Systems, 38: 0 91311--91336, 2026
work page 2026
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.