BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniques

Md. Mohibur Rahman Nabil; Mohammad Ashrafuzzaman Khan; Muhammad Rafsan Kabir

REVIEW 3 major objections 6 minor 23 references

BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniques

T0 review · 3 major / 6 minor · reviewed 2026-08-12 · deepseek-v4-flash

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read The paper claims that a compact Bangla sentence encoder trained by distilling an English teacher through parallel translations beats existing Bangla sentence transformers on paraphrase detection and semantic similarity.

desk verdict A straightforward KD application to Bangla with plausible numbers, but the missing tokenizer/initialization details make the central result unverifiable as written. read the letter →

arxiv 2411.15270 v1 pith:H56EMAUP submitted 2024-11-22 cs.CL cs.LG

Muhammad Rafsan Kabir , Md. Mohibur Rahman Nabil , Mohammad Ashrafuzzaman Khan This is my paper · ORCID

classification cs.CLcs.LG

keywords SentenceTransformerKnowledgeDistillationParaphraseDetectionSemanticTextualSimilarityBanglaCross-LingualLow-ResourceLanguageEmbeddings

verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper introduces two lightweight Bangla sentence-embedding models, BanglaEmbed-MSE and BanglaEmbed-MNR, and trains them by cross-lingual knowledge distillation from a pre-trained English sentence transformer using an English-Bangla translation dataset. Its central claim is that a 66-million-parameter student trained this way outperforms existing Bangla sentence transformers on paraphrase detection and semantic textual similarity while using far fewer parameters. The better variant, BanglaEmbed-MSE, reaches a mean cosine similarity of 0.91 and an accuracy of 0.92 on paraphrase detection, plus a Spearman correlation of 0.73 on STS, the highest scores among the models tested. If this holds, high-quality sentence embeddings for a low-resource language can be obtained from a parallel corpus rather than from a large monolingual corpus.

What carries the argument

The load-bearing mechanism is a teacher-student alignment loop built from three components: a frozen English sentence transformer (multi-qa-distilbert-cos-v1) that supplies target embeddings, a trainable student encoder based on the distilbert-base-uncased architecture with a mean-pooling layer, and a parallel English-Bangla corpus that pairs each English sentence with its translation. The student is pushed toward the teacher's embedding space by a loss, either mean squared error or multiple negatives ranking loss. This machinery transfers the teacher's English embedding geometry to Bangla, because a sentence and its translation are treated as the same point in the shared space.

What would settle it

Inspect the released student tokenizer on a set of ordinary Bangla sentences; if most words are mapped to the unknown token, the reported embeddings cannot have encoded the Bangla inputs and the whole evaluation would be invalid.

Watch

Extended reading notes

Core claim

On its own terms, the paper claims that English teacher embeddings can serve as direct supervision for a Bangla student: the teacher encodes English sentences, the student encodes their Bangla translations, and a loss aligns the student's pooled representation with the teacher's. The paper reports that the MSE-trained student, BanglaEmbed-MSE, produces the best measured embeddings, surpassing heavier Bangla transformers on paraphrase detection and STS and yielding cleaner separation in hate-speech t-SNE plots. That would establish a practical recipe for giving a low-resource language competitive sentence embeddings using machine-translation pairs instead of a large indigenous corpus.

Load-bearing premise

The student model must actually tokenize and represent Bangla text, but the paper never specifies its tokenizer or vocabulary, and the named architecture, distilbert-base-uncased, normally uses an English-only WordPiece vocabulary.

Editorial extensions

If this is right

A 66-million-parameter Bangla sentence encoder can outperform Bangla transformers with 238-278 million parameters on paraphrase detection and STS.
Training sentence embeddings for a low-resource language can be driven by a parallel translation dataset instead of a large monolingual corpus.
MSE alignment to the teacher's embeddings yields better downstream scores than multiple negatives ranking loss in this experimental setup.
The smaller model's shorter inference time makes it suitable for deployment on resource-constrained hardware.
These models provide a concrete baseline for future Bangla sentence-embedding research.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

My inference: the same distillation recipe should transfer to other low-resource languages that have access to a parallel corpus with a high-resource language, a setting the paper does not test.
My inference: because the STS benchmark is a translated version of an English dataset, a native Bangla STS benchmark might rank the models differently.
My inference: the t-SNE clustering evidence could be made quantitative with metrics such as silhouette score, which the paper does not report.
My inference: the unspecified tokenizer and vocabulary for the student model is the implementation detail most likely to undermine the pipeline, and it can be checked directly by inspecting the released tokenizer's coverage of Bangla characters.

Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Desk Editor's Note

read the letter

What you should know first: this is a direct application of Reimers and Gurevych's cross-lingual distillation to Bangla, with two 66M-parameter students trained on BanglaNMT. The authors cite the source method honestly, use public training data, and report inference times. On its face, BanglaEmbed-MSE beats the existing Bangla sentence transformers they compare against on paraphrase detection and STS. That is a useful practical result if it holds.

The real problem is the tokenizer. Section III-C says the student is "based on the distilbert-base-uncased architecture" and still has 66.4M parameters. DistilBERT's WordPiece vocabulary is English-only. The paper never says whether they trained a Bangla tokenizer, what the vocabulary size was, whether the embedding matrix was reinitialized, or how the student was initialized. If they simply loaded the English checkpoint and fed Bangla text through it, every Bangla sentence would be mostly [UNK] tokens, and the reported MCS of 0.91 and accuracy of 0.92 would not be reproducible. This is not a hyperparameter omission; it is the precondition for the entire evaluation. I read the stress-test note and it lands.

The other soft spots are more ordinary. No code or weights are released, so nothing is checkable. The STS benchmark is self-created by translating SemEval-2017 with GPT-4o and manual validation; that is defensible but should come with the translated dataset attached. The hate speech evaluation is purely qualitative t-SNE inspection, which supports nothing by itself. The cosine threshold of 0.8 for paraphrase classification is a free parameter, and there are no error bars or significance tests. The baseline set also misses obvious multilingual sentence encoders like mUSE or LaBSE.

What the paper does well is stay on task: the method section is readable, the equations are fine, and the comparison is cleaner than many low-resource NLP papers. The central claim is plausible. But as written, the missing tokenizer detail is severe enough that a careful reader cannot tell whether the training pipeline is even valid.

For peer review: yes, send it to referees rather than desk-rejecting, but the first referee request should be for full implementation details, tokenizer/vocabulary/initialization, and released code and weights. If the authors cannot supply a working tokenizer setup, the paper should not be accepted. I would not cite it in its current unreproducible form, but I would bring it to a reading group to discuss exactly where the line between "insufficiently detailed" and "internally invalid" sits.

Referee Report

3 major / 6 minor

Summary. The paper introduces BanglaEmbed-MSE and BanglaEmbed-MNR, two approximately 66M-parameter sentence transformers for Bangla, trained by distilling a pre-trained English sentence transformer (multi-qa-distilbert-cos-v1) on the English-Bangla BanglaNMT parallel corpus using MSE and multiple-negatives ranking losses. The authors report evaluations on Bangla paraphrase detection, a GPT-4o-translated SemEval STS benchmark, and qualitative t-SNE inspection of Bangla hate-speech embeddings. They claim that BanglaEmbed-MSE outperforms existing Bangla sentence transformers on paraphrase detection and STS while using fewer parameters and shorter inference time.

Significance. If substantiated, the work would offer a practical, lightweight recipe for low-resource sentence embeddings using only parallel data and a high-resource teacher, without requiring a large Bangla pretraining corpus. The evaluation targets useful downstream tasks and compares against multilingual baselines, and the reported held-out evaluations are not circular with respect to the training objective. However, the manuscript currently omits the tokenizer and initialization details that are prerequisites for the student model to process Bangla at all, and the new STS benchmark and all experimental artifacts are not released or accompanied by significance tests. These gaps make the central comparative claim unverifiable until addressed.

major comments (3)

[III-C] The student model is described only as "based on the distilbert-base-uncased architecture," but DistilBERT-base-uncased ships with an English WordPiece tokenizer and an English-only subword vocabulary. The manuscript never states how Bangla input sentences are tokenized, what vocabulary is used for the student, whether the token embedding matrix was reinitialized or extended, or whether training started from the English checkpoint. Without this information, it is not possible to determine whether Bangla text can pass through the model at all, and the reported BanglaEmbed-MSE results in Table II cannot be reproduced. The authors must specify the tokenizer, vocabulary size, and initialization scheme, and ideally release the model, before the central claim can be accepted.
[IV-A / Table II] The STS evaluation is performed on a benchmark created by the authors: SemEval STS pairs translated to Bangla with GPT-4o followed by "manual human validation." The manuscript reports no details of the validation procedure, inter-annotator agreement, the number of translated pairs actually used, or whether the translated benchmark is publicly available. In addition, Table II reports single-point performance with no variance across training runs or statistical significance tests; the main STS advantage of BanglaEmbed-MSE (ρ=0.73) over BengaliSBERT-STS (ρ=0.72) is small enough that it could easily arise from noise. The paraphrase accuracy threshold of 0.8 is also arbitrary. Please release the benchmark and add error bars or significance tests, or temper the comparative claims.
[IV-B / Fig. 4] The hate-speech evaluation is strictly qualitative: the authors state that they "conducted a qualitative evaluation" using t-SNE plots and conclude from visual separation that BanglaEmbed-MSE produces higher-quality embeddings. The abstract nevertheless lists hate speech detection as one of the evaluated downstream tasks. Visual cluster inspection is not a quantitative measure of hate-speech classification performance and does not support the stated superiority. The authors should either report quantitative classification metrics (e.g., macro-F1 on the Bengali Hate Speech Dataset) or revise the claims to match the qualitative nature of the evidence.

minor comments (6)

[Table II] The row label "Bangla Sentence Transformer 2" contains a stray superscript "2" that appears to point to a Hugging Face URL; please render the citation cleanly.
[III-B, Eq. (3)] Equation (3) uses E_S^+ and E_S^{-(n)} without clearly defining whether these are student or teacher embeddings; the notation should be made consistent with Equation (2) and the surrounding text should state which model produces each embedding.
[IV-A] Inference-time comparisons in Table II should state the hardware, batch size, sequence length, and number of runs used for all models; without these details the reported inference-time advantage is not interpretable.
[Fig. 4] The t-SNE panels are difficult to compare because the axes, color maps, and class legend are not described clearly; a quantitative cluster-quality metric or explicit axis labels would help the reader verify the claimed separation.
[I and II] The introduction calls the distillation approach "novel," but Section II already acknowledges that Reimers and Gurevych [10] use the same multilingual knowledge-distillation idea; please adjust the novelty claim or clearly differentiate the present contribution.
[Throughout] The paper uses both "Bengali" and "Bangla" to refer to the language; please choose one term for consistency.

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity: training and evaluation are external to each other; the tokenizer omission is a reproducibility concern, not a circular step.

full rationale

The proposed derivation is self-contained and its central claim is not equivalent to its inputs. The student models are trained by minimizing Eq. (1)-(3) on the external BanglaNMT parallel corpus, with teacher embeddings produced by multi-qa-distilbert-cos-v1 from English sentences and student embeddings produced from Bangla sentences; this defines the model parameters through the distillation objective. All reported evaluations use independent held-out resources: BanglaParaphrase test set (external), an STS benchmark obtained by translating SemEval-2017 Task 1 pairs with GPT-4o and human validation while preserving the original gold labels, and the Bengali Hate Speech Dataset. None of these evaluation labels or similarity scores are used in the training loss, and the paraphrase decision threshold (0.8) is a fixed evaluation rule, not a fitted parameter. The paper does not invoke a self-citation chain as load-bearing; the distillation methodology is attributed to external prior work (Reimers and Gurevych [10]). The reviewer-flagged omission of tokenizer details for the 'distilbert-base-uncased based' student is a reproducibility and validity risk, but it is not circular reasoning: the paper does not define the model or evaluation in terms of its own output. Similarly, the authors' decision to translate the STS benchmark is a data construction choice, not a reduction of predictions to inputs. Consequently, no step in the derivation chain reduces to its own inputs, and the circularity score is 0.

Assumptions & free parameters 1 free parameters · 5 assumptions · 0 invented entities

The central claim rests on standard distillation assumptions plus two ad hoc choices: the translated STS benchmark and the unstated Bangla tokenizer adaptation. The tokenizer issue is the most consequential because without it the training and evaluation pipeline cannot be realized as described.

free parameters (1)

cosine threshold for paraphrase classification = 0.8
Chosen by hand and applied uniformly to all models; it directly determines reported paraphrase accuracy, and no justification or tuning analysis is provided.

assumptions (5)

domain assumption The English teacher (multi-qa-distilbert-cos-v1) produces high-quality sentence embeddings.
The paper relies on the teacher's pre-trained quality without independent verification in this work, Section III-C.
domain assumption BanglaNMT provides accurate English-Bangla translation pairs.
Training data correctness is assumed from the dataset's provenance; preprocessing that reduced 2.75M to 2.66M pairs is not described, Section III-B.
domain assumption A sentence and its translation share the same semantic meaning, so aligning their embeddings is valid.
This is the core premise of cross-lingual distillation, stated in Section III-B and derived from Reimers and Gurevych [10].
ad hoc to paper The GPT-4o translated SemEval STS dataset is a valid Bangla STS benchmark.
The authors created this benchmark via machine translation and human validation, rather than using an existing Bangla STS dataset; Section IV-A.
ad hoc to paper A distilbert-base-uncased architecture can be adapted to process Bangla text.
The paper states the student is based on this English-only architecture but never explains how Bangla tokenization or vocabulary is handled, Section III-C.

how reviews work

0 comments

Cite this review

Pith. "Pith review of BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniques." pith.science (2026). https://pith.science/paper/H56EMAUP

@misc{pith2026241115270,
  author       = {Pith},
  title        = {Pith review of: BanglaEmbed: Efficient Sentence Embedding Models for a Low-Resource Language Using Cross-Lingual Distillation Techniques},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/H56EMAUP}},
  note         = {Machine review of arXiv:2411.15270}
}

read the original abstract

Sentence-level embedding is essential for various tasks that require understanding natural language. Many studies have explored such embeddings for high-resource languages like English. However, low-resource languages like Bengali (a language spoken by almost two hundred and thirty million people) are still under-explored. This work introduces two lightweight sentence transformers for the Bangla language, leveraging a novel cross-lingual knowledge distillation approach. This method distills knowledge from a pre-trained, high-performing English sentence transformer. Proposed models are evaluated across multiple downstream tasks, including paraphrase detection, semantic textual similarity (STS), and Bangla hate speech detection. The new method consistently outperformed existing Bangla sentence transformers. Moreover, the lightweight architecture and shorter inference time make the models highly suitable for deployment in resource-constrained environments, making them valuable for practical NLP applications in low-resource languages.

Figures

Figures reproduced from arXiv: 2411.15270 by the authors.

**Figure 2.** Sample EN-BN sentence pairs from the machine translation dataset. [PITH_FULL_IMAGE:figures/full_fig_p003_2.png] view at source ↗

**Figure 3.** Proposed cross-lingual knowledge distillation methodology for training the Bangla sentence transformer, leveraging an English-Bangla machine [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗

Figures from the paper (1 more)

**Figure 4.** Figure 4: t-SNE visualizations of four distinct sentence transformers. The [PITH_FULL_IMAGE:figures/full_fig_p005_4.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

23 extracted references · 15 canonical work pages

[1]

Natural language processing: state of the art, current trends and challenges,

D. Khurana, A. Koli, K. Khatter, and S. Singh, “Natural language processing: state of the art, current trends and challenges,” Multimedia tools and applications , vol. 82, no. 3, pp. 3713–3744, 2023

work page 2023
[2]

Sentence-BERT: Sentence embeddings using Siamese BERT-networks,

N. Reimers and I. Gurevych, “Sentence-BERT: Sentence embeddings using Siamese BERT-networks,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V . Ng, and X. Wan, Eds. Hong Kong, China: Association for Compu...

2019
[3]

Practical natural language processing for low-resource languages

B. P. King, “Practical natural language processing for low-resource languages.” Ph.D. dissertation, 2015

work page 2015
[4]

Progress in machine translation,

H. Wang, H. Wu, Z. He, L. Huang, and K. W. Church, “Progress in machine translation,” Engineering, vol. 18, pp. 143–153, 2022

work page 2022
[5]

Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali- English machine translation,

T. Hasan, A. Bhattacharjee, K. Samin, M. Hasan, M. Basak, M. S. Rahman, and R. Shahriyar, “Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali- English machine translation,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , B. Webber, T. Cohn, Y . He, and Y . Liu, Ed...

work page 2020
[6]

Efficient natural language response suggestion for smart reply,

M. Henderson, R. Al-Rfou, B. Strope, Y .-H. Sung, L. Luk ´acs, R. Guo, S. Kumar, B. Miklos, and R. Kurzweil, “Efficient natural language response suggestion for smart reply,” arXiv preprint arXiv:1705.00652 , 2017

arXiv 2017
[7]

Distilling the knowledge in a neural network,

G. Hinton, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015

arXiv 2015
[8]

Supervised learning of universal sentence representations from natural language inference data,

A. Conneau, D. Kiela, H. Schwenk, L. Barrault, and A. Bordes, “Supervised learning of universal sentence representations from natural language inference data,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , M. Palmer, R. Hwa, and S. Riedel, Eds. Copenhagen, Denmark: Association for Computational Linguistics, Se...

work page 2017

Show all 23 references

[9]

Universal sentence encoder for english,

D. Cer, Y . Yang, S.-y. Kong, N. Hua, N. Limtiaco, R. S. John, N. Con- stant, M. Guajardo-Cespedes, S. Yuan, C. Tar et al., “Universal sentence encoder for english,” in Proceedings of the 2018 conference on empirical methods in natural language processing: system demonstration...

2018
[10]

Making monolingual sentence embeddings multilingual using knowledge distillation,

N. Reimers and I. Gurevych, “Making monolingual sentence embeddings multilingual using knowledge distillation,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , B. Webber, T. Cohn, Y . He, and Y . Liu, Eds. Online: Association...

2020
[11]

Text classification using multilingual sentence embeddings,

A. Saraswat, K. Abhishek, and S. Kumar, “Text classification using multilingual sentence embeddings,” in Evolution in Computational In- telligence: Frontiers in Intelligent Computing: Theory and Applications (FICTA 2020), Volume 1 . Springer, 2021, pp. 527–536

2020
[12]

Learning cross-lingual sentence representations via a multi-task dual-encoder model,

M. Chidambaram, Y . Yang, D. Cer, S. Yuan, Y .-H. Sung, B. Strope, and R. Kurzweil, “Learning cross-lingual sentence representations via a multi-task dual-encoder model,” arXiv preprint arXiv:1810.12836, 2018

2018 arXiv
[13]

A large annotated corpus for learning natural language inference,

S. R. Bowman, G. Angeli, C. Potts, and C. D. Manning, “A large annotated corpus for learning natural language inference,” in Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, L. M `arquez, C. Callison-Burch, and J. Su, Eds. Lisbon, Portuga...

2015
[14]

SimCSE: Simple contrastive learning of sentence embeddings,

T. Gao, X. Yao, and D. Chen, “SimCSE: Simple contrastive learning of sentence embeddings,” in Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , M.-F. Moens, X. Huang, L. Specia, and S. W.-t. Yih, Eds. Online and Punta Cana, Dominican Repu...

2021
[15]

Simtde: Simple transformer distillation for sentence embeddings,

J. Xie, C. He, J. Wang, C. Qiu, A. Ke- barighotbi, and F. Ghassemi, “Simtde: Simple transformer distillation for sentence embeddings,” in SIGIR 2023 ,

2023
[16]

Distilbert, a dis- tilled version of bert: smaller, faster, cheaper and lighter,

V . Sanh, L. Debut, J. Chaumond, and T. Wolf, “Distilbert, a dis- tilled version of bert: smaller, faster, cheaper and lighter,” ArXiv, vol. abs/1910.01108, 2019

1910 arXiv
[17]

BERT: Pre- training of deep bidirectional transformers for language understanding,

J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre- training of deep bidirectional transformers for language understanding,” in Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technolog...

2019
[18]

BanglaParaphrase: A high-quality Bangla paraphrase dataset,

A. Akil, N. Sultana, A. Bhattacharjee, and R. Shahriyar, “BanglaParaphrase: A high-quality Bangla paraphrase dataset,” in Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference ...

2022
[19]

SemEval- 2017 task 1: Semantic textual similarity multilingual and crosslingual focused evaluation,

D. Cer, M. Diab, E. Agirre, I. Lopez-Gazpio, and L. Specia, “SemEval- 2017 task 1: Semantic textual similarity multilingual and crosslingual focused evaluation,” in Proceedings of the 11th International Workshop on Semantic Evaluation (SemEval-2017) , S. Bethard, M. Carpuat, M...

2017
[20]

Classification benchmarks for under-resourced bengali language based on multichannel convolutional-lstm network,

M. R. Karim, B. R. Chakravarti, J. P. McCrae, and M. Cochez, “Classification benchmarks for under-resourced bengali language based on multichannel convolutional-lstm network,” in 7th IEEE Interna- tional Conference on Data Science and Advanced Analytics (IEEE DSAA,2020). IEEE, 2020

2020
[21]

Visualizing data using t-sne

L. Van der Maaten and G. Hinton, “Visualizing data using t-sne.” Journal of machine learning research , vol. 9, no. 11, 2008

2008
[22]

L3cube- indicsbert: A simple approach for learning cross-lingual sentence rep- resentations using multilingual bert,

S. Deode, J. Gadre, A. Kajale, A. Joshi, and R. Joshi, “L3cube- indicsbert: A simple approach for learning cross-lingual sentence rep- resentations using multilingual bert,” arXiv preprint arXiv:2304.11434 , 2023

2023 arXiv
[2023]

Available: https://www.amazon.science/publications/ simtde-simple-transformer-distillation-for-sentence-embeddings

[Online]. Available: https://www.amazon.science/publications/ simtde-simple-transformer-distillation-for-sentence-embeddings

Pith tools

Reviewed August 12, 2026 · model on record in the stance chip above.

[1] [1]

Natural language processing: state of the art, current trends and challenges,

D. Khurana, A. Koli, K. Khatter, and S. Singh, “Natural language processing: state of the art, current trends and challenges,” Multimedia tools and applications , vol. 82, no. 3, pp. 3713–3744, 2023

work page 2023

[2] [2]

Sentence-BERT: Sentence embeddings using Siamese BERT-networks,

N. Reimers and I. Gurevych, “Sentence-BERT: Sentence embeddings using Siamese BERT-networks,” in Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), K. Inui, J. Jiang, V . Ng, and X. Wan, Eds. Hong Kong, China: Association for Compu...

2019

[3] [3]

Practical natural language processing for low-resource languages

B. P. King, “Practical natural language processing for low-resource languages.” Ph.D. dissertation, 2015

work page 2015

[4] [4]

Progress in machine translation,

H. Wang, H. Wu, Z. He, L. Huang, and K. W. Church, “Progress in machine translation,” Engineering, vol. 18, pp. 143–153, 2022

work page 2022

[5] [5]

Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali- English machine translation,

T. Hasan, A. Bhattacharjee, K. Samin, M. Hasan, M. Basak, M. S. Rahman, and R. Shahriyar, “Not low-resource anymore: Aligner ensembling, batch filtering, and new datasets for Bengali- English machine translation,” in Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , B. Webber, T. Cohn, Y . He, and Y . Liu, Ed...

work page 2020

[6] [6]

Efficient natural language response suggestion for smart reply,

M. Henderson, R. Al-Rfou, B. Strope, Y .-H. Sung, L. Luk ´acs, R. Guo, S. Kumar, B. Miklos, and R. Kurzweil, “Efficient natural language response suggestion for smart reply,” arXiv preprint arXiv:1705.00652 , 2017

arXiv 2017

[7] [7]

Distilling the knowledge in a neural network,

G. Hinton, “Distilling the knowledge in a neural network,” arXiv preprint arXiv:1503.02531, 2015

arXiv 2015

[8] [8]

Supervised learning of universal sentence representations from natural language inference data,

A. Conneau, D. Kiela, H. Schwenk, L. Barrault, and A. Bordes, “Supervised learning of universal sentence representations from natural language inference data,” in Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing , M. Palmer, R. Hwa, and S. Riedel, Eds. Copenhagen, Denmark: Association for Computational Linguistics, Se...

work page 2017