Pith. sign in

REVIEW 2 major objections 1 minor 262 references

CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts

T0 review · 2 major / 1 minor · reviewed 2026-06-28 · grok-4.3

Challenge this review Re-run · record.json Download PDF Read on arXiv ↗ Review JSON

Pith's one-line read CRAFT searches the full Pareto front of prompt accuracy and token cost instead of fixing a weighted trade-off before search.

desk verdict CRAFT sketches a Pareto-front prompt optimizer using dual generators and gap-based acquisition, but the abstract supplies no numbers or baseline details to check whether it actually works. read the letter →

arxiv 2606.04661 v1 pith:4JRBICN5 submitted 2026-06-03 cs.CL cs.LG

Shanu Kumar , Shubhanshu Khandelwal , Akhila Yesantarao Venkata , Parag Agrawal , Yova Kementchedjhieva , Manish Gupta This is my paper · ORCID
classification cs.CLcs.LG
keywords promptoptimizationParetofrontaccuracy-costtrade-offscalarizationcollapseNSGA-IItuningLLMinferencecostmulti-objectivesearch
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

The paper shows that accuracy-tuned prompts tend to lengthen and raise inference cost on every call, so the right balance depends on the specific task and available budget. Standard practice collapses accuracy and cost into one weighted score before optimization begins, which the authors call scalarization collapse because it recovers only a narrow slice of possible trade-offs. CRAFT instead maintains a population of prompts and allocates the limited target-model validation calls to edits near the current optimistic front. It does this by running two complementary generators each round—one accuracy-focused, one cost-focused—then using Pareto-gap acquisition to choose which candidates to evaluate and NSGA-II to keep the population spread out. On six classification and reasoning benchmarks the retained fronts cover both high-accuracy and low-cost regions while accuracy-only, cost-only, and weighted-sum baselines stay confined to narrower bands.

What carries the argument

Pareto-gap acquisition that directs scarce validation budget toward candidates near the optimistic candidate front, supported by complementary accuracy-oriented and cost-oriented prompt-edit generators and NSGA-II population retention.

What would settle it

On any of the six benchmarks, run CRAFT and a fixed-weight baseline with identical validation-call budgets and check whether the baseline ever produces a prompt whose accuracy-cost pair lies outside the final CRAFT front.

Watch

Extended reading notes

Core claim

CRAFT treats validation calls to the target LLM as the scarce resource and allocates them to candidates near the optimistic candidate front; complementary accuracy-oriented and cost-oriented generators propose edits each round, Pareto-gap acquisition spends the per-round validation budget, and NSGA-II retention preserves a spread-out population. The resulting fronts reach both high-accuracy and low-cost regions on six benchmarks, whereas accuracy-only, cost-only, and weighted-sum baselines concentrate in narrower regions, turning the accuracy-cost trade-off into a post-search choice rather than a pre-search weight.

Load-bearing premise

The two complementary generators will reliably propose edits that lie close enough to the true optimistic front for Pareto-gap acquisition to cover the relevant regions without large gaps.

Editorial extensions

If this is right

  • The accuracy-cost trade-off can be chosen after the search finishes rather than before it starts.
  • Accuracy-only, cost-only, and weighted-sum baselines each recover only narrow segments of the front.
  • The validation budget is spent on candidates near the current optimistic front instead of being spread uniformly or committed to a single weight.
  • NSGA-II retention maintains population diversity across the front throughout the search.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • Production systems could inspect the retained front and pick shorter prompts when a modest accuracy drop is acceptable for the deployment budget.
  • The same generator-plus-acquisition pattern could be applied to other multi-objective prompt problems such as balancing accuracy against latency or against safety metrics.
  • The method makes it feasible to compare prompt fronts across different target models without re-committing to a fixed weight for each model.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, simulated authors' rebuttal, and a circularity audit.

Referee Report

2 major / 1 minor

Summary. The paper introduces CRAFT, a multi-objective prompt optimizer that searches the Pareto front of accuracy versus prompt-token cost. It employs complementary accuracy-oriented and cost-oriented generators to propose edits, Pareto-gap acquisition to allocate scarce target-LLM validation calls, and NSGA-II to retain a spread-out population. The central empirical claim is that, across six classification and reasoning benchmarks, the retained fronts cover both high-accuracy and low-cost regions while accuracy-only, cost-only, and weighted-sum baselines each collapse to narrower sub-fronts, thereby converting the accuracy-cost trade-off into a post-search selection rather than a pre-search scalarization weight.

Significance. If the empirical coverage claims hold and the generator assumption is validated, the work would offer a practical advance for prompt engineering in cost-sensitive settings by avoiding scalarization collapse and enabling budget-dependent prompt selection after optimization. No machine-checked proofs, reproducible code artifacts, or parameter-free derivations are described.

major comments (2)
  1. [Method (generators and acquisition)] The strongest claim—that CRAFT fronts reach both high-accuracy and low-cost regions while baselines concentrate narrowly—rests on the unverified assumption that the accuracy-oriented and cost-oriented generators reliably produce edits near the optimistic candidate front so that Pareto-gap acquisition can allocate the validation budget without large gaps. No empirical check on generator coverage, edit quality, or frequency with which proposed candidates lie on or near the true front is supplied.
  2. [Abstract and Experiments] Abstract and Experiments: the assertion of superior front coverage on six benchmarks is stated without quantitative metrics (e.g., hypervolume, coverage ratios), statistical tests, or a description of how the accuracy-only, cost-only, and weighted-sum baselines were implemented and tuned, so the data-to-claim link cannot be evaluated.
minor comments (1)
  1. [Method] Notation for the optimistic candidate front and Pareto-gap acquisition should be defined with explicit equations or pseudocode in the method section for reproducibility.

Simulated Author's Rebuttal

2 responses · 0 unresolved

We thank the referee for the constructive feedback. We address the two major comments point-by-point below and will revise the manuscript to incorporate additional empirical checks and quantitative metrics.

read point-by-point responses

  1. Referee: [Method (generators and acquisition)] The strongest claim—that CRAFT fronts reach both high-accuracy and low-cost regions while baselines concentrate narrowly—rests on the unverified assumption that the accuracy-oriented and cost-oriented generators reliably produce edits near the optimistic candidate front so that Pareto-gap acquisition can allocate the validation budget without large gaps. No empirical check on generator coverage, edit quality, or frequency with which proposed candidates lie on or near the true front is supplied.

    Authors: We agree that the manuscript does not contain a direct empirical verification of generator coverage or the frequency with which proposed candidates lie near the true front. The design rationale for the complementary generators is presented in Section 3, and the broader fronts observed in the experiments provide indirect support for their utility. To address the concern, the revision will include a new analysis quantifying the proportion of generated candidates that improve or lie close to the current Pareto front across rounds. revision: yes

  2. Referee: [Abstract and Experiments] Abstract and Experiments: the assertion of superior front coverage on six benchmarks is stated without quantitative metrics (e.g., hypervolume, coverage ratios), statistical tests, or a description of how the accuracy-only, cost-only, and weighted-sum baselines were implemented and tuned, so the data-to-claim link cannot be evaluated.

    Authors: The current version relies on visual comparison of retained fronts in the figures. We will add hypervolume values, coverage ratios, and appropriate statistical tests in the revised Experiments section. We will also expand the baseline descriptions to detail the exact implementation and tuning procedure for the accuracy-only, cost-only, and weighted-sum variants. revision: yes

Circularity Check

0 steps flagged · score 0.0 of 10

No circularity; algorithmic procedure with independent empirical claims

full rationale

The paper presents CRAFT as an algorithmic procedure (accuracy/cost generators + Pareto-gap acquisition + NSGA-II retention) evaluated on six benchmarks. No equations, fitted parameters, or self-citations appear in the provided text that would reduce any claimed result to its own inputs by construction. The central claim concerns empirical coverage of the accuracy-cost front and is not a derivation that collapses to a definition or fit. This matches the default expectation of no significant circularity for a non-mathematical algorithmic contribution.

Assumptions & free parameters 0 free parameters · 0 assumptions · 0 invented entities

Abstract-only review supplies no concrete free parameters, axioms, or invented entities; the method description implies standard multi-objective components but does not enumerate any.

how reviews work

0 comments
Cite this review

Pith. "Pith review of CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts." pith.science (2026). https://pith.science/paper/4JRBICN5

@misc{pith2026260604661,
  author       = {Pith},
  title        = {Pith review of: CRAFT: Cost-aware Refinement And Front-aware Tuning of Prompts},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/4JRBICN5}},
  note         = {Machine review of arXiv:2606.04661}
}
read the original abstract

Prompts tuned for accuracy often grow long, raising inference cost on every model call. The best accuracy-cost trade-off depends on the task and the budget, so prompt optimization is a search over the Pareto front of accuracy and prompt-token cost rather than for one prompt. The usual shortcut, collapsing the objectives into a weighted sum, fixes the trade-off weight before search and often recovers only a narrow region of the front, a failure we call scalarization collapse. We present CRAFT (Cost-aware Refinement And Front-aware Tuning), a Pareto-front prompt optimizer that treats target-LLM validation calls as the scarce resource and allocates them to candidates near the optimistic candidate front. Each round, complementary accuracy-oriented and cost-oriented generators propose edits, Pareto-gap acquisition spends the per-round validation budget, and NSGA-II retention keeps a spread-out population. Across six classification and reasoning benchmarks, CRAFT's retained fronts reach both high-accuracy and low-cost regions, while accuracy-only, cost-only, and weighted-sum baselines each concentrate in narrower regions. The accuracy-cost trade-off becomes a post-search choice, not a pre-search weight.

Figures

Figures reproduced from arXiv: 2606.04661 by the authors.

Figure 1
Figure 1. Accuracy-cost trade-off on BeaverTails. SCULPT (accuracy-only), LLMLingua (cost-only), and WPRO0.5 (weighted-sum) each collapse to a narrow region of the front. CRAFT (ours) covers both high￾accuracy and low-token regions of the front. LLMLingua-2 (Jiang et al., 2023; Pan et al., 2024), reduce token count to lower per-call inference cost (Chen et al., 2024). Both lines treat a prompt as good or bad along one axis, y… view at source ↗
Figure 2
Figure 2. CRAFT framework. Each round, the refiner and condenser generate new candidates from the previous population Pt−1; Pareto-gap acquisition validates them under the per-round validation budget; the NSGA-II selector retains a non-dominated, spread-out population Pt for the next round. The loop repeats for R rounds. a Pareto-gap acquisition function spends the per￾round validation budget on the candidates near the optimi… view at source ↗
Figure 3
Figure 3. Pareto-gap acquisition geometry. Dots mark [PITH_FULL_IMAGE:figures/full_fig_p004_3.png] view at source ↗
Figures from the paper (12 more)
Figure 4
Figure 4. Figure 4: Mean rank across the six benchmarks at R=8 (lower is better). Columns report ranks rather than raw metric values; the left columns group per-metric ranks into front, score, and cost aspects, and the rightmost Overall column is the composite rank with the three aspects …
Figure 5
Figure 5. Figure 5: CRAFT’s retained set on DQA across rounds. Non-dominated points have darker outlines; dominated ones are smaller; the gold star marks the initial prompt. where rA(m, d) is the mean per-metric rank of method m on dataset d within aspect A. 5 Results Method Comparison […
Figure 6
Figure 6. Figure 6: CRAFT hypervolume (↑) and best score (↑) over rounds 0 to 12 on BT and GoE. Optimizer Best ↑ Mean ↑ Tok ↓ Eff ↑ HV ↑ |F| ↑ Initial 36.5 36.5 794 4.6 n/a 1 CRAFT5.5 53.0 38.8 546 9.7 52k 4 CRAFT5.4 51.0 35.5 562 9.1 50k 3 CRAFTmini 48.0 34.8 573 8.4 46k 3 CRAFTDS 51.0 3…
Figure 7
Figure 7. Figure 7: CRAFT selector. Filled circles are candidates in (c, µ) space; the yellow curve is the non-dominated front. Orange-ringed points are retained by the maximin spread rule; pink dashed-ring points are on the front but pruned because admitting them would shrink the minimum…
Figure 8
Figure 8. Figure 8: Shared critic-actor scaffold for the default [PITH_FULL_IMAGE:figures/full_fig_p013_8.png]
Figure 9
Figure 9. Figure 9: Per-dataset composite rank at R = 8 (rank ↓). CRAFT leads DQA and ST; WPRO0.5 leads BT and GoE; SCULPT leads CJ; DISTILL leads FF. C.2 Per-Dataset Optimization Dynamics Figures 10 to 15 report the per-round dynamics view (hypervolume, min feasible tokens, best score, p…
Figure 10
Figure 10. Figure 10: Optimization dynamics on BT (GPT-5) over rounds 0 to 8 for [PITH_FULL_IMAGE:figures/full_fig_p018_10.png]
Figure 11
Figure 11. Figure 11: Optimization dynamics on GoE (GPT-5) over rounds 0 to 8 for [PITH_FULL_IMAGE:figures/full_fig_p019_11.png]
Figure 12
Figure 12. Figure 12: Optimization dynamics on DQA (GPT-5) over rounds 0 to 8 for [PITH_FULL_IMAGE:figures/full_fig_p019_12.png]
Figure 13
Figure 13. Figure 13: Optimization dynamics on CJ (GPT-5) over rounds 0 to 8 for [PITH_FULL_IMAGE:figures/full_fig_p019_13.png]
Figure 14
Figure 14. Figure 14: Optimization dynamics on FF (GPT-5) over rounds 0 to 8 for [PITH_FULL_IMAGE:figures/full_fig_p020_14.png]
Figure 15
Figure 15. Figure 15: Optimization dynamics on ST (GPT-5) over rounds 0 to 8 for [PITH_FULL_IMAGE:figures/full_fig_p020_15.png]

Discussion (0). Continue with ORCID to comment.

Reference graph

Works this paper leans on

262 extracted references · 107 canonical work pages

  1. [1]

    Language Models are Few-Shot Learners

    Language Models are Few-Shot Learners , author=. arXiv preprint arXiv:2005.14165 , year=

    work page Pith review arXiv 2005

  2. [2]

    The Power of Scale for Parameter-Efficient Prompt Tuning

    The Power of Scale for Parameter-Efficient Prompt Tuning , author=. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , month=nov, year=. doi:10.18653/v1/2021.emnlp-main.243 , pages=

    work page doi:10.18653/v1/2021.emnlp-main.243 2021

  3. [3]

    Prefix-Tuning: Optimizing Continuous Prompts for Generation , author=. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , month=aug, year=. doi:10.18653/v1/2021.acl-long.353 , pages=

    work page doi:10.18653/v1/2021.acl-long.353 2021

  4. [4]

    2024 , publisher=

    Liu, Xiao and Zheng, Yanan and Du, Zhengxiao and Ding, Ming and Qian, Yujie and Yang, Zhilin and Tang, Jie , journal=. 2024 , publisher=

    2024

  5. [5]

    Learning How to Ask: Querying

    Qin, Guanghui and Eisner, Jason , editor=. Learning How to Ask: Querying. Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies , month=jun, year=. doi:10.18653/v1/2021.naacl-main.410 , pages=

    work page doi:10.18653/v1/2021.naacl-main.410 2021

  6. [6]

    Advances in Neural Information Processing Systems , volume=

    Hard prompts made easy: Gradient-based discrete optimization for prompt tuning and discovery , author=. Advances in Neural Information Processing Systems , volume=

  7. [7]

    Making Pre-trained Language Models Better Few-shot Learners , author=. Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) , month=aug, year=. doi:10.18653/v1/2021.acl-long.295 , pages=

    work page doi:10.18653/v1/2021.acl-long.295 2021

  8. [8]

    arXiv preprint arXiv:2211.11890 , year=

    Tempera: Test-time prompting via reinforcement learning , author=. arXiv preprint arXiv:2211.11890 , year=

    work page arXiv

Show all 262 references
  1. [9]

    The Twelfth International Conference on Learning Representations , year=

    Large Language Models as Optimizers , author=. The Twelfth International Conference on Learning Representations , year=

  2. [10]

    arXiv preprint arXiv:2203.07281 , year=

    Grips: Gradient-free, edit-based instruction search for prompting large language models , author=. arXiv preprint arXiv:2203.07281 , year=

  3. [11]

    Automatic Engineering of Long Prompts

    Hsieh, Cho-Jui and Si, Si and Yu, Felix and Dhillon, Inderjit. Automatic Engineering of Long Prompts. Findings of the Association for Computational Linguistics ACL 2024. 2024. doi:10.18653/v1/2024.findings-acl.634

    2024 doi

  4. [12]

    arXiv preprint arXiv:2211.01910 , year=

    Large language models are human-level prompt engineers , author=. arXiv preprint arXiv:2211.01910 , year=

    arXiv

  5. [13]

    arXiv preprint arXiv:2307.07415 , year=

    Autohint: Automatic prompt optimization with hint generation , author=. arXiv preprint arXiv:2307.07415 , year=

  6. [14]

    Findings of the Association for Computational Linguistics: ACL 2024 , month=aug, year=

    Prompt Engineering a Prompt Engineer , author=. Findings of the Association for Computational Linguistics: ACL 2024 , month=aug, year=. doi:10.18653/v1/2024.findings-acl.21 , pages=

    2024 doi

  7. [15]

    Automatic Prompt Optimization with ``Gradient Descent'' and Beam Search

    Pryzant, Reid and Iter, Dan and Li, Jerry and Lee, Yin and Zhu, Chenguang and Zeng, Michael. Automatic Prompt Optimization with ``Gradient Descent'' and Beam Search. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023. doi:10.18653/v1/2...

    2023 doi

  8. [16]

    Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , month=aug, year=

    Black-Box Prompt Optimization: Aligning Large Language Models without Model Training , author=. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , month=aug, year=. doi:10.18653/v1/2024.acl-long.176 , pages=

    2024 doi

  9. [17]

    arXiv preprint arXiv:2210.17041 , year=

    GPS: Genetic prompt search for efficient few-shot learning , author=. arXiv preprint arXiv:2210.17041 , year=

  10. [18]

    2024 IEEE Congress on Evolutionary Computation (CEC) , pages=

    Large language models as evolutionary optimizers , author=. 2024 IEEE Congress on Evolutionary Computation (CEC) , pages=. 2024 , organization=

    2024

  11. [19]

    The Twelfth International Conference on Learning Representations , year=

    Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers , author=. The Twelfth International Conference on Learning Representations , year=

  12. [20]

    Proceedings of the 41st International Conference on Machine Learning , pages =

    Promptbreeder: Self-Referential Self-Improvement via Prompt Evolution , author =. Proceedings of the 41st International Conference on Machine Learning , pages =. 2024 , editor =

    2024

  13. [21]

    Optimizing generative

    Yuksekgonul, Mert and Bianchi, Federico and Boen, Joseph and Liu, Sheng and Lu, Pan and Huang, Zhi and Guestrin, Carlos and Zou, James , journal=. Optimizing generative. 2025 , publisher=

    2025

  14. [22]

    Joshi and Hanna Moazam and Heather Miller and Matei Zaharia and Christopher Potts , booktitle=

    Omar Khattab and Arnav Singhvi and Paridhi Maheshwari and Zhiyuan Zhang and Keshav Santhanam and Sri Vardhamanan A and Saiful Haq and Ashutosh Sharma and Thomas T. Joshi and Hanna Moazam and Heather Miller and Matei Zaharia and Christopher Potts , booktitle=. 2024 , url=

    2024

  15. [23]

    Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization

    Schnabel, Tobias and Neville, Jennifer. Symbolic Prompt Program Search: A Structure-Aware Approach to Efficient Compile-Time Prompt Optimization. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024. doi:10.18653/v1/2024.findings-emnlp.37

    2024 doi

  16. [24]

    Aho and Jeffrey D

    Alfred V. Aho and Jeffrey D. Ullman , title =. 1972

    1972

  17. [25]

    Publications Manual , year = "1983", publisher =

    1983

  18. [26]

    arXiv preprint arXiv:2005.04118 , year=

    Beyond accuracy: Behavioral testing of NLP models with CheckList , author=. arXiv preprint arXiv:2005.04118 , year=

    2005

  19. [27]

    arXiv preprint arXiv:2302.09664 , year=

    Semantic uncertainty: Linguistic invariances for uncertainty estimation in natural language generation , author=. arXiv preprint arXiv:2302.09664 , year=

    arXiv

  20. [28]

    Chandra and Dexter C

    Ashok K. Chandra and Dexter C. Kozen and Larry J. Stockmeyer , year = "1981", title =. doi:10.1145/322234.322243

    1981 doi

  21. [29]

    Scalable training of

    Andrew, Galen and Gao, Jianfeng , booktitle=. Scalable training of

  22. [30]

    Dan Gusfield , title =. 1997

    1997

  23. [31]

    Tetreault , title =

    Mohammad Sadegh Rasooli and Joel R. Tetreault , title =. Computing Research Repository , volume =. 2015 , url =

    2015

  24. [32]

    A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , Volume =

    Ando, Rie Kubota and Zhang, Tong , Issn =. A Framework for Learning Predictive Structures from Multiple Tasks and Unlabeled Data , Volume =. Journal of Machine Learning Research , Month = dec, Numpages =

  25. [33]

    , title =

    Turing, Alan M. , title =. Mind , volume =

  26. [34]

    Nature , volume =

    Learning Representations by Back-Propagating Errors , author =. Nature , volume =

  27. [35]

    Proceedings of the 10th European Conference on Artificial Intelligence (ECAI) , pages =

    Planning as Satisfiability , author =. Proceedings of the 10th European Conference on Artificial Intelligence (ECAI) , pages =

  28. [36]

    Artificial Intelligence , volume =

    Collaborative Plans for Complex Group Action , author =. Artificial Intelligence , volume =

  29. [37]

    The Entropy Formula for the

    Grisha Perelman , howpublished =. The Entropy Formula for the

  30. [38]

    Causality , author =

  31. [39]

    Tnternational Conference on Machine Learning , pages=

    Dropout as a Bayesian approximation: Representing model uncertainty in deep learning , author=. Tnternational Conference on Machine Learning , pages=

  32. [40]

    Findings of the Association for Computational Linguistics: NAACL 2022 , pages=

    ” Diversity and Uncertainty in Moderation” are the Key to Data Selection for Multilingual Few-shot Transfer , author=. Findings of the Association for Computational Linguistics: NAACL 2022 , pages=

    2022

  33. [41]

    Advances in neural information processing systems , pages=

    What uncertainties do we need in bayesian deep learning for computer vision? , author=. Advances in neural information processing systems , pages=

  34. [42]

    Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, volume 2: Short Papers , pages=

    Active learning for post-editing based incrementally retrained MT , author=. Proceedings of the 14th Conference of the European Chapter of the Association for Computational Linguistics, volume 2: Short Papers , pages=

  35. [43]

    Transactions of the Association for Computational Linguistics , volume=

    Multilingual denoising pre-training for neural machine translation , author=. Transactions of the Association for Computational Linguistics , volume=. 2020 , publisher=

    2020

  36. [44]

    arXiv preprint arXiv:2010.11934 , year=

    mT5: A massively multilingual pre-trained text-to-text transformer , author=. arXiv preprint arXiv:2010.11934 , year=

    2010

  37. [45]

    arXiv preprint arXiv:2012.15674 , year=

    ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora , author=. arXiv preprint arXiv:2012.15674 , year=

    2012

  38. [46]

    Proceedings of the 57th annual meeting of the association for computational linguistics , pages=

    Reinforced training data selection for domain adaptation , author=. Proceedings of the 57th annual meeting of the association for computational linguistics , pages=

  39. [47]

    Proceedings of the 45th annual meeting of the association of computational linguistics , pages=

    Biographies, bollywood, boom-boxes and blenders: Domain adaptation for sentiment classification , author=. Proceedings of the 45th annual meeting of the association of computational linguistics , pages=

  40. [48]

    Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , pages=

    Data point selection for cross-language adaptation of dependency parsers , author=. Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies , pages=

  41. [49]

    and McDonald, Ryan and Petrov, Slav and Pyysalo, Sampo and Silveira, Natalia and Tsarfaty, Reut and Zeman, Daniel

    Nivre, Joakim and de Marneffe, Marie-Catherine and Ginter, Filip and Goldberg, Yoav and Haji c , Jan and Manning, Christopher D. and McDonald, Ryan and Petrov, Slav and Pyysalo, Sampo and Silveira, Natalia and Tsarfaty, Reut and Zeman, Daniel. U niversal D ependencies v1: A Mu...

    2016

  42. [50]

    Massively Multilingual Transfer for NER

    Rahimi, Afshin and Li, Yuan and Cohn, Trevor. Massively Multilingual Transfer for NER. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019. doi:10.18653/v1/P19-1015

    2019 doi

  43. [51]

    Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages=

    From Zero to Hero: On the Limitations of Zero-Shot Language Transfer with Multilingual Transformers , author=. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages=

    2020

  44. [52]

    BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding

    Devlin, Jacob and Chang, Ming-Wei and Lee, Kenton and Toutanova, Kristina. BERT : Pre-training of Deep Bidirectional Transformers for Language Understanding. Proceedings of the 2019 Conference of the North A merican Chapter of the Association for Computational Linguistics: Hum...

    2019 doi

  45. [53]

    How Multilingual is Multilingual BERT ?

    Pires, Telmo and Schlinger, Eva and Garrette, Dan. How Multilingual is Multilingual BERT ?. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. 2019. doi:10.18653/v1/P19-1493

    2019 doi

  46. [54]

    HuggingFace's Transformers: State-of-the-art Natural Language Processing , journal =

    Thomas Wolf and Lysandre Debut and Victor Sanh and Julien Chaumond and Clement Delangue and Anthony Moi and Pierric Cistac and Tim Rault and R. HuggingFace's Transformers: State-of-the-art Natural Language Processing , journal =. 2019 , url =

    2019

  47. [55]

    SRILM - an extensible language modeling toolkit

    Stolcke, Andreas , biburl =. SRILM - an extensible language modeling toolkit. , url =. INTERSPEECH , editor =

  48. [56]

    and Lewis, William

    Moore, Robert C. and Lewis, William. Intelligent Selection of Language Model Training Data. Proceedings of the ACL 2010 Conference Short Papers. 2010

    2010

  49. [57]

    Domain Adaptation via Pseudo In-Domain Data Selection

    Axelrod, Amittai and He, Xiaodong and Gao, Jianfeng. Domain Adaptation via Pseudo In-Domain Data Selection. Proceedings of the 2011 Conference on Empirical Methods in Natural Language Processing. 2011

    2011

  50. [58]

    Cross-lingual Language Model Pretraining , url =

    Conneau, Alexis and Lample, Guillaume , booktitle =. Cross-lingual Language Model Pretraining , url =

  51. [59]

    Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages=

    Unsupervised Cross-lingual Representation Learning at Scale , author=. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages=

  52. [60]

    International Conference on Learning Representations , year=

    Cross-Lingual Ability of Multilingual BERT: An Empirical Study , author=. International Conference on Learning Representations , year=

  53. [61]

    On the Cross-lingual Transferability of Monolingual Representations

    Artetxe, Mikel and Ruder, Sebastian and Yogatama, Dani. On the Cross-lingual Transferability of Monolingual Representations. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020. doi:10.18653/v1/2020.acl-main.421

    2020 doi

  54. [62]

    Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT

    Wu, Shijie and Dredze, Mark. Beto, Bentz, Becas: The Surprising Cross-Lingual Effectiveness of BERT. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)....

    2019 doi

  55. [63]

    Zero-Shot Cross-Lingual Transfer with Meta Learning

    Nooralahzadeh, Farhad and Bekoulis, Giannis and Bjerva, Johannes and Augenstein, Isabelle. Zero-Shot Cross-Lingual Transfer with Meta Learning. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. doi:10.18653/v1/2020.emnlp-main.368

    2020 doi

  56. [64]

    Proceedings of the 31st International Conference on Neural Information Processing Systems , pages=

    Simple and scalable predictive uncertainty estimation using deep ensembles , author=. Proceedings of the 31st International Conference on Neural Information Processing Systems , pages=

  57. [65]

    and Nowozin, Sebastian and Dillon, Joshua and Lakshminarayanan, Balaji and Snoek, Jasper , booktitle =

    Ovadia, Yaniv and Fertig, Emily and Ren, Jie and Nado, Zachary and Sculley, D. and Nowozin, Sebastian and Dillon, Joshua and Lakshminarayanan, Balaji and Snoek, Jasper , booktitle =. Can you trust your model s uncertainty? Evaluating predictive uncertainty under dataset shift , url =

  58. [66]

    2012 , publisher=

    Bayesian learning for neural networks , author=. 2012 , publisher=

    2012

  59. [67]

    Entropy-based Training Data Selection for Domain Adaptation

    Song, Yan and Klassen, Prescott and Xia, Fei and Kit, Chunyu. Entropy-based Training Data Selection for Domain Adaptation. Proceedings of COLING 2012: Posters. 2012

    2012

  60. [68]

    Proceedings of the AAAI Conference on Artificial Intelligence , volume=

    Quantifying uncertainties in natural language processing tasks , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=

  61. [69]

    2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops , pages=

    Entropy-based active learning for object recognition , author=. 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops , pages=. 2008 , organization=

    2008

  62. [70]

    The State and Fate of Linguistic Diversity and Inclusion in the NLP World

    Joshi, Pratik and Santy, Sebastin and Budhiraja, Amar and Bali, Kalika and Choudhury, Monojit. The State and Fate of Linguistic Diversity and Inclusion in the NLP World. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020. doi:10.18653...

    2020 doi

  63. [71]

    Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies , articleno =

    Sabou, Marta and Bontcheva, Kalina and Scharl, Arno , title =. Proceedings of the 12th International Conference on Knowledge Management and Knowledge Technologies , articleno =. 2012 , isbn =. doi:10.1145/2362456.2362479 , abstract =

    2012 doi

  64. [72]

    Complex Linguistic Annotation -- No Easy Way Out! A Case from B angla and H indi POS Labeling Tasks

    Dandapat, Sandipan and Biswas, Priyanka and Choudhury, Monojit and Bali, Kalika. Complex Linguistic Annotation -- No Easy Way Out! A Case from B angla and H indi POS Labeling Tasks. Proceedings of the Third Linguistic Annotation Workshop ( LAW III ). 2009

    2009

  65. [73]

    2016 , publisher=

    Collaborative Annotation for Reliable Natural Language Processing: Technical and Sociological Aspects , author=. 2016 , publisher=

    2016

  66. [74]

    Glenn W. Brier. VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY. Monthly Weather Review. 1950. doi:10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2

    1950 doi

  67. [75]

    Quarterly Journal of the Royal Meteorological Society , volume =

    Bröcker, Jochen , title =. Quarterly Journal of the Royal Meteorological Society , volume =. doi:https://doi.org/10.1002/qj.456 , url =. https://rmets.onlinelibrary.wiley.com/doi/pdf/10.1002/qj.456 , abstract =

    doi

  68. [76]

    International Conference on Artificial Intelligence and Statistics , pages=

    On Data Efficiency of Meta-learning , author=. International Conference on Artificial Intelligence and Statistics , pages=. 2021 , organization=

    2021

  69. [77]

    arXiv preprint arXiv:2001.08735 , year=

    Cross-domain few-shot classification via learned feature-wise transformation , author=. arXiv preprint arXiv:2001.08735 , year=

    2001

  70. [78]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Learning loss for active learning , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  71. [79]

    International Conference on Machine Learning , pages=

    Deep bayesian active learning with image data , author=. International Conference on Machine Learning , pages=. 2017 , organization=

    2017

  72. [80]

    arXiv preprint arXiv:1708.00489 , year=

    Active learning for convolutional neural networks: A core-set approach , author=. arXiv preprint arXiv:1708.00489 , year=

    arXiv

  73. [81]

    Proceedings of the 2019 3rd International Conference on Computer Science and Artificial Intelligence , pages=

    An ensemble deep active learning method for intent classification , author=. Proceedings of the 2019 3rd International Conference on Computer Science and Artificial Intelligence , pages=

    2019

  74. [82]

    arXiv preprint arXiv:1808.05697 , year=

    Deep bayesian active learning for natural language processing: Results of a large-scale empirical study , author=. arXiv preprint arXiv:1808.05697 , year=

    arXiv

  75. [83]

    Advances in Neural Information Processing Systems , volume=

    Latent structured active learning , author=. Advances in Neural Information Processing Systems , volume=

  76. [84]

    Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing , pages=

    An analysis of active learning strategies for sequence labeling tasks , author=. Proceedings of the 2008 Conference on Empirical Methods in Natural Language Processing , pages=

    2008

  77. [85]

    2009 IEEE Conference on Computer Vision and Pattern Recognition , pages=

    Multi-class active learning for image classification , author=. 2009 IEEE Conference on Computer Vision and Pattern Recognition , pages=. 2009 , organization=

    2009

  78. [86]

    Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pages=

    XNLI: Evaluating Cross-lingual Sentence Representations , author=. Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing , pages=

    2018

  79. [87]

    Advances in neural information processing systems , volume=

    Practical variational inference for neural networks , author=. Advances in neural information processing systems , volume=

  80. [88]

    A Little Annotation does a Lot of Good: A Study in Bootstrapping Low-resource Named Entity Recognizers , author=. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (E...

    2019

  81. [89]

    Knowledge and information systems , volume=

    A survey on instance selection for active learning , author=. Knowledge and information systems , volume=. 2013 , publisher=

    2013

  82. [90]

    International Conference on Learning Representations , year=

    Deep Batch Active Learning by Diverse, Uncertain Gradient Lower Bounds , author=. International Conference on Learning Representations , year=

  83. [91]

    2006 , institution=

    k-means++: The advantages of careful seeding , author=. 2006 , institution=

    2006

  84. [92]

    , author=

    Visualizing data using t-SNE. , author=. Journal of machine learning research , volume=

  85. [93]

    Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages=

    Making Monolingual Sentence Embeddings Multilingual Using Knowledge Distillation , author=. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) , pages=

    2020

  86. [94]

    International Conference on Learning Representations , year=

    Active Learning for Convolutional Neural Networks: A Core-Set Approach , author=. International Conference on Learning Representations , year=

  87. [95]

    arXiv preprint arXiv:1907.06347 , year=

    Discriminative active learning , author=. arXiv preprint arXiv:1907.06347 , year=

    1907 arXiv

  88. [96]

    Zero-shot Cross-lingual Transfer is Under-specified Optimization

    Wu, Shijie and Van Durme, Benjamin and Dredze, Mark. Zero-shot Cross-lingual Transfer is Under-specified Optimization. Proceedings of the 7th Workshop on Representation Learning for NLP. 2022. doi:10.18653/v1/2022.repl4nlp-1.25

    2022 doi

  89. [97]

    Do Explicit Alignments Robustly Improve Multilingual Encoders?

    Wu, Shijie and Dredze, Mark. Do Explicit Alignments Robustly Improve Multilingual Encoders?. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. doi:10.18653/v1/2020.emnlp-main.362

    2020 doi

  90. [98]

    XTREME - R : Towards More Challenging and Nuanced Multilingual Evaluation

    Ruder, Sebastian and Constant, Noah and Botha, Jan and Siddhant, Aditya and Firat, Orhan and Fu, Jinlan and Liu, Pengfei and Hu, Junjie and Garrette, Dan and Neubig, Graham and Johnson, Melvin. XTREME - R : Towards More Challenging and Nuanced Multilingual Evaluation. Proceedi...

    2021 doi

  91. [99]

    International Conference on Machine Learning , pages=

    Xtreme: A massively multilingual multi-task benchmark for evaluating cross-lingual generalisation , author=. International Conference on Machine Learning , pages=. 2020 , organization=

    2020

  92. [100]

    International Conference on Learning Representations , year=

    Sharpness-aware Minimization for Efficiently Improving Generalization , author=. International Conference on Learning Representations , year=

  93. [101]

    European Conference on Computer Vision , pages=

    Minimum class confusion for versatile domain adaptation , author=. European Conference on Computer Vision , pages=. 2020 , organization=

    2020

  94. [102]

    Advances in neural information processing systems , volume=

    Conditional adversarial domain adaptation , author=. Advances in neural information processing systems , volume=

  95. [103]

    International conference on machine learning , pages=

    Unsupervised domain adaptation by backpropagation , author=. International conference on machine learning , pages=. 2015 , organization=

    2015

  96. [104]

    Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

    Attending to discriminative certainty for domain adaptation , author=. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages=

  97. [105]

    The journal of machine learning research , volume=

    Domain-adversarial training of neural networks , author=. The journal of machine learning research , volume=. 2016 , publisher=

    2016

  98. [106]

    '' Diversity and Uncertainty in Moderation '' are the Key to Data Selection for Multilingual Few-shot Transfer

    Kumar, Shanu and Dandapat, Sandipan and Choudhury, Monojit. '' Diversity and Uncertainty in Moderation '' are the Key to Data Selection for Multilingual Few-shot Transfer. Findings of the Association for Computational Linguistics: NAACL 2022. 2022. doi:10.18653/v1/2022.finding...

    2022 doi

  99. [107]

    International Conference on Machine Learning , pages=

    Similarity of neural network representations revisited , author=. International Conference on Machine Learning , pages=. 2019 , organization=

    2019

  100. [108]

    MAD-X : A n A dapter- B ased F ramework for M ulti- T ask C ross- L ingual T ransfer

    Pfeiffer, Jonas and Vuli \'c , Ivan and Gurevych, Iryna and Ruder, Sebastian. MAD-X : A n A dapter- B ased F ramework for M ulti- T ask C ross- L ingual T ransfer. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. doi:10.1865...

    2020 doi

  101. [109]

    Findings of the Association for Computational Linguistics: EMNLP 2021 , pages=

    MAD-G: Multilingual adapter generation for efficient cross-lingual transfer , author=. Findings of the Association for Computational Linguistics: EMNLP 2021 , pages=

    2021

  102. [110]

    Lifting the Curse of Multilinguality by Pre-training Modular Transformers

    Pfeiffer, Jonas and Goyal, Naman and Lin, Xi and Li, Xian and Cross, James and Riedel, Sebastian and Artetxe, Mikel. Lifting the Curse of Multilinguality by Pre-training Modular Transformers. Proceedings of the 2022 Conference of the North American Chapter of the Association f...

    2022 doi

  103. [111]

    A mericas NLI : Evaluating Zero-shot Natural Language Understanding of Pretrained Multilingual Models in Truly Low-resource Languages

    Ebrahimi, Abteen and Mager, Manuel and Oncevay, Arturo and Chaudhary, Vishrav and Chiruzzo, Luis and Fan, Angela and Ortega, John and Ramos, Ricardo and Rios, Annette and Meza Ruiz, Ivan Vladimir and Gim \'e nez-Lugo, Gustavo and Mager, Elisabeth and Neubig, Graham and Palmer,...

    2022 doi

  104. [112]

    Proceedings of the 7th Workshop on Representation Learning for NLP , pages=

    Zero-shot Cross-lingual Transfer is Under-specified Optimization , author=. Proceedings of the 7th Workshop on Representation Learning for NLP , pages=

  105. [113]

    When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer

    Deshpande, Ameet and Talukdar, Partha and Narasimhan, Karthik. When is BERT Multilingual? Isolating Crucial Ingredients for Cross-lingual Transfer. Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language...

    2022 doi

  106. [114]

    European conference on computer vision , pages=

    Big transfer (bit): General visual representation learning , author=. European conference on computer vision , pages=. 2020 , organization=

    2020

  107. [115]

    Communications of the ACM , volume=

    Understanding deep learning (still) requires rethinking generalization , author=. Communications of the ACM , volume=. 2021 , publisher=

    2021

  108. [116]

    International Conference on Learning Representations , year=

    When Vision Transformers Outperform ResNets without Pre-training or Strong Data Augmentations , author=. International Conference on Learning Representations , year=

  109. [117]

    Parallel Data, Tools and Interfaces in OPUS

    Tiedemann, J. Parallel Data, Tools and Interfaces in OPUS. Proceedings of the Eighth International Conference on Language Resources and Evaluation ( LREC '12). 2012

    2012

  110. [118]

    Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages=

    Improving Massively Multilingual Neural Machine Translation and Zero-Shot Translation , author=. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics , pages=

  111. [119]

    Proceedings of the Third Workshop on Computational Typology and Multilingual NLP , pages=

    Improving cross-lingual sentiment analysis via conditional language adversarial nets , author=. Proceedings of the Third Workshop on Computational Typology and Multilingual NLP , pages=

  112. [120]

    Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pages=

    Effective Fine-Tuning Methods for Cross-lingual Adaptation , author=. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing , pages=

    2021

  113. [121]

    Preserving Cross-Linguality of Pre-trained Models via Continual Learning

    Liu, Zihan and Winata, Genta Indra and Madotto, Andrea and Fung, Pascale. Preserving Cross-Linguality of Pre-trained Models via Continual Learning. Proceedings of the 6th Workshop on Representation Learning for NLP (RepL4NLP-2021). 2021. doi:10.18653/v1/2021.repl4nlp-1.8

    2021 doi

  114. [122]

    International Conference on Learning Representations , year=

    Better Fine-Tuning by Reducing Representational Collapse , author=. International Conference on Learning Representations , year=

  115. [123]

    Identifying Elements Essential for BERT ' s Multilinguality

    Dufter, Philipp and Sch. Identifying Elements Essential for BERT ' s Multilinguality. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. doi:10.18653/v1/2020.emnlp-main.358

    2020 doi

  116. [124]

    The Multilingual A mazon Reviews Corpus

    Keung, Phillip and Lu, Yichao and Szarvas, Gy. The Multilingual A mazon Reviews Corpus. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP). 2020. doi:10.18653/v1/2020.emnlp-main.369

    2020 doi

  117. [125]

    PAWS-X: A Cross-lingual Adversarial Dataset for Paraphrase Identification , author=. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) , pages=

    2019

  118. [126]

    Advances in Neural Information Processing Systems , volume=

    Swad: Domain generalization by seeking flat minima , author=. Advances in Neural Information Processing Systems , volume=

  119. [127]

    International Conference on Learning Representations , year=

    Decoupled Weight Decay Regularization , author=. International Conference on Learning Representations , year=

  120. [128]

    Proceedings of the 58th annual meeting of the Association for Computational Linguistics , pages=

    Adversarial and domain-aware bert for cross-domain sentiment analysis , author=. Proceedings of the 58th annual meeting of the Association for Computational Linguistics , pages=

  121. [129]

    On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data

    Ahuja, Kabir and Choudhury, Monojit and Dandapat, Sandipan. On the Economics of Multilingual Few-shot Learning: Modeling the Cost-Performance Trade-offs of Machine Translated and Manual Data. Proceedings of the 2022 Conference of the North American Chapter of the Association f...

    2022 doi

  122. [130]

    Proceedings of the IEEE international conference on computer vision , pages=

    Least squares generative adversarial networks , author=. Proceedings of the IEEE international conference on computer vision , pages=

  123. [131]

    Advances in Neural Information Processing Systems , volume=

    On the algorithmic stability of adversarial training , author=. Advances in Neural Information Processing Systems , volume=

  124. [132]

    Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

    Sharpness-Aware Minimization Improves Language Model Generalization , author=. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) , pages=

  125. [133]

    Advances in neural information processing systems , volume=

    When does label smoothing help? , author=. Advances in neural information processing systems , volume=

  126. [134]

    International Conference on Learning Representations , year=

    mixup: Beyond Empirical Risk Minimization , author=. International Conference on Learning Representations , year=

  127. [135]

    Journal of Machine Learning Research , year =

    Nitish Srivastava and Geoffrey Hinton and Alex Krizhevsky and Ilya Sutskever and Ruslan Salakhutdinov , title =. Journal of Machine Learning Research , year =

  128. [136]

    Proceedings of the AAAI Conference on Artificial Intelligence , volume=

    Local regularizer improves generalization , author=. Proceedings of the AAAI Conference on Artificial Intelligence , volume=

  129. [137]

    International Conference on Learning Representations , year=

    On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minima , author=. International Conference on Learning Representations , year=

  130. [138]

    Asymmetric Valleys: Beyond Sharp and Flat Local Minima , url =

    He, Haowei and Huang, Gao and Yuan, Yang , booktitle =. Asymmetric Valleys: Beyond Sharp and Flat Local Minima , url =

  131. [139]

    International Conference on Learning Representations , year=

    A Bayesian Perspective on Generalization and Stochastic Gradient Descent , author=. International Conference on Learning Representations , year=

  132. [140]

    International conference on machine learning , pages=

    Batch normalization: Accelerating deep network training by reducing internal covariate shift , author=. International conference on machine learning , pages=. 2015 , organization=

    2015

  133. [141]

    arXiv preprint arXiv:1805.09501 , year=

    Autoaugment: Learning augmentation policies from data , author=. arXiv preprint arXiv:1805.09501 , year=

    arXiv

  134. [142]

    International Conference on Learning Representations , year=

    Fantastic Generalization Measures and Where to Find Them , author=. International Conference on Learning Representations , year=

  135. [143]

    arXiv preprint arXiv:1703.11008 , year=

    Computing nonvacuous generalization bounds for deep (stochastic) neural networks with many more parameters than training data , author=. arXiv preprint arXiv:1703.11008 , year=

    arXiv

  136. [144]

    , author=

    Exploring the limits of transfer learning with a unified text-to-text transformer. , author=. J. Mach. Learn. Res. , volume=

  137. [145]

    International conference on machine learning , pages=

    Learning transferable features with deep adaptation networks , author=. International conference on machine learning , pages=. 2015 , organization=

    2015

  138. [146]

    European conference on computer vision , pages=

    Deep coral: Correlation alignment for deep domain adaptation , author=. European conference on computer vision , pages=. 2016 , organization=

    2016

  139. [147]

    Don ' t Stop Pretraining: Adapt Language Models to Domains and Tasks

    Gururangan, Suchin and Marasovi \'c , Ana and Swayamdipta, Swabha and Lo, Kyle and Beltagy, Iz and Downey, Doug and Smith, Noah A. Don ' t Stop Pretraining: Adapt Language Models to Domains and Tasks. Proceedings of the 58th Annual Meeting of the Association for Computational ...

    2020 doi

  140. [148]

    and Ugarte, Arjuna and Matsubara, Yoshitomo and Young, Sean and Singh, Sameer

    Hossain, Tamanna and Logan IV, Robert L. and Ugarte, Arjuna and Matsubara, Yoshitomo and Young, Sean and Singh, Sameer. COVIDL ies: Detecting COVID -19 Misinformation on Social Media. Proceedings of the 1st Workshop on NLP for COVID -19 (Part 2) at EMNLP 2020. 2020. doi:10.186...

    2020 doi

  141. [149]

    H ate BERT : Retraining BERT for Abusive Language Detection in E nglish

    Caselli, Tommaso and Basile, Valerio and Mitrovi \'c , Jelena and Granitzer, Michael. H ate BERT : Retraining BERT for Abusive Language Detection in E nglish. Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021). 2021. doi:10.18653/v1/2021.woah-1.3

    2021 doi

  142. [150]

    Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models

    Ahuja, Kabir and Kumar, Shanu and Dandapat, Sandipan and Choudhury, Monojit. Multi Task Learning For Zero Shot Performance Prediction of Multilingual Models. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2022. ...

    2022 doi

  143. [151]

    Better Zero-Shot Reasoning with Self-Adaptive Prompting

    Wan, Xingchen and Sun, Ruoxi and Dai, Hanjun and Arik, Sercan and Pfister, Tomas. Better Zero-Shot Reasoning with Self-Adaptive Prompting. Findings of the Association for Computational Linguistics: ACL 2023. 2023. doi:10.18653/v1/2023.findings-acl.216

    2023 doi

  144. [152]

    The Eleventh International Conference on Learning Representations , year=

    Automatic Chain of Thought Prompting in Large Language Models , author=. The Eleventh International Conference on Learning Representations , year=

  145. [153]

    Large Language Models are Zero-Shot Reasoners , url =

    Kojima, Takeshi and Gu, Shixiang (Shane) and Reid, Machel and Matsuo, Yutaka and Iwasawa, Yusuke , booktitle =. Large Language Models are Zero-Shot Reasoners , url =

  146. [154]

    Language Models are Few-Shot Learners , url =

    Brown, Tom and Mann, Benjamin and Ryder, Nick and Subbiah, Melanie and Kaplan, Jared D and Dhariwal, Prafulla and Neelakantan, Arvind and Shyam, Pranav and Sastry, Girish and Askell, Amanda and Agarwal, Sandhini and Herbert-Voss, Ariel and Krueger, Gretchen and Henighan, Tom a...

  147. [155]

    ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models , year=

    Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters , author=. ICLR 2023 Workshop on Mathematical and Empirical Understanding of Foundation Models , year=

    2023

  148. [156]

    Advances in Neural Information Processing Systems 35 (NeurIPS 2022) , pages=

    Chain-of-Thought Prompting Elicits Reasoning in Large Language Models , author=. Advances in Neural Information Processing Systems 35 (NeurIPS 2022) , pages=. 2022 , url=

    2022

  149. [157]

    What Makes Good In-Context Examples for GPT -3?

    Liu, Jiachang and Shen, Dinghan and Zhang, Yizhe and Dolan, Bill and Carin, Lawrence and Chen, Weizhu. What Makes Good In-Context Examples for GPT -3?. Proceedings of Deep Learning Inside Out (DeeLIO 2022): The 3rd Workshop on Knowledge Extraction and Integration for Deep Lear...

    2022 doi

  150. [158]

    Sentence- BERT : Sentence Embeddings using S iamese BERT -Networks

    Reimers, Nils and Gurevych, Iryna. Sentence- BERT : Sentence Embeddings using S iamese BERT -Networks. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP...

    2019 doi

  151. [159]

    Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations

    Yoo, Kang Min and Kim, Junyeob and Kim, Hyuhng Joon and Cho, Hyunsoo and Jo, Hwiyeol and Lee, Sang-Woo and Lee, Sang-goo and Kim, Taeuk. Ground-Truth Labels Matter: A Deeper Look into Input-Label Demonstrations. Proceedings of the 2022 Conference on Empirical Methods in Natura...

    2022 doi

  152. [160]

    Transactions on Machine Learning Research , issn=

    Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models , author=. Transactions on Machine Learning Research , issn=. 2023 , url=

    2023

  153. [161]

    arXiv preprint arXiv:2302.13971 , year=

    Touvron, Hugo and Lavril, Thibaut and Izacard, Gautier and Martinet, Xavier and Lachaux, Marie-Anne and Lacroix, Timoth. arXiv preprint arXiv:2302.13971 , year=

    arXiv

  154. [162]

    arXiv preprint arXiv:2110.14168 , year=

    Training Verifiers to Solve Math Word Problems , author=. arXiv preprint arXiv:2110.14168 , year=

    arXiv

  155. [163]

    arXiv preprint arXiv:2201.08239 , year=

    Lamda: Language models for dialog applications , author=. arXiv preprint arXiv:2201.08239 , year=

    arXiv

  156. [164]

    and Angeli, Gabor and Potts, Christopher and Manning, Christopher D

    Bowman, Samuel R. and Angeli, Gabor and Potts, Christopher and Manning, Christopher D. A large annotated corpus for learning natural language inference. Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing. 2015. doi:10.18653/v1/D15-1075

    2015 doi

  157. [165]

    Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models

    Ni, Jianmo and Hernandez Abrego, Gustavo and Constant, Noah and Ma, Ji and Hall, Keith and Cer, Daniel and Yang, Yinfei. Sentence-T5: Scalable Sentence Encoders from Pre-trained Text-to-Text Models. Findings of the Association for Computational Linguistics: ACL 2022. 2022. doi...

    2022 doi

  158. [166]

    The Eleventh International Conference on Learning Representations , year=

    Self-Consistency Improves Chain of Thought Reasoning in Language Models , author=. The Eleventh International Conference on Learning Representations , year=

  159. [167]

    1970 , publisher=

    Monte Carlo sampling methods using Markov chains and their applications , author=. 1970 , publisher=

    1970

  160. [168]

    Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms , pages=

    K-means++ the advantages of careful seeding , author=. Proceedings of the eighteenth annual ACM-SIAM symposium on Discrete algorithms , pages=

  161. [169]

    Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

    Geva, Mor and Khashabi, Daniel and Segal, Elad and Khot, Tushar and Roth, Dan and Berant, Jonathan. Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies. Transactions of the Association for Computational Linguistics. 2021. doi:10.1162/t...

    2021 doi

  162. [170]

    Findings of the Association for Computational Linguistics: EMNLP 2022 , pages=

    Logical Fallacy Detection , author=. Findings of the Association for Computational Linguistics: EMNLP 2022 , pages=

    2022

  163. [171]

    arXiv preprint arXiv:2305.03353 , year=

    Mindgames: Targeting theory of mind in large language models with dynamic epistemic modal logic , author=. arXiv preprint arXiv:2305.03353 , year=

  164. [172]

    arXiv preprint arXiv:2303.12712 , year=

    Sparks of artificial general intelligence: Early experiments with gpt-4 , author=. arXiv preprint arXiv:2303.12712 , year=

    arXiv

  165. [173]

    arXiv preprint arXiv:2306.16564 , year=

    Automatic Calibration and Error Correction for Large Language Models via Pareto Optimal Self-Supervision , author=. arXiv preprint arXiv:2306.16564 , year=

  166. [174]

    Proceedings of the 37th International Conference on Machine Learning , pages =

    Uncertainty Estimation Using a Single Deep Deterministic Neural Network , author =. Proceedings of the 37th International Conference on Machine Learning , pages =. 2020 , editor =

    2020

  167. [175]

    Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , url =

    Lakshminarayanan, Balaji and Pritzel, Alexander and Blundell, Charles , booktitle =. Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles , url =

  168. [176]

    International conference on machine learning , pages=

    On calibration of modern neural networks , author=. International conference on machine learning , pages=. 2017 , organization=

    2017

  169. [177]

    , author=

    Measuring Calibration in Deep Learning. , author=. CVPR workshops , volume=

  170. [178]

    International Conference on Learning Representations , year=

    A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networks , author=. International Conference on Learning Representations , year=

  171. [179]

    Proceedings of the 34th International Conference on Machine Learning , pages =

    On Calibration of Modern Neural Networks , author =. Proceedings of the 34th International Conference on Machine Learning , pages =. 2017 , editor =

    2017

  172. [180]

    Advances in neural information processing systems , volume=

    Can you trust your model's uncertainty? evaluating predictive uncertainty under dataset shift , author=. Advances in neural information processing systems , volume=

  173. [181]

    Proceedings of the AAAI conference on artificial intelligence , volume=

    Obtaining well calibrated probabilities using bayesian binning , author=. Proceedings of the AAAI conference on artificial intelligence , volume=

  174. [182]

    arXiv preprint arXiv:2112.11446 , year=

    Scaling language models: Methods, analysis & insights from training gopher , author=. arXiv preprint arXiv:2112.11446 , year=

    arXiv

  175. [183]

    arXiv preprint arXiv:2203.13450 , year=

    A comparative survey of deep active learning , author=. arXiv preprint arXiv:2203.13450 , year=

  176. [184]

    Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data

    Shum, Kashun and Diao, Shizhe and Zhang, Tong. Automatic Prompt Augmentation and Selection with Chain-of-Thought from Labeled Data. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023. doi:10.18653/v1/2023.findings-emnlp.811

    2023 doi

  177. [185]

    Transactions on Machine Learning Research , issn=

    Holistic Evaluation of Language Models , author=. Transactions on Machine Learning Research , issn=. 2023 , url=

    2023

  178. [186]

    Transactions of the Association for Computational Linguistics , volume=

    Multi-task active learning for pre-trained transformer-based models , author=. Transactions of the Association for Computational Linguistics , volume=. 2022 , publisher=

    2022

  179. [187]

    Advances in Neural Information Processing Systems 36 (NeurIPS 2023) , year=

    Tree of Thoughts: Deliberate Problem Solving with Large Language Models , author=. Advances in Neural Information Processing Systems 36 (NeurIPS 2023) , year=

    2023

  180. [188]

    Solving Math Word Problems via Cooperative Reasoning induced Language Models

    Zhu, Xinyu and Wang, Junjie and Zhang, Lin and Zhang, Yuxiang and Huang, Yongfeng and Gan, Ruyi and Zhang, Jiaxing and Yang, Yujiu. Solving Math Word Problems via Cooperative Reasoning induced Language Models. Proceedings of the 61st Annual Meeting of the Association for Compu...

    2023 doi

  181. [189]

    Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication

    Yin, Zhangyue and Sun, Qiushi and Chang, Cheng and Guo, Qipeng and Dai, Junqi and Huang, Xuanjing and Qiu, Xipeng. Exchange-of-Thought: Enhancing Large Language Model Capabilities through Cross-Model Communication. Proceedings of the 2023 Conference on Empirical Methods in Nat...

    2023 doi

  182. [190]

    Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , month=nov, year=

    Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debate , author=. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , month=nov, year=. doi:10.18653/v1/2024.emnlp-main.992 , pages=

    2024 doi

  183. [191]

    Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration , author=. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Techno...

    2024 doi

  184. [192]

    Jiang, Albert Q. and Sablayrolles, Alexandre and Mensch, Arthur and Bamford, Chris and Chaplot, Devendra Singh and de las Casas, Diego and Bressand, Florian and Lengyel, Gianna and Lample, Guillaume and Saulnier, Lucile and Lavaud, L. Mistral 7. arXiv preprint arXiv:2310.06825 , year=

    arXiv

  185. [193]

    arXiv preprint arXiv:2412.08905 , year=

    Phi-4 technical report , author=. arXiv preprint arXiv:2412.08905 , year=

    arXiv

  186. [194]

    Advances in Neural Information Processing Systems 36 (NeurIPS 2023) , year=

    Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspective , author=. Advances in Neural Information Processing Systems 36 (NeurIPS 2023) , year=

    2023

  187. [195]

    Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) , month=mar, year=

    Gao, Xiang and Zhang, Jiaxin and Mouatadid, Lalla and Das, Kamalika , editor=. Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers) , month=mar, year=. doi:10.18653/v1/2024.eacl-long.143 , pages=

    2024 doi

  188. [196]

    arXiv preprint arXiv:2404.10960 , year=

    Uncertainty-Based Abstention in LLMs Improves Safety and Reduces Hallucinations , author=. arXiv preprint arXiv:2404.10960 , year=

  189. [197]

    Active Prompting with Chain-of-Thought for Large Language Models

    Diao, Shizhe and Wang, Pengcheng and Lin, Yong and Pan, Rui and Liu, Xiang and Zhang, Tong. Active Prompting with Chain-of-Thought for Large Language Models. Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2024

    2024

  190. [198]

    arXiv preprint arXiv:2405.10808 , year=

    ActiveLLM: Large Language Model-based Active Learning for Textual Few-Shot Scenarios , author=. arXiv preprint arXiv:2405.10808 , year=

  191. [199]

    Better Zero-Shot Reasoning with Role-Play Prompting

    Kong, Aobo and Zhao, Shiwan and Chen, Hao and Li, Qicheng and Qin, Yong and Sun, Ruiqi and Zhou, Xin and Wang, Enzhi and Dong, Xiaohang. Better Zero-Shot Reasoning with Role-Play Prompting. Proceedings of the 2024 Conference of the North American Chapter of the Association for...

    2024 doi

  192. [200]

    Benchmarking Uncertainty Quantification Methods for Large Language Models with

    Vashurin, Roman and Fadeeva, Ekaterina and Vazhentsev, Artem and Rvanova, Lyudmila and Vasilev, Daniil and Tsvigun, Akim and Petrakov, Sergey and Xing, Rui and Sadallah, Abdelrahman and Grishchenkov, Kirill and Panchenko, Alexander and Baldwin, Timothy and Nakov, Preslav and P...

    2025 doi

  193. [201]

    2009 , publisher=

    Statistical machine translation , author=. 2009 , publisher=

    2009

  194. [202]

    2024 , note =

    OpenAI , title =. 2024 , note =

    2024

  195. [203]

    CHI Conference on Human Factors in Computing Systems Extended Abstracts , pages=

    Promptmaker: Prompt-based prototyping with large language models , author=. CHI Conference on Human Factors in Computing Systems Extended Abstracts , pages=

  196. [204]

    Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , pages=

    Why Johnny can’t prompt: how non-AI experts try (and fail) to design LLM prompts , author=. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems , pages=

    2023

  197. [205]

    Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity

    Lu, Yao and Bartolo, Max and Moore, Alastair and Riedel, Sebastian and Stenetorp, Pontus. Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics...

    2022 doi

  198. [206]

    International conference on machine learning , pages=

    Calibrate before use: Improving few-shot performance of language models , author=. International conference on machine learning , pages=. 2021 , organization=

    2021

  199. [207]

    arXiv preprint arXiv:1301.2774 , year=

    Crowd labeling: a survey , author=. arXiv preprint arXiv:1301.2774 , year=

    arXiv

  200. [208]

    and Araki, Jun and Neubig, Graham , title =

    Jiang, Zhengbao and Xu, Frank F. and Araki, Jun and Neubig, Graham , title =. Transactions of the Association for Computational Linguistics , volume =. 2020 , month =. doi:10.1162/tacl_a_00324 , url =

    2020 doi

  201. [209]

    URL https://arxiv

    Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing, 2021 , author=. URL https://arxiv. org/abs/2107.13586 , year=

    2021

  202. [210]

    and Wallace, Eric and Singh, Sameer

    Shin, Taylor and Razeghi, Yasaman and Logan IV, Robert L. and Wallace, Eric and Singh, Sameer. A uto P rompt: E liciting K nowledge from L anguage M odels with A utomatically G enerated P rompts. Proceedings of the 2020 Conference on Empirical Methods in Natural Language Proce...

    2020 doi

  203. [211]

    arXiv preprint arXiv:2402.02101 , year=

    Are Large Language Models Good Prompt Optimizers? , author=. arXiv preprint arXiv:2402.02101 , year=

  204. [212]

    arXiv preprint arXiv:2407.21783 , year=

    The llama 3 herd of models , author=. arXiv preprint arXiv:2407.21783 , year=

    arXiv

  205. [213]

    arXiv preprint arXiv:2303.08774 , year=

    Gpt-4 technical report , author=. arXiv preprint arXiv:2303.08774 , year=

    arXiv

  206. [214]

    arXiv preprint arXiv:2601.03267 , year=

    Openai gpt-5 system card , author=. arXiv preprint arXiv:2601.03267 , year=

    arXiv

  207. [215]

    arXiv preprint arXiv:2602.02276 , year=

    Kimi K2.5: Visual Agentic Intelligence , author=. arXiv preprint arXiv:2602.02276 , year=

    arXiv

  208. [216]

    DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence , author=

  209. [217]

    PACE : Improving Prompt with Actor-Critic Editing for Large Language Model

    Dong, Yihong and Luo, Kangcheng and Jiang, Xue and Jin, Zhi and Li, Ge. PACE : Improving Prompt with Actor-Critic Editing for Large Language Model. Findings of the Association for Computational Linguistics ACL 2024. 2024. doi:10.18653/v1/2024.findings-acl.436

    2024 doi

  210. [218]

    Challenging BIG -Bench Tasks and Whether Chain-of-Thought Can Solve Them

    Suzgun, Mirac and Scales, Nathan and Sch. Challenging BIG -Bench Tasks and Whether Chain-of-Thought Can Solve Them. Findings of the Association for Computational Linguistics: ACL 2023. 2023. doi:10.18653/v1/2023.findings-acl.824

    2023 doi

  211. [219]

    Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , month=nov, year=

    Chen, Yongchao and Arkin, Jacob and Hao, Yilun and Zhang, Yang and Roy, Nicholas and Fan, Chuchu , editor=. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing , month=nov, year=. doi:10.18653/v1/2024.emnlp-main.226 , pages=

    2024 doi

  212. [220]

    arXiv preprint arXiv:2404.01077 , year=

    Efficient Prompting Methods for Large Language Models: A Survey , author=. arXiv preprint arXiv:2404.01077 , year=

  213. [221]

    arXiv preprint arXiv:2402.07927 , year=

    A systematic survey of prompt engineering in large language models: Techniques and applications , author=. arXiv preprint arXiv:2402.07927 , year=

    arXiv

  214. [222]

    and Levy, Omer

    Honovich, Or and Shaham, Uri and Bowman, Samuel R. and Levy, Omer. Instruction Induction: From Few Examples to Natural Language Task Descriptions. Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). 2023. doi:10.1865...

    2023 doi

  215. [223]

    2024 , editor =

    Chen, Lichang and Chen, Jiuhai and Goldstein, Tom and Huang, Heng and Zhou, Tianyi , booktitle =. 2024 , editor =

    2024

  216. [224]

    2023 , url =

    Best Practices for Prompt Engineering with the OpenAI API , author =. 2023 , url =

    2023

  217. [225]

    Findings of the Association for Computational Linguistics: ACL 2025 , month=jul, year=

    Task Facet Learning: A Structured Approach To Prompt Optimization , author=. Findings of the Association for Computational Linguistics: ACL 2025 , month=jul, year=. doi:10.18653/v1/2025.findings-acl.1206 , pages=

    2025 doi

  218. [226]

    G o E motions: A Dataset of Fine-Grained Emotions

    Demszky, Dorottya and Movshovitz-Attias, Dana and Ko, Jeongwoo and Cowen, Alan and Nemade, Gaurav and Ravi, Sujith. G o E motions: A Dataset of Fine-Grained Emotions. Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 2020. doi:10.18653/v1...

    2020 doi

  219. [227]

    Advances in Neural Information Processing Systems , volume=

    Beavertails: Towards improved safety alignment of llm via a human-preference dataset , author=. Advances in Neural Information Processing Systems , volume=

  220. [228]

    Thirty-seventh Conference on Neural Information Processing Systems , year=

    Self-Refine: Iterative Refinement with Self-Feedback , author=. Thirty-seventh Conference on Neural Information Processing Systems , year=

  221. [229]

    LLML ingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression

    Pan, Zhuoshi and Wu, Qianhui and Jiang, Huiqiang and Xia, Menglin and Luo, Xufang and Zhang, Jue and Lin, Qingwei and R. LLML ingua-2: Data Distillation for Efficient and Faithful Task-Agnostic Prompt Compression. Findings of the Association for Computational Linguistics: ACL ...

    2024 doi

  222. [230]

    MORL -Prompt: An Empirical Analysis of Multi-Objective Reinforcement Learning for Discrete Prompt Optimization

    Jafari, Yasaman and Mekala, Dheeraj and Yu, Rose and Berg-Kirkpatrick, Taylor. MORL -Prompt: An Empirical Analysis of Multi-Objective Reinforcement Learning for Discrete Prompt Optimization. Findings of the Association for Computational Linguistics: EMNLP 2024. 2024. doi:10.18...

    2024 doi

  223. [231]

    Findings of the Association for Computational Linguistics: EMNLP 2023 , month = dec, year =

    Yang, Heng and Li, Ke , editor =. Findings of the Association for Computational Linguistics: EMNLP 2023 , month = dec, year =. doi:10.18653/v1/2023.findings-emnlp.907 , pages =

    2023 doi

  224. [232]

    The Thirteenth International Conference on Learning Representations , year=

    Pareto Prompt Optimization , author=. The Thirteenth International Conference on Learning Representations , year=

  225. [233]

    SCULPT : Systematic Tuning of Long Prompts

    Kumar, Shanu and Venkata, Akhila Yesantarao and Khandelwal, Shubhanshu and Santra, Bishal and Agrawal, Parag and Gupta, Manish. SCULPT : Systematic Tuning of Long Prompts. Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long P...

    2025 doi

  226. [234]

    RLP rompt: Optimizing Discrete Text Prompts with Reinforcement Learning

    Deng, Mingkai and Wang, Jianyu and Hsieh, Cheng-Ping and Wang, Yihan and Guo, Han and Shu, Tianmin and Song, Meng and Xing, Eric and Hu, Zhiting. RLP rompt: Optimizing Discrete Text Prompts with Reinforcement Learning. Proceedings of the 2022 Conference on Empirical Methods in...

    2022 doi

  227. [235]

    LLML ingua: Compressing Prompts for Accelerated Inference of Large Language Models

    Jiang, Huiqiang and Wu, Qianhui and Lin, Chin-Yew and Yang, Yuqing and Qiu, Lili. LLML ingua: Compressing Prompts for Accelerated Inference of Large Language Models. Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing. 2023. doi:10.18653/v1/2...

    2023 doi

  228. [236]

    Proceedings of the AAAI Conference on Artificial Intelligence , author=

    Prompt Compression with Context-Aware Sentence Encoding for Fast and Improved LLM Inference , volume=. Proceedings of the AAAI Conference on Artificial Intelligence , author=. 2025 , month=. doi:10.1609/aaai.v39i23.34639 , abstractNote=

    2025 doi

  229. [237]

    2001 , url=

    SPEA2: Improving the strength pareto evolutionary algorithm , author=. 2001 , url=

    2001

  230. [238]

    arXiv e-prints , keywords =

    SCOPE: A Generative Approach for LLM Prompt Compression. arXiv e-prints , keywords =. doi:10.48550/arXiv.2508.15813 , archivePrefix =. 2508.15813 , primaryClass =

    doi

  231. [239]

    IEEE transactions on evolutionary computation , volume=

    A fast and elitist multiobjective genetic algorithm: NSGA-II , author=. IEEE transactions on evolutionary computation , volume=. 2002 , publisher=

    2002

  232. [240]

    arXiv preprint arXiv:2508.01541 , year=

    MOPrompt: Multi-objective semantic evolutionary search for prompt optimization , author=. arXiv preprint arXiv:2508.01541 , year=

  233. [241]

    Proceedings of the 31st International Conference on Computational Linguistics , month = jan, year =

    Menchaca Resendiz, Yarik and Klinger, Roman , editor =. Proceedings of the 31st International Conference on Computational Linguistics , month = jan, year =

  234. [242]

    2026 , url=

    Lakshya A Agrawal and Shangyin Tan and Dilara Soylu and Noah Ziems and Rishi Khare and Krista Opsahl-Ong and Arnav Singhvi and Herumb Shandilya and Michael J Ryan and Meng Jiang and Christopher Potts and Koushik Sen and Alex Dimakis and Ion Stoica and Dan Klein and Matei Zahar...

    2026

  235. [243]

    2006 , publisher =

    Knowles, Joshua , journal =. 2006 , publisher =

    2006

  236. [244]

    arXiv preprint arXiv:0912.3995 , year=

    Gaussian process optimization in the bandit setting: No regret and experimental design , author=. arXiv preprint arXiv:0912.3995 , year=

    arXiv

  237. [245]

    Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement , url =

    Daulton, Samuel and Balandat, Maximilian and Bakshy, Eytan , booktitle =. Parallel Bayesian Optimization of Multiple Noisy Objectives with Expected Hypervolume Improvement , url =

  238. [246]

    Lingjiao Chen and Matei Zaharia and James Zou , journal=. Frugal. 2024 , url=

    2024

  239. [247]

    The Twelfth International Conference on Learning Representations , year=

    Large Language Model Cascades with Mixture of Thought Representations for Cost-Efficient Reasoning , author=. The Twelfth International Conference on Learning Representations , year=

  240. [248]

    Thirty-seventh Conference on Neural Information Processing Systems , year=

    Learning to Compress Prompts with Gist Tokens , author=. Thirty-seventh Conference on Neural Information Processing Systems , year=

  241. [249]

    IEEE transactions on Evolutionary Computation , volume=

    Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , author=. IEEE transactions on Evolutionary Computation , volume=. 1999 , publisher=

    1999

  242. [250]

    Journal of the American Statistical Association , volume =

    The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , author =. Journal of the American Statistical Association , volume =

  243. [251]

    1963 , school =

    Distribution-Free Multiple Comparisons , author =. 1963 , school =

    1963

  244. [252]

    and Zhang, Hao and Gonzalez, Joseph E

    Zheng, Lianmin and Chiang, Wei-Lin and Sheng, Ying and Zhuang, Siyuan and Wu, Zhanghao and Zhuang, Yonghao and Lin, Zi and Li, Zhuohan and Li, Dacheng and Xing, Eric P. and Zhang, Hao and Gonzalez, Joseph E. and Stoica, Ion , booktitle =. Judging. 2023 , eprint =

    2023

  245. [253]

    Liu, Yang and Iter, Dan and Xu, Yichong and Wang, Shuohang and Xu, Ruochen and Zhu, Chenguang , booktitle =

  246. [254]

    IEEE Transactions on Evolutionary Computation , volume =

    The Balance Between Proximity and Diversity in Multiobjective Evolutionary Algorithms , author =. IEEE Transactions on Evolutionary Computation , volume =

  247. [255]

    Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability , volume =

    Some Methods for Classification and Analysis of Multivariate Observations , author =. Proceedings of the Fifth Berkeley Symposium on Mathematical Statistics and Probability , volume =

  248. [256]

    Machine learning , volume=

    Finite-time analysis of the multiarmed bandit problem , author=. Machine learning , volume=. 2002 , publisher=

    2002

  249. [257]

    Structural optimization , volume=

    A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems , author=. Structural optimization , volume=. 1997 , publisher=

    1997

  250. [258]

    Theory of Computing Systems , volume=

    The Power of the Weighted Sum Scalarization for Approximating Multiobjective Optimization Problems , author=. Theory of Computing Systems , volume=. 2022 , publisher=

    2022

  251. [259]

    Structural and Multidisciplinary Optimization , volume=

    Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , author=. Structural and Multidisciplinary Optimization , volume=. 2006 , publisher=

    2006

  252. [260]

    Proceedings of the Fourth International Conference on Automated Machine Learning , pages =

    Zehle, Tom and Schlager, Moritz and Hei. Proceedings of the Fourth International Conference on Automated Machine Learning , pages =. 2025 , editor =

    2025

  253. [261]

    Theoretical computer science , volume=

    Clustering to minimize the maximum intercluster distance , author=. Theoretical computer science , volume=. 1985 , publisher=

    1985

  254. [262]

    Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , pages=

    A systematic survey of automatic prompt optimization techniques , author=. Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing , pages=

    2025

Pith tools

Reviewed June 28, 2026 · model on record in the stance chip above.