Pith. sign in

REVIEW 4 major objections 5 minor 1 cited by

LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment

T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash

Pith's one-line read LSAQ claims that Jaccard overlap between a layer's top-k input and output tokens is a better guide to which LLM layers can be safely quantized to INT4 than cosine similarity is.

desk verdict A simple, plausibly useful Jaccard-based layer importance metric for LLM quantization, but the paper's token-set justification is technically off and the evaluation is too thin to fully support the centrality claim. read the letter →

arxiv 2412.18135 v2 pith:TPBSD4SK submitted 2024-12-24 cs.CL

classification cs.CL
keywords largelanguagemodelspost-trainingquantizationlayerimportanceJaccardsimilaritymixed-precisionedgedeploymentLlamaperplexity
verification ladder T0 review T1 audit T2 compute T3 formal

The pith

A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.

The reading

This paper proposes that the layers of a large language model can be ranked by how little they change the model's most likely next-token vocabulary, measured by the Jaccard overlap between the top-k tokens before and after each layer. On that ranking, LSAQ assigns INT8 to high-importance layers and INT4 to low-importance layers, choosing the split from the GPU memory actually available. The paper reports that this allocation beats a cosine-similarity-based layer-wise quantizer at the same average bit-width on zero-shot tasks and WikiText2 perplexity across Llama-2-7B, Llama-2-13B, and Llama-3-8B. The intended payoff is that one model can be deployed at whatever precision fits the device, with the least harmful layers taking the compression.

What carries the argument

The machinery is the top-k token-set Jaccard importance metric (Equation 3), built from hidden states projected to vocabulary space through the embedding matrix. It treats each layer as a semantic transformation: decode input and output hidden states to their most probable tokens, count how much the token sets overlap, and invert that similarity into an importance score. This score feeds an allocation algorithm (Algorithm 1) that, given free GPU memory, maximizes the number of high-precision layers: full FP16 if memory allows, then INT8, then as many INT8 layers as memory allows with the least important layers dropped to INT4. Per-channel INT8/INT4 weight quantization is then applied to the chosen layers.

What would settle it

On Llama-2-7B, compute the Jaccard importance score for all 32 layers, quantize the 10 lowest-scoring layers to INT4 and the remaining 22 to INT8, and compare perplexity against quantizing 10 randomly chosen layers to INT4. The central claim is falsified if the random split matches or beats the Jaccard-based split, or if zeroing or heavily quantizing any high-overlap layer causes a large perplexity jump.

Watch

Extended reading notes

Core claim

The central claim is that semantic layer importance is better captured by token-set overlap than by cosine similarity of hidden states. For each layer, LSAQ projects the last-token hidden state at input and output through the embedding matrix, keeps the k most probable vocabulary tokens, and defines importance as $I_i = 1 - J(C_{i,\text{in}}, C_{i,\text{out}})$, where $J$ is the Jaccard similarity of the two top-k token sets. Layers whose input and output token sets overlap heavily are judged redundant and are quantized to INT4 first; layers whose token sets diverge are kept at INT8 or FP16. The paper argues that this ranking is more effective than cosine similarity, and supports it experimentally by showing better zero-shot accuracy and lower perplexity at 7-, 6-, and 5-bit average precision.

Load-bearing premise

The whole scheme assumes that a layer whose top-k most-likely tokens barely change from input to output is safe to compress hardest; if a layer preserves token identities while still computing probability shifts the model relies on, the importance ranking will be misleading.

Editorial extensions

If this is right

  • At the same average bit-width, LSAQ reports higher average zero-shot accuracy than the cosine-based LWQ baseline on most tasks and lower WikiText2 perplexity in most of the tested configurations.
  • The same quantized model can be reconfigured for different devices: for Llama-2-7B, 16GB keeps all 32 layers at FP16, 8GB fits all 32 at INT8, and 6GB fits 22 INT8 layers plus 10 INT4 layers.
  • Because the importance ranking is computed once offline, online deployment only requires reading available memory and selecting the corresponding INT8/INT4 split, which enables dynamic deployment to edge devices with different resources.
  • At 5-bit average precision, LSAQ stays within a few points of the 8-bit model on most zero-shot tasks, suggesting that heavily compressed deployments can preserve most of the model's capabilities.

Reading between the lines

Editorial extensions of the paper, not claims the author makes directly.

  • The Jaccard top-k ranking could be reused beyond quantization, for example to decide which layers to prune or which layers can be skipped in early-exit inference, since it identifies layers that barely change the model's output-token distribution; the paper does not test these uses.
  • A stronger version of the metric might compare full output distributions rather than top-k token sets, which would avoid the arbitrary choice of k but would be more expensive to compute.
  • The claim that a high-overlap layer is unimportant would be directly testable by comparing the Jaccard ranking against an oracle sensitivity ranking obtained by perturbing each layer; the paper does not report that comparison.
Share X Bluesky LinkedIn Reddit HN

Editorial analysis

A structured set of objections, weighed in public.

Desk editor's note, referee report, and a circularity audit.

Referee Report

4 major / 5 minor

Summary. The paper proposes LSAQ, a layer-specific adaptive quantization system for LLMs. Layer importance is estimated by projecting each layer's input and output hidden states through the input embedding matrix, taking the top-k tokens, and computing I_i = 1 - Jaccard(C_{i,in}, C_{i,out}); layers with higher importance receive higher precision. A resource-detection module and an allocation algorithm (Algorithm 1) then assign FP16, INT8, or INT4 per layer according to available GPU memory. Experiments on Llama-2-7B/13B and Llama-3-8B compare LSAQ against a cosine-similarity-based LWQ baseline on six zero-shot tasks and WikiText2 perplexity at 7/6/5 average bits, reporting small average accuracy gains and mostly lower perplexity.

Significance. If validated, LSAQ would be a simple and practical heuristic for mixed-precision deployment of LLMs on memory-constrained devices, with the useful property of adapting the quantization scheme to available resources. The paper's intended contribution is clear, and the deployment-oriented framing (offline planning plus online quantization) is sensible. However, the central claim that Jaccard token-set overlap is a more effective layer-importance metric than cosine similarity is not established by the current evidence: the metric is not validated against any per-layer sensitivity oracle, the token-set construction uses an unvalidated projection, and the empirical differences over the single baseline are small and unreplicated. The paper also ships no code or detailed configuration, which limits reproducibility. The idea is worth pursuing, but the current manuscript requires substantial additional validation.

major comments (4)
  1. [III-A, Equations (1)-(2)] The paper states that projecting hidden states through W_E^T and selecting the top-k indices yields 'the top-k most probable tokens' for the layer input and output. For Llama-2 and Llama-3, the output embedding (language modeling head) is not weight-tied with the input embedding matrix, so X_{i,in} · W_E^T is not the vocabulary logits distribution. The resulting sets are therefore not the model's top-k predicted tokens, and the semantic interpretation attached to the Jaccard metric is not justified. The authors should either use the actual language-model head for this projection, or explicitly reframe the construction as a heuristic similarity measure and validate it as such.
  2. [Equation (3) and IV.B.3] The load-bearing assumption is that a layer with high Jaccard overlap between its input and output top-k token sets is less important and can tolerate stronger quantization. This assumption is not validated. Jaccard set overlap discards all probability information inside the set: a layer could reorder or sharpen the probabilities among the same top-k tokens and still be critical for the final prediction, while Equation (3) would label it low-importance. The paper needs a direct validation of the importance ranking against a per-layer quantization-sensitivity oracle, for example by measuring the actual perplexity or zero-shot accuracy drop when each individual layer is quantized to INT4 and comparing that oracle ranking with the Jaccard ranking. Without such a test, the end-to-end results cannot confirm that the proposed metric is meaningfully better than cosine similarity or even than a random layer ordering.
  3. [IV.B, Tables I and III] The empirical evidence for the central claim is thin. The accuracy differences over the LWQ cosine baseline are typically 0.1–1.5 points on individual tasks, with no error bars, no repeated runs, and no significance tests; one perplexity comparison (Llama-3-8B at 7 bits) actually favors LWQ, which is acknowledged in IV.B.2 but conflicts with the abstract's 'consistently outperforms' wording. Since the only baseline is LWQ with cosine similarity, and both methods use the same quantization engine, the claimed superiority of the Jaccard metric rests on very small margins. The authors should add multiple seeds or calibration sets, report variance, and ideally include additional baselines (e.g., layer-importance by weight-outlier count, random layer ordering, and a sensitivity-oracle upper bound) to demonstrate that the chosen metric, not just the allocation procedure, drives the gains.
  4. [Algorithm 1] The allocation pseudocode is underspecified at a load-bearing point. Line 8 sets 'Mint8' to the difference between available memory and the memory required for INT4 precision, but the variable name suggests it should be the memory available for INT8 layers; the subsequent formula Nint4 = len - Mint8 / S8to4 should be derived explicitly with units (bytes vs. bits) and the memory overhead for activations or inference buffers should be stated. As written, the formula is not reproducible from the text.
minor comments (5)
  1. [IV.B.1] The claim of an advantage in '87.5% of individual tasks' should state the denominator explicitly (e.g., how many model-bit-width-task triples are compared) and clarify whether the 7-bit Llama-2-7B case, where both methods are identical, is included in the count.
  2. [Abstract and IV.B.2] The abstract says LSAQ 'consistently outperforms' the baselines, but the paper later reports a perplexity exception for Llama-3-8B at 7 bits; the wording should be tempered to match the actual results.
  3. [III.A] The sentence 'we transform this value by inversion and addition to obtain the importance metric' is unclear; Equation (3) simply defines I_i as 1 minus the Jaccard similarity, so the description should be rewritten to match the formula.
  4. [III.A] The choice of k is justified only by a citation to [25]; since k directly controls the size of the token sets and hence the granularity of the metric, a sensitivity analysis over k (even a small one) would strengthen the claim that the specific value has minimal impact.
  5. [General] The paper would benefit from a discussion of calibration data: the importance detection in Equations (1)-(2) requires input hidden states, but the text does not specify which dataset or how many samples are used to compute the layer importance, nor whether the results are stable across different calibration sets.

Circularity Check

0 steps flagged · score 0.0 of 10

No significant circularity: the layer-importance heuristic is self-contained and the end-to-end comparison is external, not fitted into the claim.

full rationale

The paper's derivation chain does not reduce to its own inputs. The layer-importance metric in Eq. (3) is a stated heuristic: it constructs top-k token sets from hidden states via Eqs. (1)-(2) and computes I_i = 1 - Jaccard(C_in, C_out). No parameter of the metric is fitted to the zero-shot or perplexity outcomes; the quantization allocation in Algorithm 1 consumes the metric as an input but does not reverse-engineer it from the reported accuracies. The comparison against LWQ is an external empirical benchmark using the same quantization machinery, so the central claim ('more effective than cosine similarity') is testable rather than guaranteed by construction. The only self-overlapping citation is [25] for the choice of k, and the paper explicitly states that 'the specific value chosen for k has minimal impact on the overall trend,' so it is not load-bearing. Concerns about whether W_E^T actually yields the model's output-token distribution are validity/correctness risks for the heuristic, not circularity: the metric is defined as stated and is not equivalent to the performance outcome by definition. Accordingly, no circular step is present.

Assumptions & free parameters 1 free parameters · 3 assumptions · 0 invented entities

The paper introduces no new entities. Its contributions are heuristic choices: k and the importance metric. These are not independently evidenced beyond the reported experiments, but they are not fitted to force the outcome.

free parameters (1)
  • k (top-k size for token sets) = not specified; cited to Li et al. [25]
    The number of most probable tokens selected from the projected hidden states to form the input and output sets. The paper states its value has minimal impact on the ranking because smaller k is a subset of larger k, but no exact value or sensitivity analysis is provided.
assumptions (3)
  • domain assumption Projecting hidden states through the input embedding matrix W_E yields a meaningful distribution over the vocabulary for each layer's output.
    Used in Section III-A to construct top-k token sets; assumes the embedding projection is a valid proxy for token-level semantics.
  • domain assumption Layer importance, as measured by token-set overlap, correlates with how much quantization harms the model.
    Central heuristic in Section III-A and III-C; without this, the allocation rule would have no basis.
  • standard math Standard linear algebra and set-theoretic operations are valid.
    Used throughout the method and experiments.

how reviews work

0 comments
Cite this review

Pith. "Pith review of LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment." pith.science (2026). https://pith.science/paper/TPBSD4SK

@misc{pith2026241218135,
  author       = {Pith},
  title        = {Pith review of: LSAQ: Layer-Specific Adaptive Quantization for Large Language Model Deployment},
  year         = {2026},
  howpublished = {\url{https://pith.science/paper/TPBSD4SK}},
  note         = {Machine review of arXiv:2412.18135}
}
read the original abstract

As Large Language Models (LLMs) demonstrate exceptional performance across various domains, deploying LLMs on edge devices has emerged as a new trend. Quantization techniques, which reduce the size and memory requirements of LLMs, are effective for deploying LLMs on resource-limited edge devices. However, existing one-size-fits-all quantization methods often fail to dynamically adjust the memory requirements of LLMs, limiting their applications to practical edge devices with various computation resources. To tackle this issue, we propose Layer-Specific Adaptive Quantization (LSAQ), a system for adaptive quantization and dynamic deployment of LLMs based on layer importance. Specifically, LSAQ evaluates the importance of LLMs' neural layers by constructing top-k token sets from the inputs and outputs of each layer and calculating their Jaccard similarity. Based on layer importance, our system adaptively adjusts quantization strategies in real time according to the computation resource of edge devices, which applies higher quantization precision to layers with higher importance, and vice versa. {Experimental results show that LSAQ consistently outperforms the selected quantization baselines in terms of perplexity and zero-shot tasks. Additionally, it can devise appropriate quantization schemes for different usage scenarios to facilitate the deployment of LLMs.

Figures

Figures reproduced from arXiv: 2412.18135 by the authors.

Figure 1
Figure 1. The framework of LSAQ. It is composed of offline and online parts. In the offline part, the importance of each layer of the LLM is first obtained, and the available GPU resources at the current moment are detected simultaneously. Based on this, a quantization strategy is meticulously formulated. Subsequently, this quantization strategy is transmitted to the online part, where the model is quantized according to this… view at source ↗
Figure 2
Figure 2. The process of constructing top-k token sets. In addition to using cosine similarity as a metric, Dumitru et al. [19] also estimate the layer importance by analyzing the number of weights significantly exceeding the average value within a layer. If a layer contains many weights with absolute values much larger than the average weight of that layer, it is likely to have a greater impact on the LLM’s output. By evalua… view at source ↗
Figure 3
Figure 3. Importance of LLMs layer. This observation indicates that a higher similarity between the two top-k token sets implies that the layer may have performed less significant semantic transformation on the input information. Consequently, it can be inferred that the layer’s contribution to semantic transformation is relatively low, leading to a lower assessment of its importance. Through [PITH_FULL_IMAGE:figures/full_fi… view at source ↗
Figures from the paper (1 more)
Figure 4
Figure 4. Figure 4: demonstrates the amount of memory required to load the weights of three LLMs at different quantization precisions. When these LLMs operate at FP16 precision, they require approximately 12.82GB, 24.36GB, and 15.14GB of memory, respectively. With the reduction of the ave…

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models

    cs.LG 2025-02 conditional novelty 6.0 of 10

    CE-LoRA accelerates LoRA fine-tuning by approximating the dense activation-gradient matrix multiply with selected rows and columns and a frozen low-rank correction, reporting up to 3.39x faster backward passes with ne...

Reference graph

Works this paper leans on

32 extracted references · 1 canonical work pages · cited by 1 Pith paper

  1. [1]

    Large language models meet nlp: A survey,

    L. Qin, Q. Chen, X. Feng, Y . Wu, Y . Zhang, Y . Li, M. Li, W. Che, and P. S. Yu, “Large language models meet nlp: A survey,” 2024. [Online]. Available: https://arxiv.org/abs/2405.12819

  2. [2]

    A survey on large language models for code generation,

    J. Jiang, F. Wang, J. Shen, S. Kim, and S. Kim, “A survey on large language models for code generation,” 2024. [Online]. Available: https://arxiv.org/abs/2406.00515

  3. [3]

    Model editing for llms4code: How far are we?

    X. Li, S. Wang, S. Li, J. Ma, J. Yu, X. Liu, J. Wang, B. Ji, and W. Zhang, “Model editing for llms4code: How far are we?” 2024. [Online]. Available: https://arxiv.org/abs/2411.06638

  4. [4]

    Revolutionizing finance with llms: An overview of applications and insights,

    H. Zhao, Z. Liu, Z. Wu, Y . Li, T. Yang, P. Shu, S. Xu, H. Dai, L. Zhao, G. Mai et al. , “Revolutionizing finance with llms: An overview of applications and insights,” arXiv preprint arXiv:2401.11641 , 2024

  5. [5]

    Large language models for education: A survey and outlook,

    S. Wang, T. Xu, H. Li, C. Zhang, J. Liang, J. Tang, P. S. Yu, and Q. Wen, “Large language models for education: A survey and outlook,” arXiv preprint arXiv:2403.18105 , 2024

  6. [6]

    Llm-rec: Personalized recommendation via prompting large language models,

    H. Lyu, S. Jiang, H. Zeng, Y . Xia, Q. Wang, S. Zhang, R. Chen, C. Leung, J. Tang, and J. Luo, “Llm-rec: Personalized recommendation via prompting large language models,”arXiv preprint arXiv:2307.15780, 2023

  7. [7]

    Llama 2: Open foundation and fine-tuned chat models,

    H. Touvron, L. Martin, K. Stone, P. Albert, A. Almahairi, Y . Babaei, N. Bashlykov, S. Batra, P. Bhargava, S. Bhosale et al. , “Llama 2: Open foundation and fine-tuned chat models,” arXiv preprint arXiv:2307.09288, 2023

  8. [8]

    Gptq: Accurate post-training quantization for generative pre-trained transformers,

    E. Frantar, S. Ashkboos, T. Hoefler, and D. Alistarh, “Gptq: Accurate post-training quantization for generative pre-trained transformers,” arXiv preprint arXiv:2210.17323, 2022

Show all 32 references
  1. [9]

    Llm.int8(): 8-bit matrix multiplication for transformers at scale,

    T. Dettmers, M. Lewis, Y . Belkada, and L. Zettlemoyer, “Llm.int8(): 8-bit matrix multiplication for transformers at scale,” 2022. [Online]. Available: https://arxiv.org/abs/2208.07339

  2. [10]

    Duquant: Distributing outliers via dual transformation makes stronger quantized llms,

    H. Lin, H. Xu, Y . Wu, J. Cui, Y . Zhang, L. Mou, L. Song, Z. Sun, and Y . Wei, “Duquant: Distributing outliers via dual transformation makes stronger quantized llms,” 2024. [Online]. Available: https://arxiv.org/abs/2406.01721

  3. [11]

    Llm-pruner: On the structural pruning of large language models,

    X. Ma, G. Fang, and X. Wang, “Llm-pruner: On the structural pruning of large language models,” Advances in neural information processing systems, vol. 36, pp. 21 702–21 720, 2023

  4. [12]

    Sparsegpt: Massive language models can be accurately pruned in one-shot,

    E. Frantar and D. Alistarh, “Sparsegpt: Massive language models can be accurately pruned in one-shot,” in International Conference on Machine Learning. PMLR, 2023, pp. 10 323–10 337

  5. [13]

    Laco: Large language model pruning via layer collapse,

    Y . Yang, Z. Cao, and H. Zhao, “Laco: Large language model pruning via layer collapse,” 2024. [Online]. Available: https://arxiv.org/abs/ 2402.11187

  6. [14]

    Minillm: Knowledge distillation of large language models,

    Y . Gu, L. Dong, F. Wei, and M. Huang, “Minillm: Knowledge distillation of large language models,” in The Twelfth International Conference on Learning Representations, 2024

  7. [15]

    In-context learning dis- tillation: Transferring few-shot learning ability of pre-trained language models,

    Y . Huang, Y . Chen, Z. Yu, and K. McKeown, “In-context learning dis- tillation: Transferring few-shot learning ability of pre-trained language models,” arXiv preprint arXiv:2212.10670 , 2022

  8. [16]

    Tensorgpt: Efficient compression of the embedding layer in llms based on the tensor-train decomposition,

    M. Xu, Y . L. Xu, and D. P. Mandic, “Tensorgpt: Efficient compression of the embedding layer in llms based on the tensor-train decomposition,” arXiv preprint arXiv:2307.00526 , 2023

  9. [17]

    Omniquant: Omnidirectionally calibrated quantization for large language models,

    W. Shao, M. Chen, Z. Zhang, P. Xu, L. Zhao, Z. Li, K. Zhang, P. Gao, Y . Qiao, and P. Luo, “Omniquant: Omnidirectionally calibrated quantization for large language models,” 2024. [Online]. Available: https://arxiv.org/abs/2308.13137

  10. [18]

    Shortgpt: Layers in large language models are more redundant than you expect,

    X. Men, M. Xu, Q. Zhang, B. Wang, H. Lin, Y . Lu, X. Han, and W. Chen, “Shortgpt: Layers in large language models are more redundant than you expect,” arXiv preprint arXiv:2403.03853 , 2024

  11. [19]

    Layer-wise quantization: A pragmatic and effective method for quantizing llms beyond integer bit-levels,

    R.-G. Dumitru, V . Yadav, R. Maheshwary, P.-I. Clotan, S. T. Mad- husudhan, and M. Surdeanu, “Layer-wise quantization: A pragmatic and effective method for quantizing llms beyond integer bit-levels,” arXiv preprint arXiv:2406.17415, 2024

  12. [20]

    Pointer sentinel mixture models,

    S. Merity, C. Xiong, J. Bradbury, and R. Socher, “Pointer sentinel mixture models,” arXiv preprint arXiv:1609.07843 , 2016

  13. [21]

    Zeroquant: Efficient and affordable post-training quantization for large- scale transformers,

    Z. Yao, R. Yazdani Aminabadi, M. Zhang, X. Wu, C. Li, and Y . He, “Zeroquant: Efficient and affordable post-training quantization for large- scale transformers,” Advances in Neural Information Processing Sys- tems, vol. 35, pp. 27 168–27 183, 2022

  14. [22]

    Smoothquant: Accurate and efficient post-training quantization for large language models,

    G. Xiao, J. Lin, M. Seznec, H. Wu, J. Demouth, and S. Han, “Smoothquant: Accurate and efficient post-training quantization for large language models,” in International Conference on Machine Learning . PMLR, 2023, pp. 38 087–38 099

  15. [23]

    Awq: Activation-aware weight quanti- zation for on-device llm compression and acceleration,

    J. Lin, J. Tang, H. Tang, S. Yang, W.-M. Chen, W.-C. Wang, G. Xiao, X. Dang, C. Gan, and S. Han, “Awq: Activation-aware weight quanti- zation for on-device llm compression and acceleration,” Proceedings of Machine Learning and Systems , vol. 6, pp. 87–100, 2024

  16. [24]

    Change is the only constant: Dynamic llm slicing based on layer redundancy,

    R.-G. Dumitru, P.-I. Clotan, V . Yadav, D. Peteleaza, and M. Surdeanu, “Change is the only constant: Dynamic llm slicing based on layer redundancy,” arXiv preprint arXiv:2411.03513 , 2024

  17. [25]

    Pmet: Precise model editing in a transformer,

    X. Li, S. Li, S. Song, J. Yang, J. Ma, and J. Yu, “Pmet: Precise model editing in a transformer,” in Proceedings of the AAAI Conference on Artificial Intelligence, vol. 38, no. 17, 2024, pp. 18 564–18 572

  18. [26]

    Using of jaccard coefficient for keywords similarity,

    S. Niwattanakul, J. Singthongchai, E. Naenudorn, and S. Wanapu, “Using of jaccard coefficient for keywords similarity,” in Proceedings of the international multiconference of engineers and computer scientists , vol. 1, no. 6, 2013, pp. 380–384

  19. [27]

    The llama 3 herd of models,

    A. Dubey, A. Jauhri, A. Pandey, A. Kadian, A. Al-Dahle, A. Letman, A. Mathur, A. Schelten, A. Yang, A. Fan et al. , “The llama 3 herd of models,” arXiv preprint arXiv:2407.21783 , 2024

  20. [28]

    Piqa: Reasoning about physical commonsense in natural language,

    Y . Bisk, R. Zellers, J. Gao, Y . Choi et al. , “Piqa: Reasoning about physical commonsense in natural language,” in Proceedings of the AAAI conference on artificial intelligence , vol. 34, no. 05, 2020, pp. 7432– 7439

  21. [29]

    Think you have solved question answering? try arc, the ai2 reasoning challenge,

    P. Clark, I. Cowhey, O. Etzioni, T. Khot, A. Sabharwal, C. Schoenick, and O. Tafjord, “Think you have solved question answering? try arc, the ai2 reasoning challenge,” arXiv preprint arXiv:1803.05457 , 2018

  22. [30]

    Boolq: Exploring the surprising difficulty of natural yes/no questions,

    C. Clark, K. Lee, M.-W. Chang, T. Kwiatkowski, M. Collins, and K. Toutanova, “Boolq: Exploring the surprising difficulty of natural yes/no questions,” arXiv preprint arXiv:1905.10044 , 2019

  23. [31]

    Hel- laswag: Can a machine really finish your sentence?

    R. Zellers, A. Holtzman, Y . Bisk, A. Farhadi, and Y . Choi, “Hel- laswag: Can a machine really finish your sentence?” arXiv preprint arXiv:1905.07830, 2019

  24. [32]

    Winogrande: An adversarial winograd schema challenge at scale,

    K. Sakaguchi, R. L. Bras, C. Bhagavatula, and Y . Choi, “Winogrande: An adversarial winograd schema challenge at scale,” Communications of the ACM , vol. 64, no. 9, pp. 99–106, 2021

Pith tools

Reviewed August 11, 2026 · model on record in the stance chip above.