Pith. sign in

Paper Citation Record · LEDGER

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat

As of 23 August 2026, this Paper Citation Record lists 27 of 27 outbound references and 1 inbound Pith citation observation for arXiv:2607.17219.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.17219 v2

Coverage vector

measured 27 of 27 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-01T18:46:37.026793Z

measured 28 of 28 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-12T12:46:53.100299Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: pith, observed 2026-08-12T12:46:53.173164Z

Reference resolution

27 of 27 outbound references displayed

  • verified exact5
  • verified fuzzy0
  • unresolved21
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 72865db8-4102-4e3e-8a2a-bfc67b7568c4 · outbound

This paper cites an unresolved cited work.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Unresolved cited work

Reference 1

Resolution
verified exact
doi, observed 2026-08-01T18:49:06.428577Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-01T18:46:34.307789Z digest=sha256:364ad032ca2c015905b27936881d3fd0bd2f2e77a1d2d6788cd46d8838f734b7

Observation 6eed6a19-fd32-42fb-bcc7-6d7b26b0da1e · outbound

This paper cites Busemeyer.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Busemeyer

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:34.455792Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:34.455792Z digest=sha256:522e48169881f97b28b7d04770d7944b6497590b0d0fa9639108a332b553a409

Observation 095dd2ec-bd05-4da3-9024-3cec27c50fb7 · outbound

This paper cites Shiffrin, and Jerome R.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Shiffrin, and Jerome R

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:34.527287Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:34.527287Z digest=sha256:7b655a3e369a1261e4efd1cddb564859cfa30b4367b2e95348026e7b4e872a71

Observation 5e844b78-1df9-4ddf-8d9f-5ee58177b70b · outbound

This paper cites Do LLMs Exhibit Human-like Response Biases? A Case Study in Survey Design.Transactions of the Association for Computational Linguistics, 12:1011–1026, 2024.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Do LLMs Exhibit Human-like Response Biases? A Case Study in Survey Design.Transactions of the Association for Computational Linguistics, 12:1011–1026, 2024

Reference 4

Resolution
malformed identifier
no resolver link, observed 2026-08-01T18:46:34.647716Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:34.647716Z digest=sha256:06cb40c17d47fa8396abcd8fb776072c8807eba5a8a74378635514c701ba7937

Observation 7cba6d57-e5e9-47d4-8030-0b0daaeb2006 · outbound

This paper cites Prompt Perturbations Reveal Human- Like Biases in Large Language Model Survey Responses.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Prompt Perturbations Reveal Human- Like Biases in Large Language Model Survey Responses

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:34.748018Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:34.748018Z digest=sha256:51e2e1b068138cc64f2cbfb7dfcd1a5b8466a7dad1c7ec333c2c7b1325921b75

Observation ead485dd-6d62-40f0-9bd0-5cc48c6b7bda · outbound

This paper cites CAPE: Context-Aware Personality Evaluation Framework for Large Language Models.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat CAPE: Context-Aware Personality Evaluation Framework for Large Language Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:34.826288Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:34.826288Z digest=sha256:a1b1fc0ac1b883f5c659e98dbe74b92d18018b987d2229e91bd0c893933e6526

Observation 6173ee37-d147-4da8-9ff9-e9b0ac45e92b · outbound

This paper cites World Scientific, Singapore, 2023.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat World Scientific, Singapore, 2023

Reference 7

Resolution
verified exact
doi, observed 2026-08-01T18:49:06.206650Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-01T18:46:34.875639Z digest=sha256:550d2f194aeac5e0dec99c9c2d5c623b68d0eeb4218b894725cc4219cadbcaf7

Observation bb99bacd-99be-4ea5-b5eb-56c86db03b0c · outbound

This paper cites Clopper and Egon S.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Clopper and Egon S

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:34.971209Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:34.971209Z digest=sha256:56af547d2d88f9cd022a38fde070043b97c29a12853e8b0a5d593e2782bd0a25

Observation 606b2d85-a31e-4ab3-b4aa-74c1cf0eba95 · outbound

This paper cites Qwen3 Technical Report.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Qwen3 Technical Report

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.081107Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.081107Z digest=sha256:cd721bc05a5164d28a46fb9693c6c44deae6beca0488e710b3624424cd92d1c8

Observation 20bb8704-66db-4a3c-9497-71781c2dfa5a · outbound

This paper cites Modeling Combination of Question Order Ef- fect, Response Replicability Effect, and QQ-equality with Quantum Instruments.Jour- nal of Mathematical Psychology, 100:102491, 2021.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Modeling Combination of Question Order Ef- fect, Response Replicability Effect, and QQ-equality with Quantum Instruments.Jour- nal of Mathematical Psychology, 100:102491, 2021

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.198038Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.198038Z digest=sha256:bbda974f81d318d7e3cfeb292dca8494b70ff55c8562316a79d533c487bef209

Observation 4eb17d9c-78cf-4008-92a9-b542a9b34a72 · outbound

This paper cites Dzhafarov, Janne V.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Dzhafarov, Janne V

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.270909Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.270909Z digest=sha256:ffd7083e22edd03ae0ed5ba0c28a0260ea01c76936aec4ee68e1dfb19e7298da

Observation d92f599f-aed7-4084-9875-7d40ee7d83ec · outbound

This paper cites Kujala and Ehtibar N.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Kujala and Ehtibar N

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.338926Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.338926Z digest=sha256:4715a4059b8807d59dd64ce8a5286f38825eec0fe2f58689a8b740ea6aa9ed21

Observation 6580b37c-44f3-4d2b-9f51-08e9fe8386a0 · outbound

This paper cites Failure of contextual invariance in large language models.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Failure of contextual invariance in large language models

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.501968Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.501968Z digest=sha256:54f45f93d5a897784cee3f7d675e9938ddb28e1feb31aba0a59667498df86b08

Observation 06b72f33-f982-4fc5-bfac-d8623081113a · outbound

This paper cites Ontology-Amplified Distillation and Contextuality Auditing for Sovereign Enterprise Language Models: A Combined Proof-of-Mechanism and Negative-Results Method Study.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Ontology-Amplified Distillation and Contextuality Auditing for Sovereign Enterprise Language Models: A Combined Proof-of-Mechanism and Negative-Results Method Study

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.598857Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.598857Z digest=sha256:2cf7b4fe954a33ed0f625641cf50d3b8af5c4697cd548dcfa50d77cb5a9ecc6f

Observation b54b7c12-43ab-4ba0-aadd-34d3dc3c6d8f · outbound

This paper cites Pothos, and Andy J.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Pothos, and Andy J

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.658363Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.658363Z digest=sha256:ddf5244f1f4a4751cd83948484f7284a28616e6f4519cfa811b211357c22f89c

Observation 308f91e0-4a07-4962-af44-bacf9d26a11b · outbound

This paper cites Identifying Quantum Structure in AI Language: Evidence for Evolutionary Convergence of Human and Artificial Cognition.Entropy, 28(6):622, June 2026.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Identifying Quantum Structure in AI Language: Evidence for Evolutionary Convergence of Human and Artificial Cognition.Entropy, 28(6):622, June 2026

Reference 16

Resolution
verified exact
doi, observed 2026-08-01T18:49:05.784885Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-01T18:46:35.804373Z digest=sha256:c82de1a425faae2dd99ec25037afe590f3d5eb76c7215f7ebe71699990bdee23

Observation ac3f4a69-0916-48a3-ad2e-d418bded4603 · outbound

This paper cites Quantum-like Contextuality in Large Language Models.Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 481(2319):20240399, 08 2025.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Quantum-like Contextuality in Large Language Models.Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 481(2319):20240399, 08 2025

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.854295Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.854295Z digest=sha256:d6f0cba4946e0609574b8397b9a0b3c41063bc0413dc3051b541cf663b700389

Observation b34c65cd-9c66-49f6-8ef2-690c834dc45e · outbound

This paper cites Large Language Models Are Not Robust Multiple Choice Selectors.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Large Language Models Are Not Robust Multiple Choice Selectors

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:35.969545Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:35.969545Z digest=sha256:cc2a6edf8f703861179c00b922792b99b9097ece152d645dbdb2cc63aa7bdd04

Observation 16276c34-ae54-4be3-aee0-cb9e39ce40c2 · outbound

This paper cites Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questions

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:36.087029Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:36.087029Z digest=sha256:44e52d5d5f48c823318adad9b10b39f2102b6625529c49d4af5ca9afac0be0ba

Observation 6e21ec81-486b-4a28-9e44-1cdf2986e830 · outbound

This paper cites My Answer is C.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat My Answer is C

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:36.219532Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:36.219532Z digest=sha256:e06c099a07da198f3f8658d64817398bc98498c80fd969746b3c975bd873c8d7

Observation 8faac43d-3905-41eb-b012-ead3b6c53a89 · outbound

This paper cites doi: https://doi.org/10.1002/andp.19504430510.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat doi: https://doi.org/10.1002/andp.19504430510

Reference 21

Resolution
verified exact
doi, observed 2026-08-01T18:49:05.579506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-01T18:46:36.354808Z digest=sha256:e668c064a0eebed9d1bafd325dcaf79a83550e9138260ddac85a4ef8cd383dc8

Observation 3fe48403-5ceb-4ff2-bfe0-b6e414811e46 · outbound

This paper cites Understanding the Effects of RLHF on LLM Generalisation and Diversity.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Understanding the Effects of RLHF on LLM Generalisation and Diversity

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:36.524585Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:36.524585Z digest=sha256:d759d302472b1f3fab60e95523aa4f21d72f27f0ce0420870764b46f10d480ba

Observation cdfd5fe0-2719-4874-848c-b232d6f03ca7 · outbound

This paper cites Does Writing with Language Models Reduce Content Diversity? InThe Twelfth International Conference on Learning Representations, 2024.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Does Writing with Language Models Reduce Content Diversity? InThe Twelfth International Conference on Learning Representations, 2024

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:36.685765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:36.685765Z digest=sha256:f44b2df0fa9dbca505bcce817269a2414152ddc4f01f39e5dfd3526887f1b461

Observation 1ef0752a-3c3e-4d41-b77f-7b07b57234c1 · outbound

This paper cites Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedback

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:36.834492Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:36.834492Z digest=sha256:ee3f4949b3ce6a34a8c17ce896d5cbd4cf8436eeab5e9e3ae7b44362f966d58d

Observation 41bbb2ca-dda9-4c38-b863-28136d2ba42b · outbound

This paper cites Language Models (Mostly) Know What They Know.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat Language Models (Mostly) Know What They Know

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:37.026793Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:37.026793Z digest=sha256:205741174341c17d4ca15dc2dd412ca7c8346a374858b27681461bb0036a9626

Observation 3cfd1728-e85c-4007-992f-86025b34df53 · outbound

This paper cites doi: 10.18653/v1/2023.emnlp-main.330.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat doi: 10.18653/v1/2023.emnlp-main.330

Reference 2023

Resolution
unresolved
no resolver link, observed 2026-08-01T18:46:36.964269Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-01T18:46:36.964269Z digest=sha256:6ca2d0f92fb79e759e7feaa59302388de6d47dd0bb4c5ca7af82192addb1ecf9

Observation e7683258-7c37-461f-8aea-d995df8498c8 · outbound

This paper cites URL https://doi.org/10.1007/s10701-015-9964-8.

Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat URL https://doi.org/10.1007/s10701-015-9964-8

Reference 9516

Resolution
verified exact
doi, observed 2026-08-01T18:49:05.991924Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-01T18:46:35.395052Z digest=sha256:391c914bbd842d2cf1c96127e715cb5d7ad2966cabd27e843a641824798caa72

Pith citing papers

Observation 0541b972-0ad8-4244-a6f0-0bcfb7bddfc0 · inbound

What Iterated Self-Feeding Probes of Language Models Measure, and a test that separates the construction from the model cites this paper.

What Iterated Self-Feeding Probes of Language Models Measure, and a test that separates the construction from the model Auditing Question-Order Effects in Large Language Models with the QQ Equality: Mechanism Characterization and a Saturation Caveat

Reference 58

Resolution
verified exact
local_arxiv, observed 2026-08-12T12:46:53.180264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=arxiv_source observed=2026-08-12T12:46:53.100299Z digest=sha256:7b3d58b31c0db4f30449fb37b6adca652c818a2d9e074e40b0ed06ec2b785ad6