Pith. sign in

Paper Citation Record · LEDGER

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation

As of 22 August 2026, this Paper Citation Record lists 19 of 19 outbound references and 0 inbound Pith citation observations for arXiv:2608.12150.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2608.12150 v1

Coverage vector

measured 19 of 19 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-16T00:18:50.086913Z

measured 19 of 19 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-22T06:32:14.747728+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

19 of 19 outbound references displayed

  • verified exact0
  • verified fuzzy7
  • unresolved12
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 0dea97cf-8abb-437a-8120-c955be85be51 · outbound

This paper cites https://huggingface.co/spaces/ open-llm-leaderboard/open_llm_leaderboard, 2024.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation https://huggingface.co/spaces/ open-llm-leaderboard/open_llm_leaderboard, 2024

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.829918Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.657013Z digest=sha256:b883266a8ce1a6b75e449a65834a968de94b2b5aa1e9b22d436d6146f23084dd

Observation 5ad0a644-6e84-4b65-80a9-1322b1c03bc7 · outbound

This paper cites Zheng, W.-L.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Zheng, W.-L

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.815428Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.704929Z digest=sha256:3694167f77b2739e6eb120127613b62e362e75a2f17dfbdd0a2a8e0b01c26746

Observation 536d36c7-bfef-4e90-97bd-7d72d55656a5 · outbound

This paper cites Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:49.709956Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:49.709956Z digest=sha256:ac00c7bc31777eba2838622ae54e196e70a7712bcaa3f9483595902793cabf4d

Observation c3dd739a-aeb3-4437-a060-88b7febd0a4a · outbound

This paper cites s1: Simple test-time scaling.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation s1: Simple test-time scaling

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:49.716415Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:49.716415Z digest=sha256:34ac2fa1d790214963ad229f56cf480e6a1154bdc3751ecc12074357334cd47b

Observation 5ea49f83-3fae-4da2-b1a1-998c0e41162c · outbound

This paper cites L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:49.720819Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:49.720819Z digest=sha256:5aecacdc87be48eddf1e97dc40a0e74ffd3125519798624923eded13dddacc72

Observation d79702c8-f06e-4a3c-a576-9651e13b7384 · outbound

This paper cites an unresolved cited work.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:18:50.803383Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.759840Z digest=sha256:95eed36a64bc5b4ad771da812492fedc1da8958adb37e0d5048cacd7f717b21a

Observation e498d443-9e3e-45f7-a927-ad7c28a48a8d · outbound

This paper cites Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Do NOT Think That Much for 2+3=? On the Overthinking of o1-Like LLMs

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:49.891317Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:49.891317Z digest=sha256:c63aa13a5e4ade4d7dcb406df6d7084df31b0704cf3a66244774c29bc8b55afc

Observation 8cd91594-7f09-4944-b324-6eb660367e1f · outbound

This paper cites Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Stop Overthinking: A Survey on Efficient Reasoning for Large Language Models

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:49.931347Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:49.931347Z digest=sha256:0ebba17dd82fcb4fc262ea7400237a9da542f942f729398ae5578b7ae09939cb

Observation 2d0d2b13-a88e-4d3a-89dd-270da9efdbb9 · outbound

This paper cites Jiang, X.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Jiang, X

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.698253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.936693Z digest=sha256:ec1fc5d88348794a6e1bbd65013eab1e8fb99b07ed327d1138246eae9aea3a80

Observation 8f61801f-b8a2-4f98-ab82-c22190036b6b · outbound

This paper cites an unresolved cited work.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:18:50.627055Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.941605Z digest=sha256:dd8a564c96f5ca9f587f0cf2f2372794875dd2398e53ee895b44663639863f29

Observation ec991bd0-fbc5-4833-97ac-63935795d2ae · outbound

This paper cites Large Language Model Routing with Benchmark Datasets.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Large Language Model Routing with Benchmark Datasets

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:49.945835Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:49.945835Z digest=sha256:a69de0dd3acf19216c853632b5c2277a4e8b5bb2659cf7582e42e980c7844795

Observation fa6ba4b0-c9d7-4e5c-b243-9d499109e955 · outbound

This paper cites Sainz, J.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Sainz, J

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.612895Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.950012Z digest=sha256:5f7d6300f2c32399feb96417112908b2b8128b2d59567c27831de10f68a87161

Observation 88cb1400-986c-4244-875a-301ba6f6dfdf · outbound

This paper cites Kiela, M.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Kiela, M

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.487850Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:49.989031Z digest=sha256:df8307b02898af6844e28b068adac2eeff011490602e9ae7ea55dca8bc243a5c

Observation c18f1338-c13a-42fd-bed2-bc1918fb30b6 · outbound

This paper cites Liang, R.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Liang, R

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.403387Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:50.035374Z digest=sha256:0f8ec21f32958e1809c22c80622a09c4292e738156829f6be46923b02a5ae1fd

Observation 7389d241-19db-426f-939c-7094c0fa0cd4 · outbound

This paper cites The Llama 3 Herd of Models.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation The Llama 3 Herd of Models

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:50.067916Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:50.067916Z digest=sha256:fa750db9ff7282c0153d1174b89d2a0c7b8acd56540344b017d2b3753d952286

Observation 4cc8e97f-8871-4034-81f0-f792f387ee03 · outbound

This paper cites Qwen3 Technical Report.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Qwen3 Technical Report

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:50.073275Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:50.073275Z digest=sha256:725e3185f5859cb0703ff8c9e8cf17262a65a8a6b6719e373c7dfc7da26fb800

Observation 67ff05fd-52da-4cb8-a81a-0543ded28cbe · outbound

This paper cites Training Verifiers to Solve Math Word Problems.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Training Verifiers to Solve Math Word Problems

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-16T00:18:50.078456Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T00:18:50.078456Z digest=sha256:f655f74da8b22c08e2ce1ed05d1360660f28ad93f4397f18adc76eb27d6c71e1

Observation 5f559647-ba0d-4b24-bc0c-2a4b8bdd8261 · outbound

This paper cites Hendrycks, C.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Hendrycks, C

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-16T00:18:50.389590Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:50.083166Z digest=sha256:495c921d05bac55ac9806320c8bcfccc6b410a77b85386bde2f8cc34ec79fd03

Observation 1bc51b99-8f84-4b31-a19e-87015c853b95 · outbound

This paper cites an unresolved cited work.

Who Thinks Best Depends on How Long You Let Them: Budget-Dependent Rankings in LLM Evaluation Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-16T00:18:50.318791Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-22T06:32:14.747728+00:00.

source=pdf_text observed=2026-08-16T00:18:50.086913Z digest=sha256:6cf990963330f41b82c0b29163c9704e283944ebef01c15f7579b496f81a421f

Pith citing papers

No inbound Pith citation observations are available.