Pith. sign in

Paper Citation Record · LEDGER

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals

As of 8 August 2026, this Paper Citation Record lists 20 of 20 outbound references and 0 inbound Pith citation observations for arXiv:2505.14597.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.14597 v1

Coverage vector

measured 20 of 20 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:36:04.013632Z

measured 20 of 20 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-08T06:32:00.761636+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

20 of 20 outbound references displayed

  • verified exact0
  • verified fuzzy12
  • unresolved8
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 40acdc18-3ae6-41de-85e3-11e4ebb91c73 · outbound

This paper cites Given a string consisting of three letters ’abc’ in any order, can ’abc’ appear after swapping any two characters at most once?.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Given a string consisting of three letters ’abc’ in any order, can ’abc’ appear after swapping any two characters at most once?

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:05.002398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:02.509269Z digest=sha256:81cd48e01df6116fed51267d37369fb006857a9c73cf7f701aadf3c713cae469

Observation bfb0e8d5-4734-4ff2-8b54-8a3e0d6aeab5 · outbound

This paper cites OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:01.982429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:01.982429Z digest=sha256:f5ae92f8450efcd1e0fc16dfa7d732c55798cbbad65b3ef095a5938c1adc58cd

Observation bcc6c9f0-14bc-47fe-b86b-9bfe64d38457 · outbound

This paper cites Qwen2.5 Technical Report.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Qwen2.5 Technical Report

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:02.123222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:02.123222Z digest=sha256:b7541e2bff1d9ed48735314c7e1df72715d36f0eb7d3ef25302497e042f043ca

Observation b058e484-e7c4-4592-b354-6547f6154de9 · outbound

This paper cites DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals DolphCoder: Echo-Locating Code Large Language Models with Diverse and Multi-Objective Instruction Tuning

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:02.257975Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:02.257975Z digest=sha256:723569d1141c8efd15d4fcf77be9fe6a3e1ae8ac61cfa568f5e4d5c6b3e342f9

Observation 75da96c6-1cab-4bb0-ab97-177cad38b227 · outbound

This paper cites DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-07T15:36:02.357541Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:36:02.357541Z digest=sha256:9f29da08df9843dbac97780d2009ea0132415b69f434405f2b4b1f6e92d0bb60

Observation 5244f18a-f846-4155-9187-169eabc9ee14 · outbound

This paper cites If there are errors in the Sample Input/Output or in the Test Cases , correct them.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals If there are errors in the Sample Input/Output or in the Test Cases , correct them

Reference 7

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.983196Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:02.605549Z digest=sha256:63c6f680beb9da4644833d71d91e441b3a3eb10510a5d8012118fbef65de51b6

Observation 5d821b14-d9ad-40d4-9513-ea9125f45084 · outbound

This paper cites any substring can be reversed.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals any substring can be reversed

Reference 8

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.965264Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:02.673372Z digest=sha256:a28fdfa84801839a261b866df4d386970b6793932f905f02a71d2ece5fd80728

Observation 80ae524a-cb00-425b-9970-7d641dca56f7 · outbound

This paper cites YES" if it is possible, and.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals YES" if it is possible, and

Reference 9

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.947355Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:02.752000Z digest=sha256:6ceb61f9500e5216be43263ce956b6f4605c719f5a703f97a93a1941fb30cf11

Observation a2c9eae4-788b-4e53-b76e-ca512d78f8ae · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.928662Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:02.878731Z digest=sha256:2acbb385484e4a3e83f24413fe8bb8a25e279e0fb2d4f523a808d2e4a356e4f5

Observation 0dbb3029-7aa3-4920-8a6a-fd7934dc97c3 · outbound

This paper cites **The modification should be slight but cause a substantial change in the solution approach**.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals **The modification should be slight but cause a substantial change in the solution approach**

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.912357Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:02.963580Z digest=sha256:256aaf3ce2382ce93c8099b3a0df1333a3e0414fb889a9500466a75cdb193202

Observation cab61e97-2839-416b-acea-2d96fea3801c · outbound

This paper cites Ask yourself: Would it change data structures or algorithms? Explain the influence before output the counterfactual problem.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Ask yourself: Would it change data structures or algorithms? Explain the influence before output the counterfactual problem

Reference 12

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.895731Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.072577Z digest=sha256:af7510d2c2e05d0b3f9d71d8c509ae5cc26b4ad7219e5a10ec7083ceb88ef922

Observation 444eb4aa-0ec1-4a71-9b2d-bc7cd6da07b1 · outbound

This paper cites The modified problem must be consistent, clear, and requires a significantly different solution approach.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals The modified problem must be consistent, clear, and requires a significantly different solution approach

Reference 13

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.879583Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.144101Z digest=sha256:b2ebfe59fc9c044dd3abc07ebae61c02efa99abb1e9a455503ff65a6ca04cca3

Observation 229d927b-7d81-446b-ab80-864a61d7b990 · outbound

This paper cites ###Counterfactual Problem.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals ###Counterfactual Problem

Reference 14

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.863080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.251867Z digest=sha256:9e386d45b9691ef1d3ff803a0fad9fd4eecaa6348257b1fa9469322f85b93ac1

Observation 8300915f-4c68-4f17-b32f-a82c332590fd · outbound

This paper cites The difference will be assessed through evaluated by the Rouge score, indicating the high similarity in wording, sentence structure, and length to the original.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals The difference will be assessed through evaluated by the Rouge score, indicating the high similarity in wording, sentence structure, and length to the original

Reference 15

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.844973Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.341933Z digest=sha256:f3f8d21f76f9d9330fad5502be56002ba45e05db1f39b23dac06d9741126a051

Observation f92a8757-784e-45e8-a708-7284f93d2e7a · outbound

This paper cites Do not make trivial changes like adding or removing a word, changing the order of words, or replacing synonyms.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Do not make trivial changes like adding or removing a word, changing the order of words, or replacing synonyms

Reference 16

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.824837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.450520Z digest=sha256:6642d9840860790400cfa4903811de3d2bd4f6950ce18acb2b120e068d138490

Observation 49d357bf-340e-4212-a95d-9d86425c82cc · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 17

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.803578Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.511775Z digest=sha256:c00ec768701bd23501a9c9ff36850737af095ea33db80aea45bc170712635545

Observation c2cbab0b-1fda-4c90-a5cb-91a861ffbde2 · outbound

This paper cites Change every aspect of the code, including the function name, variable names.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Change every aspect of the code, including the function name, variable names

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.786127Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.596017Z digest=sha256:0a8b83ad79441558f4cace9e127dd65e7c8839f8da68db0536df4bc0ff026da2

Observation 84996287-8ec0-4471-84a2-16a06cee2cb2 · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.681708Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.728800Z digest=sha256:6ea72d4769d71961cc248bfc32e64c0e6dd1f20f1c1361aaa8d4c7e579b6ecdb

Observation 09fd4e6e-a227-480a-9177-68f00f819cda · outbound

This paper cites an unresolved cited work.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:36:04.532016Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:03.893320Z digest=sha256:aa4a8cfab9ef3048178cc12eab4407f083f1d1d8ea4aa9c1f61cc0c8519483c1

Observation 8d4bd803-07bf-413f-b8e9-352581f138c0 · outbound

This paper cites ## Examples: {seeds} ## Question: - Original_Sample: Figure 16: The prompt used to generate CTF-Instruct data.

Success is in the Details: Evaluate and Enhance Details Sensitivity of Code LLMs through Counterfactuals ## Examples: {seeds} ## Question: - Original_Sample: Figure 16: The prompt used to generate CTF-Instruct data

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:36:04.308762Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-08T06:32:00.761636+00:00.

source=pdf_text observed=2026-08-07T15:36:04.013632Z digest=sha256:f673ab2ebf427766949e38c34923d19f28860ac5659cd6dd6b1446e5be57d34a

Pith citing papers

No inbound Pith citation observations are available.