Pith. sign in

Paper Citation Record · LEDGER

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks

As of 18 August 2026, this Paper Citation Record lists 30 of 30 outbound references and 0 inbound Pith citation observations for arXiv:2506.20938.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2506.20938 v2

Coverage vector

measured 30 of 30 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-06T22:43:51.670221Z

measured 30 of 30 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-18T06:34:40.430872+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

30 of 30 outbound references displayed

  • verified exact3
  • verified fuzzy8
  • unresolved19
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 841ca845-a418-4cd1-8e28-d22336d2dbb4 · outbound

This paper cites Llama 3.3 Model Card and Prompt Format.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Llama 3.3 Model Card and Prompt Format

Reference 1

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:55.474269Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.639271Z digest=sha256:ec5a7afcd0d60e3cc65a141a6a763a87f1e2115720e09ee6b56a9581d6b7f42e

Observation 33698bf7-3e7f-4914-86a8-4b31f61bfacf · outbound

This paper cites QwQ: Reflect Deeply on the Boundaries of the Unknown.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks QwQ: Reflect Deeply on the Boundaries of the Unknown

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:55.310183Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.705891Z digest=sha256:026afa8c62b2532b69e88ef79ab27aaa0601d0fa569d7fca7cde03b337a3f1fc

Observation 503843b7-6e60-4eb7-a251-0384227857db · outbound

This paper cites o3 and o4-mini System Card.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks o3 and o4-mini System Card

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:55.154081Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.755156Z digest=sha256:ee0e7776222ddc0e7347afbef6e484063dfdb85591a2a434d01a69c96656f984

Observation e7c88d72-de0c-431f-90a8-9f6fc5ea56d7 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 4

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:55.024775Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.824417Z digest=sha256:de17db6081c9b4635c9eaf25316b853f3ff1417394fbc3132816b739cfe609af

Observation fe4b6679-f2af-48d3-9af5-602aeae78c10 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.857080Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.877645Z digest=sha256:9088e9f8afdc7b0a7e7d631e96eb831575046d40c767203547f3d2e6f4834b0b

Observation c51e9fe1-b6e5-4728-b573-1d5c08c30832 · outbound

This paper cites Davis, Pranav Sivaraman, Joy Kitson, Konstantinos Parasyris, Harshitha Menon, Isaac Minn, Giorgis Georgakoudis, and Abhinav Bhatele.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Davis, Pranav Sivaraman, Joy Kitson, Konstantinos Parasyris, Harshitha Menon, Isaac Minn, Giorgis Georgakoudis, and Abhinav Bhatele

Reference 6

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:54.709734Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.932225Z digest=sha256:ce0d36c353a5ab98fdb537845abd41ac7b92c128f13ca44a752d686130ef2885

Observation 8600b02a-9010-4fc6-8e68-26a6e04a8c80 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.555505Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:49.996355Z digest=sha256:441e4efef9f59ca9a26f54fc2b33718c3d73bf5961fa7272e1d4a2d4f04bf836

Observation 7496726f-d371-44a5-87f5-38e847e17f4c · outbound

This paper cites DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.061336Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.061336Z digest=sha256:c23eb2ff211f07bd578c5c0c44376b8b273b5167f0e8d7429dc65ca7a1a79c61

Observation 2a269638-e603-4dcb-a438-5ecae533e38d · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 9

Resolution
verified exact
raw_fallback, observed 2026-08-06T22:43:52.531527Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.128126Z digest=sha256:65a6dd797bfeb69338148d6328024fba791c489e9cd16270df4f2661e47ccfc1

Observation e6ad57c8-4000-4993-98f8-6deb4d45b694 · outbound

This paper cites 2024.The Llama 3 Herd of Models.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks 2024.The Llama 3 Herd of Models

Reference 10

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:54.420107Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.192077Z digest=sha256:8cfa22e67e2eb042f622eae28ec54937fcb846d1c26d90635de232337cb0a487

Observation 56e678ba-ad4b-47b8-9b51-8f3d4341cdc0 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.244187Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.244187Z digest=sha256:04449bbea50a40c5d37f86f895fcede2c08252e3061001f108ab36514cd8b845

Observation 6118fa1c-1ffd-46d9-a43e-e46b36b07a54 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.241180Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.305104Z digest=sha256:246643b4a1285ea2b306f5b06b63173a2b72ba9ddd087a524cc8e643268ec9ff

Observation 1be5578c-08eb-415e-8bc2-1b6ee6c408d7 · outbound

This paper cites AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks AlphaTrans: A Neuro-Symbolic Compositional Approach for Repository-Level Code Translation and Validation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.356264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.356264Z digest=sha256:10c0e5e6f5d725684cf57b798f9ffffc5ac2f65131a4477c5a13b665527536ce

Observation e2127d97-5b1f-4164-ad47-2fdd96525e6b · outbound

This paper cites Creating a Dataset for High-Performance Computing Code Translation using LLMs: A Bridge Between OpenMP Fortran and C++.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Creating a Dataset for High-Performance Computing Code Translation using LLMs: A Bridge Between OpenMP Fortran and C++

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.410301Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.410301Z digest=sha256:8ffade025a0cdbde2cb79016fb98a8014b70d327358d30abaf950e78072a3c1c

Observation 6e7a7b10-5c13-48ad-bd6e-aa10a900bd87 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:54.058996Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.499419Z digest=sha256:87c06fc7b0923f5387aad60bb2c534455620aef7b8d87513a1304a231c37964e

Observation 1f5edbc7-a56f-41b3-b708-6a31e7f09cd5 · outbound

This paper cites Efficient Estimation of Word Representations in Vector Space.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Efficient Estimation of Word Representations in Vector Space

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.551019Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.551019Z digest=sha256:c920c38ad785315ca0724056965f1809d49a73dc7bf7f05465091e4c4555a6ab

Observation 3adc42ec-f295-4063-8eca-ff3595151def · outbound

This paper cites LLM4VV: Developing LLM-Driven Testsuite for Compiler Validation.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks LLM4VV: Developing LLM-Driven Testsuite for Compiler Validation

Reference 17

Resolution
verified exact
local_arxiv, observed 2026-08-06T22:43:52.247106Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.604016Z digest=sha256:c4af8e03b396ddc7b75619a990c57779db649f9c2ec41834335d2d1834fd91a8

Observation 8bd00500-5a89-4849-bd70-7d788f66dff9 · outbound

This paper cites Davis, Zhaojun Xie, Arjun Rajaram, and Abhinav Bhatele.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Davis, Zhaojun Xie, Arjun Rajaram, and Abhinav Bhatele

Reference 18

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:53.892742Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.653934Z digest=sha256:2e344c7b1a605e711fbaa05bfe106357caede06b8be5af36ef72725d5667cca4

Observation 42933a52-274f-4cd5-a852-0a8d3f0d6319 · outbound

This paper cites GPT-4o System Card.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks GPT-4o System Card

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.739906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.739906Z digest=sha256:d26aef705e527ca8876521720d79fd4309f582eab67a15dc1a6cdb6858321914

Observation 92126a03-1bd1-458b-8a96-feef41081b64 · outbound

This paper cites OpenMP Application Program Interface.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks OpenMP Application Program Interface

Reference 20

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:53.709049Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.793514Z digest=sha256:fb48c235572b91a70a64dfa98a8738490fdf6402d4dde7d620d28f412d06e6c4

Observation c2713b67-37ac-4205-8d28-031ac6eaedf9 · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Gemini: A Family of Highly Capable Multimodal Models

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:50.865671Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:50.865671Z digest=sha256:6d21652416acf695be8ca6d2fe1d24aa1533244dca0b3c30071fe183f8342a99

Observation bff33345-ab52-4632-a3f2-2cbb9785c1a6 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 22

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:53.508715Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:50.943723Z digest=sha256:97d1d6376291fa0f0bb551a4432860e807aaef9d7cd77ab5261f038b64cb0745

Observation b84857ed-94cd-450d-95a6-ecd82e61bd2d · outbound

This paper cites Tramm, Geoffrey Gunow, Tim He, Kord S.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Tramm, Geoffrey Gunow, Tim He, Kord S

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-06T22:43:53.312669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:51.019395Z digest=sha256:cb0d23053241ab420f3b5ab4ab29fc49b585efe49a07d772a4e0fdb81c8f7d7f

Observation 099fdc7a-0be5-4633-a44d-dcd5bde88628 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 24

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:53.128108Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:51.182317Z digest=sha256:60066d8e8df012a809a57fc18c8f01b8f6fef91009e564c018e0d0638b4c5685

Observation 8b57d7cd-86c3-4d55-9a75-a492d5e931ba · outbound

This paper cites Trott, Damien Lebrun-Grandié, Daniel Arndt, Jan Ciesko, Vinh Dang, Nathan Ellingwood, Rahulkumar Gayatri, Evan Harvey, Daisy S.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Trott, Damien Lebrun-Grandié, Daniel Arndt, Jan Ciesko, Vinh Dang, Nathan Ellingwood, Rahulkumar Gayatri, Evan Harvey, Daisy S

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:51.291366Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:51.291366Z digest=sha256:32598ea0cb4587d72eafef56e874d15ef28d91b92296c5583e4c856ecfaef04b

Observation e295de9a-ee80-4191-88b0-04a65f5ebe9e · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:52.930565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:51.398502Z digest=sha256:32a005af1178ddc49dd79a4f56cdc60b9a2b22d350c23bbbcfb807ea3f29ee92

Observation a007e12a-fc1b-43a2-a7fb-9db8ae32dccd · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 27

Resolution
unresolved
raw_fallback, observed 2026-08-06T22:43:52.718873Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:51.491845Z digest=sha256:e2f1eac65b121ccd3bfe4fd93d44344f72b446032d830801561aa5e9dffef157

Observation 50f99404-03bc-458c-8e29-671c3341787a · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:51.575175Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:51.575175Z digest=sha256:d3478dad8cb6a515ff9f95cc41a6e80e1f6c4a89980a31c641d17eb26ab3fa22

Observation 2e6de089-4649-488c-b5c8-0d92bed82f1a · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-06T22:43:51.670221Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T22:43:51.670221Z digest=sha256:f3a95ed063c4a3a78841b93667824d0d4e07df2ad2fa493eb9bb73a4ad964f4e

Observation 9fb9630a-18e3-4938-954e-a5bb656a8357 · outbound

This paper cites an unresolved cited work.

ParEval-Repo: A Benchmark Suite for Evaluating LLMs with Repository-level HPC Translation Tasks Unresolved cited work

Reference 150

Resolution
verified exact
doi, observed 2026-08-06T22:43:51.878367Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-18T06:34:40.430872+00:00.

source=pdf_text observed=2026-08-06T22:43:51.106825Z digest=sha256:ce6caec4bf7129579cfb11821c29d57a2f28154f2e0b93c9743ad7de12bdc49c

Pith citing papers

No inbound Pith citation observations are available.