Pith. sign in

Paper Citation Record · LEDGER

Can Large Language Models Serve as Evaluators for Code Summarization?

As of 17 August 2026, this Paper Citation Record lists 66 of 66 outbound references and 6 inbound Pith citation observations for arXiv:2412.01333.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2412.01333 v1

Coverage vector

measured 66 of 66 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T04:32:03.419764Z

measured 72 of 72 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-17T06:30:58.91139+00:00

measured 6 of 6 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-08-16T05:56:23.781576Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-17T03:38:57.833957Z

Reference resolution

66 of 66 outbound references displayed

  • verified exact2
  • verified fuzzy29
  • unresolved35
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation e13550c2-d7d7-4b7b-911f-d01e9109d06b · outbound

This paper cites Summarizing source code using a neural attention model,.

Can Large Language Models Serve as Evaluators for Code Summarization? Summarizing source code using a neural attention model,

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.048646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.048646Z digest=sha256:4160e86f22471c3409f30f82e8659b927c1928af12ba028397b6c9e052fe7031

Observation 8e07fe13-e465-4554-84b5-f2bad33e5b36 · outbound

This paper cites A neural model for generating natural language summaries of program subroutines,.

Can Large Language Models Serve as Evaluators for Code Summarization? A neural model for generating natural language summaries of program subroutines,

Reference 2

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.663891Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.054315Z digest=sha256:edeed55274ed5c2ec5ffe54c069cc29931ad48547bc862e9ab0451023e00d58c

Observation 928dd8a9-7c7a-4be0-9553-650774b2da6d · outbound

This paper cites Large language models are few-shot summarizers: Multi-intent comment generation via in-context learning,.

Can Large Language Models Serve as Evaluators for Code Summarization? Large language models are few-shot summarizers: Multi-intent comment generation via in-context learning,

Reference 3

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.648125Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.060133Z digest=sha256:e06b163d5fc0d495a3753738564479b8f48efb96a9c3af1d5cf7ca54e4ca90a9

Observation 2791eb5d-5d3e-4c55-b31b-d6ed9e13f9ea · outbound

This paper cites Gpt-4 technical report,.

Can Large Language Models Serve as Evaluators for Code Summarization? Gpt-4 technical report,

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.065121Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.065121Z digest=sha256:2f8471de0d100a90fa52c90dd5fa313edb4ccd8299e630075593d05f8854f325

Observation 9bf09b46-b5e1-45af-9603-b472024bc83e · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

Can Large Language Models Serve as Evaluators for Code Summarization? Gemini: A Family of Highly Capable Multimodal Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.070428Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.070428Z digest=sha256:d22f3c476742e668230b1d38b66c671436fffe69fa09439f110923fb4dafff2f

Observation 5271e906-7a83-4617-a52f-a800452f994d · outbound

This paper cites LLaMA: Open and Efficient Foundation Language Models.

Can Large Language Models Serve as Evaluators for Code Summarization? LLaMA: Open and Efficient Foundation Language Models

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.075797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.075797Z digest=sha256:2189f181f11c33ad761f6fb8324ec6cdfaabe0818331befc530c06adb1a0ab1c

Observation fad18f81-5cb9-49ee-8f83-b744c0e6d6c3 · outbound

This paper cites Bleu: a method for automatic evaluation of machine translation,.

Can Large Language Models Serve as Evaluators for Code Summarization? Bleu: a method for automatic evaluation of machine translation,

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.081542Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.081542Z digest=sha256:6ce887100e7e74a3fee97d83e9c2cfbab5cb74a53450c013fb3edb4985a6b6b2

Observation f9c513bd-fada-4b2b-81ce-aa701e90a11c · outbound

This paper cites Rouge: A package for automatic evaluation of summaries,.

Can Large Language Models Serve as Evaluators for Code Summarization? Rouge: A package for automatic evaluation of summaries,

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.086423Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.086423Z digest=sha256:5fb45fe6892f28c861562c14134c3f7e0c777b7953092815833109451256906f

Observation dca472b4-82b1-4bc5-94d7-7afe777d0d5a · outbound

This paper cites Meteor: An automatic metric for mt evaluation with improved correlation with human judgments,.

Can Large Language Models Serve as Evaluators for Code Summarization? Meteor: An automatic metric for mt evaluation with improved correlation with human judgments,

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.091826Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.091826Z digest=sha256:b5dee78b39b4fe5c6fdc068d24f12993663ab99dd9e01c6eef11bac2647ff29b

Observation 34ee4429-ac5e-4887-887b-36d6a5629b3d · outbound

This paper cites BERTScore: Evaluating Text Generation with BERT.

Can Large Language Models Serve as Evaluators for Code Summarization? BERTScore: Evaluating Text Generation with BERT

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.097218Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.097218Z digest=sha256:8aeaa1a84007c9bbfc500c7acfdea47a306ef07937d217d849b48ab9653cde38

Observation 483510d7-aebc-4846-b9ce-9a2b61aee303 · outbound

This paper cites On the evaluation of neural code summarization,.

Can Large Language Models Serve as Evaluators for Code Summarization? On the evaluation of neural code summarization,

Reference 11

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.591407Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.103027Z digest=sha256:cea38cc03cdc2b8c423cc7aff749ba3f94f7d1e7db4dd1ecfb12ff5942351c7e

Observation 9b77032c-d91f-44a5-99a2-7b5f51adcf4c · outbound

This paper cites Reassessing automatic evaluation metrics for code summarization tasks,.

Can Large Language Models Serve as Evaluators for Code Summarization? Reassessing automatic evaluation metrics for code summarization tasks,

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.108170Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.108170Z digest=sha256:7ebd74346f7220bbe4888abbeb54e2781fe690e68d81cf8ed58804b6d109477e

Observation ac43f845-a8d3-4563-997b-b3718a9a75be · outbound

This paper cites Is ChatGPT a Good NLG Evaluator? A Preliminary Study.

Can Large Language Models Serve as Evaluators for Code Summarization? Is ChatGPT a Good NLG Evaluator? A Preliminary Study

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.114529Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.114529Z digest=sha256:e2ba701385d507c6df23f4b9aab14b7f4d881c79ac1a8a410836bad8806cebff

Observation 9584fe44-95b9-4350-a50f-67e56050f521 · outbound

This paper cites G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment.

Can Large Language Models Serve as Evaluators for Code Summarization? G-Eval: NLG Evaluation using GPT-4 with Better Human Alignment

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.119646Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.119646Z digest=sha256:30693c0aedad7de24064173a047382672aebd9fc3687c18e2209944964e2ca74

Observation 035363bf-f34a-4f15-9bfe-707d3331831b · outbound

This paper cites Can Large Language Models Be an Alternative to Human Evaluations?.

Can Large Language Models Serve as Evaluators for Code Summarization? Can Large Language Models Be an Alternative to Human Evaluations?

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.124672Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.124672Z digest=sha256:86d452618b23b951888adce323631cc5cc67775df81f8e0f7647918486a55857

Observation 2c6c2898-cd37-47a3-971f-33cbb43c2730 · outbound

This paper cites A Closer Look into Automatic Evaluation Using Large Language Models.

Can Large Language Models Serve as Evaluators for Code Summarization? A Closer Look into Automatic Evaluation Using Large Language Models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.129691Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.129691Z digest=sha256:db498cb2eb8ab70532414e5a2987e4afa4fbd582aa8b93c626baff3c0d5e03c1

Observation 165f2e09-5617-4951-b96f-947689a3593c · outbound

This paper cites ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate.

Can Large Language Models Serve as Evaluators for Code Summarization? ChatEval: Towards Better LLM-based Evaluators through Multi-Agent Debate

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.136393Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.136393Z digest=sha256:0f678a3bd76c35cc70b4f412df74e93a0649eba30f67c288a0d089265d641c8a

Observation af062056-6ed3-4a15-af6c-9b018670f92b · outbound

This paper cites Large Language Models Are State-of-the-Art Evaluators of Translation Quality.

Can Large Language Models Serve as Evaluators for Code Summarization? Large Language Models Are State-of-the-Art Evaluators of Translation Quality

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.143248Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.143248Z digest=sha256:348658f7403f4665f77190097af6ff97b984c909a008b0f96ce03329f21995de

Observation 8d8c2549-bcb2-4420-8fd8-d78d3a0e977e · outbound

This paper cites Evaluating Large Language Models at Evaluating Instruction Following.

Can Large Language Models Serve as Evaluators for Code Summarization? Evaluating Large Language Models at Evaluating Instruction Following

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.151155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.151155Z digest=sha256:cb1ecd1cade13a26d0108a66951e2f0fc194b926663e230d038c19f405cef2be

Observation b52a792b-0557-4f99-8536-af24bb7b6196 · outbound

This paper cites Ice-score: Instructing large language models to evaluate code,.

Can Large Language Models Serve as Evaluators for Code Summarization? Ice-score: Instructing large language models to evaluate code,

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.157456Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.157456Z digest=sha256:779ebe5eaba739a728d109244e2ad9ba31db2af20bb114b4c4125a6342730413

Observation 4e0a1c37-c890-4b52-95ee-5020050223ea · outbound

This paper cites Chatgpt,.

Can Large Language Models Serve as Evaluators for Code Summarization? Chatgpt,

Reference 21

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.554398Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.162567Z digest=sha256:6bd9277e02cb3b3af21d7147d59791b0abb2310295fd265894a506189be2dfa2

Observation e7d26a14-c503-436e-a99e-3a5e84e13a79 · outbound

This paper cites [Online].

Can Large Language Models Serve as Evaluators for Code Summarization? [Online]

Reference 22

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.536637Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.168956Z digest=sha256:5e26a91c5e546fe83c82f607778f407d56dc815c857e9c41b0cfdf699f0565b9

Observation a56b8c3d-d6ea-4aed-b3af-c248cd382820 · outbound

This paper cites [Online].

Can Large Language Models Serve as Evaluators for Code Summarization? [Online]

Reference 23

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.519932Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.173856Z digest=sha256:e0efe013201b7c6ffbb983a0b03ec50692985af63bef96e1efec06775b183010

Observation 2382104c-c26d-4491-9956-ef2a9b8c270b · outbound

This paper cites Deep code comment generation,.

Can Large Language Models Serve as Evaluators for Code Summarization? Deep code comment generation,

Reference 24

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.503840Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.179805Z digest=sha256:7e315df86ca817fb25a1e6154219a51b61ec73cd82b6b1e6234415c0a73912ba

Observation b0bd9099-3c0d-4e2c-b09a-4b3f6d3719c3 · outbound

This paper cites Retrieval-based neural source code summarization,.

Can Large Language Models Serve as Evaluators for Code Summarization? Retrieval-based neural source code summarization,

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.186797Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.186797Z digest=sha256:56ad62bcd2f6cfb9a27a9b4a01ee265038c3aa1e325d0e078a4e166d7a4cd1c0

Observation 5e99ece5-01bb-4805-b075-b70aa2f38490 · outbound

This paper cites A Transformer-based Approach for Source Code Summarization.

Can Large Language Models Serve as Evaluators for Code Summarization? A Transformer-based Approach for Source Code Summarization

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.193998Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.193998Z digest=sha256:17cdd9a6e517e8e89b2ecdfec8c1dd5c167f0d9f6a5890a577412ed45735d40f

Observation 3a2c6c2d-e4f7-4cf7-bcb3-04eb15baa7c6 · outbound

This paper cites Automatic Code Summarization via ChatGPT: How Far Are We?.

Can Large Language Models Serve as Evaluators for Code Summarization? Automatic Code Summarization via ChatGPT: How Far Are We?

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.199906Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.199906Z digest=sha256:202d8335ffa0e12c7e6fcc3e0abd474bceac9ee6a65281327d38b859694825de

Observation 14c682dc-1c84-4b8f-99db-9e9b3a1b8895 · outbound

This paper cites An empirical study of smoothing techniques for language modeling,.

Can Large Language Models Serve as Evaluators for Code Summarization? An empirical study of smoothing techniques for language modeling,

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.207558Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.207558Z digest=sha256:f8047799c6ec86e8c306358d4f61ecea5991fd35379d5fde3c4ae2e9e028fb2d

Observation 1e1ede7c-79e7-49a3-9d80-c5b425441890 · outbound

This paper cites Retrieve and refine: exemplar- based neural comment generation,.

Can Large Language Models Serve as Evaluators for Code Summarization? Retrieve and refine: exemplar- based neural comment generation,

Reference 29

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.466072Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.214677Z digest=sha256:705a5c8b3d698193bfaa77f1012504a3a03f6fdb828e645f9f7bc112ddad9b14

Observation fcf31da2-c731-49b8-907d-7ff8a7e96804 · outbound

This paper cites Project-level encoding for neural source code summarization of subroutines,.

Can Large Language Models Serve as Evaluators for Code Summarization? Project-level encoding for neural source code summarization of subroutines,

Reference 30

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.450394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.219827Z digest=sha256:f9c0a3159291150d3761124d668d81eca6fc1a072787e4135b2c965211c506e8

Observation 596247f9-e949-4d1b-8934-b6c2cf99f0d9 · outbound

This paper cites Improving code summarization with block-wise abstract syntax tree splitting,.

Can Large Language Models Serve as Evaluators for Code Summarization? Improving code summarization with block-wise abstract syntax tree splitting,

Reference 31

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.435489Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.224919Z digest=sha256:2f213390211f1f72f81c632d93e6b67a93988167d7b3229471255950e396c939

Observation 39323a8a-9b66-42b9-9826-e7149f3afc6f · outbound

This paper cites Api2com: On the improvement of automatically generated code comments using api documentations,.

Can Large Language Models Serve as Evaluators for Code Summarization? Api2com: On the improvement of automatically generated code comments using api documentations,

Reference 32

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.413669Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.229702Z digest=sha256:8cca6f2745c3b5cdb9e9c29d2f22e1d3dc57acb7555cd01dd4054f17be82adfd

Observation 5d97a36b-2e55-46ba-88fd-b783ed0f6cd5 · outbound

This paper cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.

Can Large Language Models Serve as Evaluators for Code Summarization? RoBERTa: A Robustly Optimized BERT Pretraining Approach

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.235273Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.235273Z digest=sha256:1d24fe21992d57d32c75b5b9f397cd487230bf086c56bf404150585f775cf0fb

Observation 3835d723-d7fd-4849-b663-91fac5d2e354 · outbound

This paper cites Chain-of-thought prompting elicits reasoning in large language models,.

Can Large Language Models Serve as Evaluators for Code Summarization? Chain-of-thought prompting elicits reasoning in large language models,

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.241668Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.241668Z digest=sha256:02cb8f2c2ec7f1e787176097609126dfe334bf8d66188cf48650bb8aafbbb8a2

Observation e27429a5-6910-42c0-bc4d-a1b999f7217b · outbound

This paper cites Generative agents: Interactive simulacra of human behavior,.

Can Large Language Models Serve as Evaluators for Code Summarization? Generative agents: Interactive simulacra of human behavior,

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.247330Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.247330Z digest=sha256:d5e06ce1d632bee3438f6e09538b2fda2c2ac8731e5ca0a0a28106cfbaf0d03e

Observation 1255f785-8cff-488e-b14c-118bf72ed027 · outbound

This paper cites Multi-Agent Consensus Seeking via Large Language Models.

Can Large Language Models Serve as Evaluators for Code Summarization? Multi-Agent Consensus Seeking via Large Language Models

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.252880Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.252880Z digest=sha256:1d1a8b859c535968485fd2c3c5068ffdf0368e2db96280805d52c7805c065603

Observation 4ad4f033-cd94-4a46-a002-08c98a7a4db0 · outbound

This paper cites Summarizing source code with transferred api knowledge,.

Can Large Language Models Serve as Evaluators for Code Summarization? Summarizing source code with transferred api knowledge,

Reference 37

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.371132Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.258245Z digest=sha256:f9d14e586433b24567fc60c6b8c9bdf276162f39ccf53d74a18173c379aabfa1

Observation a251f891-ac49-4969-81ed-68eef0843c67 · outbound

This paper cites Summeval: Re-evaluating summarization evaluation,.

Can Large Language Models Serve as Evaluators for Code Summarization? Summeval: Re-evaluating summarization evaluation,

Reference 38

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.355253Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.263112Z digest=sha256:4e581bc386d9f72ffa9ab01595ee96664281c294e5429cec8b9ea03b3a54afd1

Observation 242d043c-459e-4a45-9221-023517833854 · outbound

This paper cites The treatment of ties in ranking problems,.

Can Large Language Models Serve as Evaluators for Code Summarization? The treatment of ties in ranking problems,

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.338507Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.267829Z digest=sha256:40dced043f428993ae42fdebede6c90cf3f1a45c1c290040ab1db40ac554da1a

Observation 97189272-8706-4ffe-b1a7-2296e3c32757 · outbound

This paper cites Standard probability and statistics tables and formulae,.

Can Large Language Models Serve as Evaluators for Code Summarization? Standard probability and statistics tables and formulae,

Reference 40

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.323182Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.272910Z digest=sha256:448931ea10db70d7241b617764824969a9844003eafc2649f39dbeb819305ef3

Observation 6ccc1155-2c2c-435a-9e6d-383e9291aa9a · outbound

This paper cites Software documentation: how much is enough?.

Can Large Language Models Serve as Evaluators for Code Summarization? Software documentation: how much is enough?

Reference 41

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.308041Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.277820Z digest=sha256:bd62e292f2b98677644966470806b1beb1d50ab80e5802115782cbc99bedf308

Observation d83cfa2d-63cc-4301-846a-d13cee2f0c6f · outbound

This paper cites The relevance of software documenta- tion, tools and technologies: a survey,.

Can Large Language Models Serve as Evaluators for Code Summarization? The relevance of software documenta- tion, tools and technologies: a survey,

Reference 42

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.290679Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.283304Z digest=sha256:9e1630f3ca7069ada4e990c5b1841d0145cfbe6a83ad2832ec8ce90fd8bc499e

Observation 6a7268c7-3224-4de3-bf59-274f3c943eb3 · outbound

This paper cites Documenting software systems with views,.

Can Large Language Models Serve as Evaluators for Code Summarization? Documenting software systems with views,

Reference 43

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.271834Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.288754Z digest=sha256:3749fb4f5f5d3f200142bfb79073d5fc7f8aa5e3fc388f11411ee211700a6c85

Observation 6a13a4b6-cb70-4382-8cc2-bab14cb0c6ec · outbound

This paper cites Reinforcement-learning-guided source code summarization using hierarchical attention,.

Can Large Language Models Serve as Evaluators for Code Summarization? Reinforcement-learning-guided source code summarization using hierarchical attention,

Reference 44

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.253717Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.295186Z digest=sha256:56317dc5b2f362f8468f17207de786b86ca86a88e7fb4f8450048e8043062261

Observation 5c414b7d-351d-47ae-8c67-168d83bec955 · outbound

This paper cites Modeling hierarchical syntax structure with triplet position for source code summarization,.

Can Large Language Models Serve as Evaluators for Code Summarization? Modeling hierarchical syntax structure with triplet position for source code summarization,

Reference 45

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.233675Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.300050Z digest=sha256:9dc900f4d86c44e3c91e81613c6a1488688d98487d0b7ac8a0131a3ce8d9edff

Observation 0899d916-3e40-4623-8508-78afb46fe682 · outbound

This paper cites Improving automatic source code summarization via deep reinforcement learning,.

Can Large Language Models Serve as Evaluators for Code Summarization? Improving automatic source code summarization via deep reinforcement learning,

Reference 46

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.217392Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.305757Z digest=sha256:a23f948e284f46b657a0a956963798ec24809b9338b7516a41ada817400bb150

Observation 55ed83f5-0be1-477c-bb60-4d24247c8147 · outbound

This paper cites Deep learning for code intelligence: Survey, benchmark and toolkit,.

Can Large Language Models Serve as Evaluators for Code Summarization? Deep learning for code intelligence: Survey, benchmark and toolkit,

Reference 47

Resolution
verified exact
doi, observed 2026-08-12T04:32:03.467494Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.311038Z digest=sha256:c1ba1010ed1f1ddee7d8ab9069eb217c0fd91784522776b1ba1921a2bfc7057a

Observation 25fedac6-7b5f-489b-bbb3-416a3861b673 · outbound

This paper cites Deep learning for code generation: A survey,.

Can Large Language Models Serve as Evaluators for Code Summarization? Deep learning for code generation: A survey,

Reference 48

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.193086Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.318357Z digest=sha256:8398f1d1d907c310bb4687409a08a12ea5b8fb958c64db68142995e5e7e030be

Observation 129d47aa-c4cf-4eab-b7af-c1fdac64973e · outbound

This paper cites Code Summarization with Structure-induced Transformer.

Can Large Language Models Serve as Evaluators for Code Summarization? Code Summarization with Structure-induced Transformer

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.324065Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.324065Z digest=sha256:b38f5a25fc2d69791df57070661461212f210d815b4b5a0de0bbef1defd74b65

Observation 519c9f0c-4e48-4f07-9762-c7d5d9ae4bd9 · outbound

This paper cites code2seq: Generating Sequences from Structured Representations of Code.

Can Large Language Models Serve as Evaluators for Code Summarization? code2seq: Generating Sequences from Structured Representations of Code

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.329655Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.329655Z digest=sha256:09a46dbd5c60427102198957cbf173a82a3d9b3e7e1090afa01403b56313f09d

Observation af9034e2-1d4a-49c3-8a0c-b4337a41265d · outbound

This paper cites Code to comment.

Can Large Language Models Serve as Evaluators for Code Summarization? Code to comment

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.336062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.336062Z digest=sha256:41722a97e81454abe3f0e5fa87dd8531b1bbcb0fd17daf2eb8236b64bda696fd

Observation e5ea8343-2320-4df4-9fde-08f82402630e · outbound

This paper cites CodeBERT: A Pre-Trained Model for Programming and Natural Languages.

Can Large Language Models Serve as Evaluators for Code Summarization? CodeBERT: A Pre-Trained Model for Programming and Natural Languages

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.341910Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.341910Z digest=sha256:0c46ad83cf678e6252970bb72c3ba0f4660080cc1e7c980da1dbadcf80bb5aa3

Observation b802330c-1d96-4284-8feb-47a0654719d1 · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

Can Large Language Models Serve as Evaluators for Code Summarization? CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.347747Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.347747Z digest=sha256:b2d4b85dc0f07dab4e7e67a8e3358e413267e4bc70744fb3b932d23c46bccce0

Observation 908919ee-ec26-4862-a5ef-61ac948d13ad · outbound

This paper cites Automatic code documentation generation using gpt-3,.

Can Large Language Models Serve as Evaluators for Code Summarization? Automatic code documentation generation using gpt-3,

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.157369Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.354379Z digest=sha256:831363136a729bcf429c52f79f03a83836de22bfd8817b361ec3b5a707a01052

Observation 59d5ab25-a658-47f0-970e-320985656d5f · outbound

This paper cites Automatic semantic augmentation of language model prompts (for code summarization),.

Can Large Language Models Serve as Evaluators for Code Summarization? Automatic semantic augmentation of language model prompts (for code summarization),

Reference 55

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.359435Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.359435Z digest=sha256:9a7abedf0aa327a938e6e9e17b8dd91dcc9857f11550566771a61aa75833d3b6

Observation 1190defe-72f6-48eb-a264-9120e79caed6 · outbound

This paper cites On-the-fly adapting code summarization on trainable cost-effective language models,.

Can Large Language Models Serve as Evaluators for Code Summarization? On-the-fly adapting code summarization on trainable cost-effective language models,

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.364473Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.364473Z digest=sha256:e4392d2eb6f503e673c7b1e545ae14d725b0047ac682ff4677097a826dba93cc

Observation 4f9d36c9-3c8a-4e7c-a72d-119365f9c683 · outbound

This paper cites Distilled gpt for source code summarization,.

Can Large Language Models Serve as Evaluators for Code Summarization? Distilled gpt for source code summarization,

Reference 57

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.110488Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.369543Z digest=sha256:18ae0f0a54deef34294ba539774f09598433012a814451d68c350f3e400a4bc3

Observation f229d004-d995-46ea-b242-f0c9bc8efe11 · outbound

This paper cites Source code summarization in the era of large language models,.

Can Large Language Models Serve as Evaluators for Code Summarization? Source code summarization in the era of large language models,

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.090593Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.376045Z digest=sha256:bda85980520ccf656d5bbb25fa451c90b5185006ff20b9b78fade7b059071c31

Observation 918d554c-29ff-42b0-a47f-eb040aafcb44 · outbound

This paper cites A human study of comprehension and code summariza- tion,.

Can Large Language Models Serve as Evaluators for Code Summarization? A human study of comprehension and code summariza- tion,

Reference 59

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.074220Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.382018Z digest=sha256:34a5dc7affdefa85c71dc5a0bc8628eed708a0c6b57394aff23672845297cdeb

Observation fcb3384d-e882-4cc3-9be6-cc3a2a7c7699 · outbound

This paper cites GPTScore: Evaluate as You Desire.

Can Large Language Models Serve as Evaluators for Code Summarization? GPTScore: Evaluate as You Desire

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.387369Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.387369Z digest=sha256:8b1939ce4dee69d85c59d7174f030238af2f7ff3cfb15dcc941ac31d9c32d8ca

Observation 04e8875f-7143-4f7b-a991-1ad53d92a41a · outbound

This paper cites Mllm-as-a-judge: Assessing multimodal llm-as- a-judge with vision-language benchmark,.

Can Large Language Models Serve as Evaluators for Code Summarization? Mllm-as-a-judge: Assessing multimodal llm-as- a-judge with vision-language benchmark,

Reference 61

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.056792Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.392931Z digest=sha256:98e6b8a2a06a0834d0180aadea2cd32e14597a9262849702ffcad9d4736e3058

Observation 78ad570d-338a-4aef-8e62-c34cbd16e3d7 · outbound

This paper cites Large Language Models are Diverse Role-Players for Summarization Evaluation.

Can Large Language Models Serve as Evaluators for Code Summarization? Large Language Models are Diverse Role-Players for Summarization Evaluation

Reference 62

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.398570Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.398570Z digest=sha256:3881bdd683c1cf5c78ca45fde4ca2ec434d6831f1ec624fce33e493492630c1c

Observation ab4ed19b-f959-4989-8ddc-62fd7bb645e8 · outbound

This paper cites How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs?.

Can Large Language Models Serve as Evaluators for Code Summarization? How Reliable Are Automatic Evaluation Methods for Instruction-Tuned LLMs?

Reference 63

Resolution
verified exact
local_arxiv, observed 2026-08-12T04:32:03.636635Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.403644Z digest=sha256:fa2401a9acf1585394cda0414ae8ddba9263814b9ad7e32f2a4865727defcaca

Observation f94e10d2-e19b-4132-ba34-ec66c88881c6 · outbound

This paper cites Who validates the validators? aligning llm-assisted evaluation of llm outputs with human preferences,.

Can Large Language Models Serve as Evaluators for Code Summarization? Who validates the validators? aligning llm-assisted evaluation of llm outputs with human preferences,

Reference 64

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.038500Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.408902Z digest=sha256:49a7e7599a70622e6b1ed525fa73318b3cf0d3773518156ac419f0f5248c7dd5

Observation 3ad261fa-84c8-4368-8b52-5d20790a899a · outbound

This paper cites Naturalcc: an open-source toolkit for code intelligence,.

Can Large Language Models Serve as Evaluators for Code Summarization? Naturalcc: an open-source toolkit for code intelligence,

Reference 65

Resolution
verified fuzzy
raw_fallback, observed 2026-08-12T04:32:04.021401Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-08-12T04:32:03.419764Z digest=sha256:a1bb7b36cf948349055eb193cf05a069a260fb6387638efd016d75e55f3e5b75

Observation aeb14d77-2f83-45cd-a000-5c29818e25cc · outbound

This paper cites Available: https://doi.org/10.1145/3654777.3676450.

Can Large Language Models Serve as Evaluators for Code Summarization? Available: https://doi.org/10.1145/3654777.3676450

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-12T04:32:03.414062Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T04:32:03.414062Z digest=sha256:d1ef7eb56a0f24dc50ceb76a0b043f6269cf64d0e8959e2a1442951302b3ced1

Pith citing papers

Observation 4339c255-4ae4-4a99-8527-11901eb565f7 · inbound

Can Large Language Models Understand Intermediate Representations in Compilers? cites this paper.

Can Large Language Models Understand Intermediate Representations in Compilers? Can Large Language Models Serve as Evaluators for Code Summarization?

Reference 65

Resolution
unresolved
no resolver link, observed 2026-08-08T20:20:19.753566Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=arxiv_source observed=2026-08-08T20:20:19.753566Z digest=sha256:9dc9d60983680e8a4467ed87ed01ca33781daf78e320258f55e7a53ea55d4f94

Observation 0e6845cf-8bd7-4310-b6a8-9d2d244f04ae · inbound

Do Automatic Comment Generation Techniques Fall Short? Exploring the Influence of Method Dependencies on Code Understanding cites this paper.

Do Automatic Comment Generation Techniques Fall Short? Exploring the Influence of Method Dependencies on Code Understanding Can Large Language Models Serve as Evaluators for Code Summarization?

Reference 81

Resolution
unresolved
no resolver link, observed 2026-08-16T05:56:23.781576Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-16T05:56:23.781576Z digest=sha256:81d240d5b04996ddda25adedc5ca29e72a0d265a943473e3682b89d45cd7f821

Observation 6bd6ec4a-2d93-4b15-8bff-a2804792981c · inbound

Issue Retrieval and Verification Enhanced Supplementary Code Comment Generation cites this paper.

Issue Retrieval and Verification Enhanced Supplementary Code Comment Generation Can Large Language Models Serve as Evaluators for Code Summarization?

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-15T19:54:55.722155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-15T19:54:55.722155Z digest=sha256:a78f884f0d7554aef552e9cc14bda3749d4924c396c5a7ed98138ffe1dcfdb03

Observation d6813f7d-0b7f-4e78-8e46-f4d83a39b5ce · inbound

evalSmarT: An LLM-Based Framework for Evaluating Smart Contract Generated Comments cites this paper.

evalSmarT: An LLM-Based Framework for Evaluating Smart Contract Generated Comments Can Large Language Models Serve as Evaluators for Code Summarization?

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-06T13:17:42.262914Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-06T13:17:42.262914Z digest=sha256:9b69f8efa2b34faefb434ca76306ffee46b03d6e1c12b639d960fc4075fe03d4

Observation dbca0308-c386-41ea-b3d0-3003a1157511 · inbound

Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Study cites this paper.

Knowledge-Graph-Driven Data Synthesis for Low-Resource Software Development: A HarmonyOS Case Study Can Large Language Models Serve as Evaluators for Code Summarization?

Reference 67

Resolution
verified exact
arxiv_id, observed 2026-05-17T03:38:57.837063Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-17T06:30:58.91139+00:00.

source=pdf_text observed=2026-05-17T03:38:40.078229Z digest=sha256:4b153c1d7f30466debe58701c2aeec361a9090e9cea74c5e4c4dabed2507a0ec

Observation 6c19b454-d264-47db-a20e-6d6c0a437ead · inbound

Using Mutation-Analysis to Examine an LLM's Ability to Summarize Code cites this paper.

Using Mutation-Analysis to Examine an LLM's Ability to Summarize Code Can Large Language Models Serve as Evaluators for Code Summarization?

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-02T22:09:52.817688Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T22:09:52.817688Z digest=sha256:3d7c3b7a6ef0065e98360262f0ae5edb36b1fda85bf58bfa7e4b28ef070dff39