Pith. sign in

Paper Citation Record · LEDGER

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

As of 8 August 2026, this Paper Citation Record lists 63 of 63 outbound references and 1 inbound Pith citation observation for arXiv:2505.15469.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2505.15469 v1

Coverage vector

measured 63 of 63 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-07T15:20:52.902763Z

measured 64 of 64 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-07T06:34:17.273281+00:00

measured 1 of 1 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links, observed 2026-05-19T10:19:07.701197Z

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: arxiv_reference, observed 2026-05-19T10:22:14.539749Z

Reference resolution

63 of 63 outbound references displayed

  • verified exact4
  • verified fuzzy4
  • unresolved55
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation aee76ef4-e86d-4eba-81cd-cd428e923f11 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:46.487084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:46.487084Z digest=sha256:cd2eab2f7df94ee8ac789518a5e4760bda7281f8346697c6e20645d1425693c7

Observation e599388a-0125-4bdf-a77e-5c4eec1c5903 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.481909Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:46.734381Z digest=sha256:b6231d2a8a30bab8984ec86b97d53f1921c234ec3bc6b5dc2a7a5c512fb2150a

Observation 62797bf6-45e3-46c5-bfa8-92a50622c814 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 3

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.314250Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:46.821296Z digest=sha256:c22b21d9896096fc2665c7713cecabb7030030dd0bde87102635c39de7bdbd11

Observation f7d2e336-3e15-499c-aa8a-123c97c28b26 · outbound

This paper cites Efficient Training of Language Models to Fill in the Middle.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Efficient Training of Language Models to Fill in the Middle

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:46.957316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:46.957316Z digest=sha256:8d7dae322ab73ec1a7ff5ca5e93dbcd0aff1f34748e857a2a6ac22da8cb86cf2

Observation fab25d9c-e76d-4daa-9641-d30685f9f165 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 5

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.187552Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.035386Z digest=sha256:6f0e8b989d6429fdad99026942ddcd708133eba02ebf7b90885fec30670bbfe4

Observation 2f4d310b-f238-446f-bfc5-aa0c10bc4864 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 6

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.036105Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.148094Z digest=sha256:9e84533a8d195fc526b9d9167088b9b03e707ac1d4eb752ec8f296791e779052

Observation f7aa3615-1f3e-4520-a7b5-e96606f9fbb2 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 7

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.845352Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.288313Z digest=sha256:6e4d437f163413db9c477d1403ff54be38169f29aa5fe10076278c8a4c90eb56

Observation d31e0e58-756e-4519-b606-4bbe034f94bb · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 8

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.713155Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.401300Z digest=sha256:1fd68a03adc0cf10ca08968aae22aba2be36955704d7461e14ae9d8a6fa15c8c

Observation 51e9f5fc-08c9-4dde-a05b-6dee9f767d3c · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 9

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.328616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.508110Z digest=sha256:e824cd20545a3cfc65073ad2903c293a2f969d9abd882e2be502a50d0b0bf4d2

Observation 36d0ed6c-07c1-4748-a4d3-6b55698c7b3f · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 10

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.552892Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.572575Z digest=sha256:0e1facab7d3ac872a840106ee7228f102900f6b59ba4c643d26e5bb3727affa3

Observation 62050d25-3c15-49cc-a25b-0790630c6fe4 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 11

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.359286Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.624702Z digest=sha256:1b15a429f825339211535795be641fba74cb4e97445a8f1f5c1aef611c728b97

Observation b92c6d34-4f0c-4e0c-be69-525b8300cf84 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 12

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:59.163043Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.722014Z digest=sha256:7890f8d0f85ad6bf62d20d59b5dfa442ad37aef1cecf922eec26c8c77dc1e24a

Observation feac6d7f-505f-4772-8bc9-92deac8440d4 · outbound

This paper cites A Survey on Large Language Models for Code Generation.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics A Survey on Large Language Models for Code Generation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:47.806822Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:47.806822Z digest=sha256:e76d4a4e91d9de7fcf6c4c68c6fd76ef723884c615a5848a14030610010c0ae8

Observation 10b3618f-546d-43fd-86c7-b04d20b2e0a2 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 14

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.976027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.885209Z digest=sha256:40c00fe5f10a3b290197603e1a098b936f1fa9bcceb5dba2c0e5ea7b75ca0226

Observation 9dc8e610-ad90-453a-991e-0eda77692dff · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 15

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.751310Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:47.998000Z digest=sha256:79ad21bfb13b0490ab4add7030b659b95ed9016158cfa2671c8771dd63aec224

Observation 85f9f119-d691-498c-abb6-4b654e461279 · outbound

This paper cites Automatic Code Documentation Generation Using GPT-3.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Automatic Code Documentation Generation Using GPT-3

Reference 16

Resolution
verified exact
local_arxiv, observed 2026-08-07T15:20:53.913759Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:48.108019Z digest=sha256:373de8543e31adf50bc58d7739afbdce488fc7f3226acdff2a051b0fc7526c79

Observation ed38a35b-c46a-4b67-8c17-51ab52067b6e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.217206Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.217206Z digest=sha256:09f2f3366be492e27f2a922b9985f8c3c9c0af8d6191fd8815cb848b1c387fc1

Observation bb014937-5742-4133-9bdc-4cc0ba7a9d96 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 18

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.584458Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:48.363196Z digest=sha256:73225020644269fa3d70919531390355f8814da1a53ac61166e5569602d36cf3

Observation f802cb32-a484-4600-b12b-4a4570eded92 · outbound

This paper cites Liang, Chenyang Yang, and Brad A.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Liang, Chenyang Yang, and Brad A

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.498296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.498296Z digest=sha256:6708be2a7a1997cf46dd202ca7b6eb4c01cec076646f376eb266e7100d55afaa

Observation 404ba66a-a4df-4f6e-80db-33fdf7c84638 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 20

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.362506Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:48.607374Z digest=sha256:24975792b6c84dd5d307f0db2fe466e4a8288db6cf978cd43abfbad438138f95

Observation c6b0bec7-c83b-428a-816c-7ff9abb0963d · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 21

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:58.095782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:48.732104Z digest=sha256:1f359a0e445e98f97fef2dfd76559a24044f0c7ee205d6251aa025458bad8134

Observation 495a5318-6ed5-4868-a1a2-4b6d94fdfa15 · outbound

This paper cites RoBERTa: A Robustly Optimized BERT Pretraining Approach.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics RoBERTa: A Robustly Optimized BERT Pretraining Approach

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:48.844391Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:48.844391Z digest=sha256:03aa7bf84d6014a9eec4f2457594f492dac376306bdac0632f8dfd68edd15f81

Observation 4bd50e4e-4b59-4879-be8a-3c9a9dd31f63 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 23

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.917258Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:48.933750Z digest=sha256:bb6765962a1fcaef49432f25c7cc51e31516561f5abef2b7790f72ad888b84df

Observation 1b191ffd-d8bb-41eb-aa38-33f3c93e8044 · outbound

This paper cites StarCoder 2 and The Stack v2: The Next Generation.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics StarCoder 2 and The Stack v2: The Next Generation

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.072231Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.072231Z digest=sha256:b350b3268fc2a4e06981bc333516c272b364d5e2d986085a612fe6de815a99dc

Observation d5081326-f24b-4508-b8ba-2cdc1a0bdd3e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 25

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.763683Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:49.185550Z digest=sha256:85120744f0544a2e0253bbef5646745131aa51e9c1a03a62533ee38688dbb0f5

Observation 5a06c56b-6916-4296-b4cf-d36e98f25901 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 26

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.634688Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:49.278106Z digest=sha256:293e3c0ba0d0f30b491028d7b459278ec39b02a3c4cf2ea1a823bf8854bcbdba

Observation 5a51117e-e432-4cb4-9da0-f5a0bebf6215 · outbound

This paper cites Efficient Estimation of Word Representations in Vector Space.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Efficient Estimation of Word Representations in Vector Space

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.381977Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.381977Z digest=sha256:d87be68e186c6b52a1c02f3706b1f2a45956e7fb2ce86051325ec32464ba5dfb

Observation a1091bbb-eec8-4547-b227-eb9583d20d4f · outbound

This paper cites Granite Code Models: A Family of Open Foundation Models for Code Intelligence.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Granite Code Models: A Family of Open Foundation Models for Code Intelligence

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.511222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.511222Z digest=sha256:0be7bbc51462c1f5cf500fb89338fff205640c579ab02fd7a0d31da0d56013d7

Observation c299f4b6-7596-45da-938e-e3508cc33b8e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.638318Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.638318Z digest=sha256:f78727a2648f7d5134f8ebb3df578ca453ae28a8eacc78d66a842d9094a43802

Observation 52f2af0d-47cf-4fc0-a1dc-831015004064 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:49.723813Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:49.723813Z digest=sha256:2bceadded84c2ced2f77c1979d4bf44ac740c5026ac38512a67543ac9694f46a

Observation b06cadb3-9acc-409e-9e59-e4d75bca6197 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 31

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.485773Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:49.834835Z digest=sha256:218eb436a7bde58962e353b34239dfbab9e511cf787b4f812a48adea90cbae45

Observation 8d8b30bc-7ebf-4f3c-8223-8d31208afc92 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 32

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.315450Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:49.951493Z digest=sha256:713bd0d5e2ef69617ec2951fa8b9da4e91c50a91fb16c78ea8d54a368fdfc88c

Observation d0cbc8a7-1c4c-4806-bc60-c1f7d4eac6ea · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 33

Resolution
verified exact
doi, observed 2026-08-07T15:20:53.113117Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.181924Z digest=sha256:34bbe42a340e7cffed2f362a68271e1c65d7021de241bcc6af27a376ebbca55e

Observation e361b070-12c5-4993-8774-8754cb7c6ad1 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 34

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.029027Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.314446Z digest=sha256:8273c0aa6e5e995cfb9fcea59b0bb9c4d9ab6def28f5101062388d0129f382e3

Observation 71987109-4f36-4e91-8ea8-133f6a7e7211 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 35

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.873872Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.417629Z digest=sha256:609fe6f43ce9fde0963497742e36b8959e4efbf6d986f4da7744880cdad80e92

Observation 3460e378-3466-437a-ad49-ce632e2c5c0b · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 36

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.700849Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.489267Z digest=sha256:b4a886e425dcf26b039761c2f90c1b2b5cde24a7595890120048eb74ff253021

Observation 49923556-ae3c-48d9-b93c-a25c101af8fa · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 37

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.553704Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.619929Z digest=sha256:e4978f5edfc0f5c1c33fcbe064e34478b7f852a718737b066693ef1626acbf3a

Observation 7a85e8bb-9ad7-4825-9cb2-4851b4ffd61f · outbound

This paper cites Code Llama: Open Foundation Models for Code.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Code Llama: Open Foundation Models for Code

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:50.753776Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:50.753776Z digest=sha256:ed5c33e208f516f6b055147336cc8db1b131b4d17185fecd5201f02669d82da8

Observation b122e0ed-2bfb-41c6-98bf-3cc5b198cbbc · outbound

This paper cites Sai, Tanay Dixit, Dev Yashpal Sheth, Sreyas Mohan, and Mitesh M.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Sai, Tanay Dixit, Dev Yashpal Sheth, Sreyas Mohan, and Mitesh M

Reference 39

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:56.417276Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.854897Z digest=sha256:4c25f99805d358f57325e21c404c0dfc847fd586f71eda2eea9007ba245b2959

Observation 682d8869-9e59-451f-a363-9d167b67a1a7 · outbound

This paper cites Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Reproducibility in Machine Learning-based Research: Overview, Barriers and Drivers

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:50.934765Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:50.934765Z digest=sha256:89450ec1a69a0cbb7404ddf6979102685bdcc8ac19d1771feb32883509255681

Observation e5a943bb-e2cf-47ba-ae18-52e2c35389ef · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 41

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.251837Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.067575Z digest=sha256:f062651ca0a1080d8197a568d7639c3cf44d9bf5b9f51a8972ba098be50d020e

Observation 86767d71-985d-42b0-a165-a42c4925a1ea · outbound

This paper cites CodeGemma: Open Code Models Based on Gemma.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics CodeGemma: Open Code Models Based on Gemma

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.134531Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.134531Z digest=sha256:b248273937bfabbc15bef590edccfbcb63d661828469fd9aef5296fc139a0a48

Observation a7e49ac4-5528-4234-a552-cde82b56cd28 · outbound

This paper cites Gemma: Open Models Based on Gemini Research and Technology.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Gemma: Open Models Based on Gemini Research and Technology

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.225398Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.225398Z digest=sha256:4b4a5010bb6d5fee47c6d81eeb2fcfc68d99a867c7f205982f20684365e12aa2

Observation 220c80ca-0093-482a-87ca-a5f88019f130 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 44

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:56.092417Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.346574Z digest=sha256:9e354b30b3c479c6896f680a7ce9bc24af942b9ff2e17a7b1d01ad30af04613a

Observation 88102446-ca89-401e-bb04-d8121dd65381 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 45

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.905978Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.466805Z digest=sha256:4854e2d10d344875ea3f0b65ed64e8374a1e8cfee1d07b9f32944868599ef61f

Observation fcc8625a-b1d8-4230-9005-d942b5d27d98 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 46

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.726548Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.539046Z digest=sha256:acc9fe06258239b15a8f4276c3cb0a4048ec998d7634e1d78e1ce2a6a8319e50

Observation f36dbc48-0b8b-42d8-8f41-7707fb0c8929 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 47

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.581700Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.619713Z digest=sha256:83e4d66019f6bd038ed0c59d3d374488a92b696a2bb3d05c69d8538276f0ee09

Observation 778fee85-27aa-4582-8e3b-e06de84987da · outbound

This paper cites Llama 2: Open Foundation and Fine-Tuned Chat Models.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Llama 2: Open Foundation and Fine-Tuned Chat Models

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.693738Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.693738Z digest=sha256:d8458c196909245f29540dec504b6eeb93906153449b828298ea49377761316f

Observation f001a3c9-9c4c-432c-817a-cacc404b2a4e · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 49

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.427351Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.774228Z digest=sha256:e5aba85904fb79fb0e3bffcaa8404e3620d3f5a28ebb99a8d067b4fb75cf89f2

Observation 9fd2cd3a-fcc4-4b18-bb10-1a537dea1d69 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:51.870535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:51.870535Z digest=sha256:b6deeea81e5bf07c8b77269a9b622b39870b789c9ac18f49d34c591f47f7be98

Observation aadc31c8-38b3-4281-a715-a1587106bd73 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 51

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.220074Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:51.952565Z digest=sha256:ff9162dcb6a0c79eb0facab7d2bded0a9d4867d5e4f23cbf97cc32abff6e0588

Observation c7d109a9-5785-4573-a6e2-f90714ff9806 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.037377Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.037377Z digest=sha256:12dc2aaac582ff5dbb022c30ac87fa1ad8cca3c4a3bf7932342ca46ab11a31fd

Observation 27656cc5-d700-4162-89f5-1909418e58bd · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 53

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:55.077647Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.158447Z digest=sha256:51e9c4f65e1a5259ce4f6ab2244eda626ae3189adae417d6455ebdfc65682388

Observation b7bfdbd0-052f-422f-a0be-da9ed8ef6dd6 · outbound

This paper cites Witchel, Christopher I.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Witchel, Christopher I

Reference 54

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.917761Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.252558Z digest=sha256:e15728c52ae95590a8af311518b8293632a740588fbe192b0027ecb7fb66f911

Observation a4283ada-82b8-4446-8b75-cc0db0c10155 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 55

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.617394Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.429199Z digest=sha256:71408539532e9bcac8c45111bdbc32a8effdb61dc6d4c5b88d097198f17d784f

Observation cf2d77e5-6c9f-441c-a379-aa8386fca7a9 · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 56

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.476112Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.538790Z digest=sha256:426ebae6d56e773adfbceb1a0695494de85374ae8a4b1e73195f306c8f60270a

Observation 09c30082-122c-4dad-9f39-d6062c6aed2a · outbound

This paper cites Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Don't Trust ChatGPT when Your Question is not in English: A Study of Multilingual Abilities and Types of LLMs

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.641310Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.641310Z digest=sha256:40de8726253829b9b1c9f3bfcead5fd37984fa594cab25432b03efbed6fa40a1

Observation 9ba06270-9a7e-46b7-b613-181ce6ff5f7a · outbound

This paper cites Weinberger, and Yoav Artzi.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Weinberger, and Yoav Artzi

Reference 58

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.294855Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.701026Z digest=sha256:bc3a5e328c0ecb76229db316c46b7dd57b54c25ebcc82e9e2714e8f447b42e76

Observation 091d7c87-99f6-471d-bad4-e14d1b625f3c · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 59

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:54.150485Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.798547Z digest=sha256:7bf1bbca11e901f5ee506acb7491a09d93f025f36e0cbc95682e671e16b1c3fc

Observation 89e40cbe-707c-4e72-b339-0d0b12a6cfcc · outbound

This paper cites Productivity Assessment of Neural Code Completion.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Productivity Assessment of Neural Code Completion

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-07T15:20:52.902763Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-07T15:20:52.902763Z digest=sha256:c16f1b2c0cb68768f3fec27d1e5dc8a8ad671617198728c060d9188ad9f3c1c6

Observation 73557d92-368c-48b3-b5eb-6b3f39f92ca1 · outbound

This paper cites Frontiers in Psychology, 13, 873844.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Frontiers in Psychology, 13, 873844

Reference 2022

Resolution
verified fuzzy
raw_fallback, observed 2026-08-07T15:20:54.757288Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:52.325156Z digest=sha256:0a863d73a9cf859b471579745a0a3a653065fb61191ae57d560b909df0b327d1

Observation 147107d5-bb97-445e-96df-467741c195db · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2024

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:20:57.174233Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:50.062042Z digest=sha256:5591c58f57e655919ab89703ccc269b5e263243a32bc2c0e9993fb9114fd345f

Observation 8453bbfc-0511-4425-99a2-cf16a3f2442d · outbound

This paper cites an unresolved cited work.

A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics Unresolved cited work

Reference 2025

Resolution
unresolved
raw_fallback, observed 2026-08-07T15:21:00.456326Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-08-07T15:20:46.577952Z digest=sha256:51e61338da2f16ed2f7f150e32d5c7b3a8b7eb7d96e0c8fd3fb122fe87cc9147

Pith citing papers

Observation facb7a0e-03b0-4913-adc7-da28166ae9f9 · inbound

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation cites this paper.

AdaDec: A Uncertainty-Guided Lookahead Decoding Framework for LLM-Based Code Generation A Qualitative Investigation into LLM-Generated Multilingual Code Comments and Automatic Evaluation Metrics

Reference 35

Resolution
verified exact
arxiv_id, observed 2026-05-19T10:22:14.541296Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-07T06:34:17.273281+00:00.

source=pdf_text observed=2026-05-19T10:19:07.701197Z digest=sha256:1af54186bb440844b49f5a8fa3d2d725f235e983a97c169dd3479962b7477a35