Pith. sign in

Paper Citation Record · LEDGER

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks

As of 13 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2411.15470.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.15470 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T14:18:33.462725Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-13T06:32:02.005865+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved23
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a15cd32a-7380-413f-ab81-b7377e0e3e04 · outbound

This paper cites Program Synthesis with Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Program Synthesis with Large Language Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:32.892227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:32.892227Z digest=sha256:8dd0fa262090ca537d60bb03582acbcfdf5846ab7a866004becf344052c3a761

Observation 57458435-431e-486b-a224-6afdd9082782 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:32.967088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:32.967088Z digest=sha256:5e4c42e4f89c5ac233bc4a4a456e2e55c49a58ad3480f2e1ffac7f4f3c156cab

Observation 7e770cdd-864e-4d3c-8dc4-df9bee273bb4 · outbound

This paper cites On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.018383Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.018383Z digest=sha256:271a053ca6bf62dea355d3a6cf570deb8d8f42160a8455b022d25d686f3ab0cb

Observation bf8a3c85-3d47-400c-b678-b1483b7fc7b7 · outbound

This paper cites Multi-lingual Evaluation of Code Generation Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.026719Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.026719Z digest=sha256:d15880798ef1a8145f8da4189387a1c930f3211f1e276404806edc121bbdc863

Observation 1f8e14df-3998-4b11-98c7-b4b2b332eb64 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Code Llama: Open Foundation Models for Code

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.035030Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.035030Z digest=sha256:a8fcb72cb0128cacb5a700eed01f1ea5c31426dcc059581e9e3de5ef962333eb

Observation 6b1b2ae1-1215-4283-98ef-016e1069ad00 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Measuring Coding Challenge Competence With APPS

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.042222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.042222Z digest=sha256:751dfbf18286d99ba014fa771f64818271e2f60aa270a96f431af86230849e56

Observation f254911f-c9bc-4589-b7c6-b262e42e460f · outbound

This paper cites MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.053114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.053114Z digest=sha256:7127cbe7f7213c199280fd28a55aecb56a917fff5f76f76f5f121918931aa6b3

Observation 8d4fe1cf-5246-49a4-841d-c4cc7b3fe84a · outbound

This paper cites Evaluating Large Language Models Trained on Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Evaluating Large Language Models Trained on Code

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.062155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.062155Z digest=sha256:25facc1173d46faad39a842d18c9357dbad614aee12f0cf02bf04f09d9a42217

Observation 1c3e52fa-f3ef-4201-ae0b-0555f3f68570 · outbound

This paper cites OctoPack: Instruction Tuning Code Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks OctoPack: Instruction Tuning Code Large Language Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.074086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.074086Z digest=sha256:7a05afa328c63aae4f49d58b0f6bed82b7bbd359c9f6a0a0c78e98a68711c7f8

Observation 0c3f486c-e727-45bc-bfe8-9042131eba0c · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.080993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.080993Z digest=sha256:d7722ee748b05a3e480a10e3cad968951b7302902b94386f549fdca85778ad43

Observation 50676c16-d061-4178-ba3c-ecc776037176 · outbound

This paper cites StarCoder: may the source be with you!.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks StarCoder: may the source be with you!

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.091264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.091264Z digest=sha256:0197a8b293525ad0f0a0aa85985106171e63f2f47d46a6c41c325458811dddd0

Observation 27303d7d-965a-40b4-b0dd-882ba098deed · outbound

This paper cites TACO: Topics in Algorithmic COde generation dataset.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks TACO: Topics in Algorithmic COde generation dataset

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.132332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.132332Z digest=sha256:84abfd02f0b00d3f3d173dba31813a468ad50cad0fa98f4fdbe21b9bb53232c5

Observation 386c03d0-c26d-40b4-8042-136f936d4d0a · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.171783Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.171783Z digest=sha256:9f9b2cd12eb5c43ad8e633c27b51a6e45506b9120c2e8c0a2b99d4aa0444caae

Observation eeec9c18-8edd-42c3-8eec-fa63b78c6e70 · outbound

This paper cites ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.226296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.226296Z digest=sha256:ddd166a5bf098e443b62d336ef8efeb0f5f40dc963c234b5b34afe90cc1211a5

Observation c98449f9-fd4c-4965-b249-d7d226fe62b0 · outbound

This paper cites Large Language Models for Software Engineering: A Systematic Literature Review.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Large Language Models for Software Engineering: A Systematic Literature Review

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.292513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.292513Z digest=sha256:9644f653ff8d8f3e3d3ca48b1b11124e24da57a5bf73225a3b57ad238b5b71c6

Observation e1415567-f509-4d01-820e-e1978cce8057 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 17

Resolution
verified exact
doi, observed 2026-08-12T14:18:33.596964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-12T14:18:33.298965Z digest=sha256:806290102d596ea5bb7729802f0e847c60e241ee67dc4d51ee124f93c54faae7

Observation 0428b1a5-a8cb-4c65-976b-07f101dcf264 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.329781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.329781Z digest=sha256:5ad32c9a5acef029ea2e52c82e0d1e893e7a629c2ba2a9e96820cfb10bd16ef8

Observation a7d1141c-347c-4e0e-8e5b-76646a087c6f · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-12T14:18:34.302782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-13T06:32:02.005865+00:00.

source=pdf_text observed=2026-08-12T14:18:33.380722Z digest=sha256:70ff8ae44814e9667b8963bd5cdc680210821888352d6fffe7f983481985c549

Observation 28182b45-7165-406a-84b6-3b78e2c79706 · outbound

This paper cites CodeBLEU: a Method for Automatic Evaluation of Code Synthesis.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.390162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.390162Z digest=sha256:7e30305f41cdaae60f0f7a0f9871bede26ac935de1e8ff8affb7992e24ee5ae9

Observation ca89cb8a-fb04-45c2-8e54-b0912b2619af · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.395093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.395093Z digest=sha256:dd211aab11c0c814305cb62f0c85852d7861714a5d9a00f0619ad8bb15cd3f49

Observation ac103ae9-9f7c-4b07-b64c-83b32906ca1b · outbound

This paper cites Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.401213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.401213Z digest=sha256:92c0e024e20835dd016771f19df4bdf78c41045035c064aee3522d6d10a304ff

Observation 32e570a7-760e-4585-a6a7-d131d87e01f9 · outbound

This paper cites A Systematic Evaluation of Large Language Models of Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks A Systematic Evaluation of Large Language Models of Code

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.407633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.407633Z digest=sha256:dcb172f2053ef0ec2c767f2e461a8d8f320be0f74d9cc9c5b26b0257dbe95a01

Observation 0702e6df-fc97-4507-bcfc-72e2a54aa6e3 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.427466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.427466Z digest=sha256:9aaaf1ba9bf3f273c6df5c3f408112c4d9f6736684bd16a918be749df0124158

Observation 3e3254cc-eef4-463c-809c-ef6905da0b7a · outbound

This paper cites InInternational Conference on Mining Software Repositories (MSR).

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks InInternational Conference on Mining Software Repositories (MSR)

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.462725Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.462725Z digest=sha256:5ca7b0229914267e3b7ce86062f85a14a695e5b8727c7064f530006f0e6c41e9

Pith citing papers

No inbound Pith citation observations are available.