Pith. sign in

Paper Citation Record · LEDGER

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks

As of 13 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2411.15470.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.15470 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T14:18:33.462725Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-12T06:34:41.77262+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved23
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a15cd32a-7380-413f-ab81-b7377e0e3e04 · outbound

This paper cites Program Synthesis with Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Program Synthesis with Large Language Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:32.892227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:32.892227Z digest=sha256:369f1469f764c78933745e556a61a80f1a05031682a90312c964c936b781e9b7

Observation 57458435-431e-486b-a224-6afdd9082782 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:32.967088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:32.967088Z digest=sha256:3d517fed41843d3b391a5969880722e97e67ef1a631722157cae398a7edb125d

Observation 7e770cdd-864e-4d3c-8dc4-df9bee273bb4 · outbound

This paper cites On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.018383Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.018383Z digest=sha256:693d306a475014862fcd9a651d6b4d85007da7d764e657f311e969093773b602

Observation bf8a3c85-3d47-400c-b678-b1483b7fc7b7 · outbound

This paper cites Multi-lingual Evaluation of Code Generation Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.026719Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.026719Z digest=sha256:fb2de0f444cb8be8d3fb091acb85f7a137bbbd4668372466f042a4a90150bbcc

Observation 1f8e14df-3998-4b11-98c7-b4b2b332eb64 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Code Llama: Open Foundation Models for Code

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.035030Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.035030Z digest=sha256:e19c4d088d2884b29873ddad18a23475fc6ce0b40540bb3c87636675ae086f65

Observation 6b1b2ae1-1215-4283-98ef-016e1069ad00 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Measuring Coding Challenge Competence With APPS

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.042222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.042222Z digest=sha256:e506579ae1e591ea3f609737b171c2a395a701dc240d9923075427a0b0e99276

Observation f254911f-c9bc-4589-b7c6-b262e42e460f · outbound

This paper cites MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.053114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.053114Z digest=sha256:cec3de933aee03d16ba18f8b89ca0bd493563f55699a00be1dcbf1209a5c3a17

Observation 8d4fe1cf-5246-49a4-841d-c4cc7b3fe84a · outbound

This paper cites Evaluating Large Language Models Trained on Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Evaluating Large Language Models Trained on Code

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.062155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.062155Z digest=sha256:977b76e79d5098219d0093bf820dadfe14c35cb53fe5a99d4a309c6ce5abab3d

Observation 1c3e52fa-f3ef-4201-ae0b-0555f3f68570 · outbound

This paper cites OctoPack: Instruction Tuning Code Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks OctoPack: Instruction Tuning Code Large Language Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.074086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.074086Z digest=sha256:e929d6657c7c576e308ca4dd9833b7cf78e2de78e21a410fcdb198f724f05bff

Observation 0c3f486c-e727-45bc-bfe8-9042131eba0c · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.080993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.080993Z digest=sha256:e018342234e9af9d857959496f0b8c2c468838db55cd43a0f04a6b9332eb1271

Observation 50676c16-d061-4178-ba3c-ecc776037176 · outbound

This paper cites StarCoder: may the source be with you!.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks StarCoder: may the source be with you!

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.091264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.091264Z digest=sha256:9637cd34cbe0019885640162dbb1472e92a07b97df16aef1560c7d1e18cd11a1

Observation 27303d7d-965a-40b4-b0dd-882ba098deed · outbound

This paper cites TACO: Topics in Algorithmic COde generation dataset.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks TACO: Topics in Algorithmic COde generation dataset

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.132332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.132332Z digest=sha256:a9717d199d59a41ee71c9d90824d8c161b3ede4c6307fc61fd7691cd90920756

Observation 386c03d0-c26d-40b4-8042-136f936d4d0a · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.171783Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.171783Z digest=sha256:f2ecceecd69f0016dff8fbaa8c576c98711cdde78327694f0707834e879825a6

Observation eeec9c18-8edd-42c3-8eec-fa63b78c6e70 · outbound

This paper cites ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.226296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.226296Z digest=sha256:4d7646b474e82746fccbf28cea13eb2a376503c6fc6152fb4c1a8897d120150a

Observation c98449f9-fd4c-4965-b249-d7d226fe62b0 · outbound

This paper cites Large Language Models for Software Engineering: A Systematic Literature Review.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Large Language Models for Software Engineering: A Systematic Literature Review

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.292513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.292513Z digest=sha256:1b08d31ac6cb6a055dd8f186cb5adbeea763631fcce770f95baab0a024b18af7

Observation e1415567-f509-4d01-820e-e1978cce8057 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 17

Resolution
verified exact
doi, observed 2026-08-12T14:18:33.596964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-12T14:18:33.298965Z digest=sha256:065b1f58bf4a0fd6a132a3914f0d08eb8b616f2a837546d2c552cff811a58a26

Observation 0428b1a5-a8cb-4c65-976b-07f101dcf264 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.329781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.329781Z digest=sha256:cbe7b6058e962551f66ed2843ccf44eb8592aedb774ccf59d10ac0df99d8decf

Observation a7d1141c-347c-4e0e-8e5b-76646a087c6f · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-12T14:18:34.302782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-12T06:34:41.77262+00:00.

source=pdf_text observed=2026-08-12T14:18:33.380722Z digest=sha256:ade281cc0fd01c3d45b44274df6c172a2137832a99031794c2ff9d7d5ca183f8

Observation 28182b45-7165-406a-84b6-3b78e2c79706 · outbound

This paper cites CodeBLEU: a Method for Automatic Evaluation of Code Synthesis.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.390162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.390162Z digest=sha256:a383e2fc8875cba6df0aa2120fef861c902732013c234ef03d220da934946145

Observation ca89cb8a-fb04-45c2-8e54-b0912b2619af · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.395093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.395093Z digest=sha256:810631bee25bfe7b8d5d8e5f1673589d7ee8616f70a6fcee307798aad050e98c

Observation ac103ae9-9f7c-4b07-b64c-83b32906ca1b · outbound

This paper cites Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.401213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.401213Z digest=sha256:ca7e6eadbfa1c22a5b9f711063878fc126fe3b1be6961aa45b29ef62a67ce652

Observation 32e570a7-760e-4585-a6a7-d131d87e01f9 · outbound

This paper cites A Systematic Evaluation of Large Language Models of Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks A Systematic Evaluation of Large Language Models of Code

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.407633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.407633Z digest=sha256:3e903f9ea2df4f43f54ea3655c5510be258706844da306bb68abc730edb6bd0f

Observation 0702e6df-fc97-4507-bcfc-72e2a54aa6e3 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.427466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.427466Z digest=sha256:dc37616db785ccae951ddc4f579cca87c67720f3acae532dc6e48385f34cb6f8

Observation 3e3254cc-eef4-463c-809c-ef6905da0b7a · outbound

This paper cites InInternational Conference on Mining Software Repositories (MSR).

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks InInternational Conference on Mining Software Repositories (MSR)

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.462725Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.462725Z digest=sha256:4ec17cc55b166739627acfad48d778f68f6fbd149fe994cd005e7b4f7e4249fc

Pith citing papers

No inbound Pith citation observations are available.