Pith. sign in

Paper Citation Record · LEDGER

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks

As of 23 August 2026, this Paper Citation Record lists 24 of 24 outbound references and 0 inbound Pith citation observations for arXiv:2411.15470.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2411.15470 v1

Coverage vector

measured 24 of 24 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-12T14:18:33.462725Z

measured 24 of 24 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-23T06:30:58.430688+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

24 of 24 outbound references displayed

  • verified exact1
  • verified fuzzy0
  • unresolved23
  • parse uncertain0
  • malformed identifier0
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation a15cd32a-7380-413f-ab81-b7377e0e3e04 · outbound

This paper cites Program Synthesis with Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Program Synthesis with Large Language Models

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:32.892227Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:32.892227Z digest=sha256:55cfdbef4e45ec2122412cae117023138641d5ce377f3d1084ebcba4ab3c4eca

Observation 57458435-431e-486b-a224-6afdd9082782 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:32.967088Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:32.967088Z digest=sha256:ffb2f5f1a5824e43752122d875f759509eb5e45c782071112244050f05575e5a

Observation 7e770cdd-864e-4d3c-8dc4-df9bee273bb4 · outbound

This paper cites On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks On the Robustness of Code Generation Techniques: An Empirical Study on GitHub Copilot

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.018383Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.018383Z digest=sha256:bc9e6f278bf9738db460aaaebffd02246042dd86c755c2a4753ec60daa9fbe11

Observation bf8a3c85-3d47-400c-b678-b1483b7fc7b7 · outbound

This paper cites Multi-lingual Evaluation of Code Generation Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Multi-lingual Evaluation of Code Generation Models

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.026719Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.026719Z digest=sha256:8cd1efc12ec475337cf536f3d62b98072c18e6ecf0ff3061670e97e596b8da0a

Observation 1f8e14df-3998-4b11-98c7-b4b2b332eb64 · outbound

This paper cites Code Llama: Open Foundation Models for Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Code Llama: Open Foundation Models for Code

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.035030Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.035030Z digest=sha256:ef68bac772fb1e2d761a6c3e40ff25b3dc56065861dfba86ac7584bec8018142

Observation 6b1b2ae1-1215-4283-98ef-016e1069ad00 · outbound

This paper cites Measuring Coding Challenge Competence With APPS.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Measuring Coding Challenge Competence With APPS

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.042222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.042222Z digest=sha256:074910b66dc053d1daebe139b9610a0c7b02fb98dd0a598cc68876e4833f63b4

Observation f254911f-c9bc-4589-b7c6-b262e42e460f · outbound

This paper cites MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks MultiPL-E: A Scalable and Extensible Approach to Benchmarking Neural Code Generation

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.053114Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.053114Z digest=sha256:6d2f28d63c5e68b02338ce100438c147f42fbe19947281c3ea98f36a80ffb7d9

Observation 8d4fe1cf-5246-49a4-841d-c4cc7b3fe84a · outbound

This paper cites Evaluating Large Language Models Trained on Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Evaluating Large Language Models Trained on Code

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.062155Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.062155Z digest=sha256:548b9d59cdac245815273617edee45cb37a6de7ec3748a59fc81aec6b6c9d474

Observation 1c3e52fa-f3ef-4201-ae0b-0555f3f68570 · outbound

This paper cites OctoPack: Instruction Tuning Code Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks OctoPack: Instruction Tuning Code Large Language Models

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.074086Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.074086Z digest=sha256:ddb35c7ed9c8efefaaf28f537ec8aa32c9d65989496e6b70724e50a4cc72cd55

Observation 0c3f486c-e727-45bc-bfe8-9042131eba0c · outbound

This paper cites CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-X

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.080993Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.080993Z digest=sha256:e57ba83e57d8135e3cf7d991494ba66cd4d27f4d14b8153417e3728e27ef269d

Observation 50676c16-d061-4178-ba3c-ecc776037176 · outbound

This paper cites StarCoder: may the source be with you!.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks StarCoder: may the source be with you!

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.091264Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.091264Z digest=sha256:61eea0b712fb06cd659708928c4da935ed4061098a4477807d86021dcdd54fda

Observation 27303d7d-965a-40b4-b0dd-882ba098deed · outbound

This paper cites TACO: Topics in Algorithmic COde generation dataset.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks TACO: Topics in Algorithmic COde generation dataset

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.132332Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.132332Z digest=sha256:9931cc48abe35f433aae4e449ae3ad3edaf5857f51a26a601c600daeb9492ddd

Observation 386c03d0-c26d-40b4-8042-136f936d4d0a · outbound

This paper cites CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.171783Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.171783Z digest=sha256:0d2f9b77b773af817e332aa72f0755d531860f3bd1fc12d985a18f15553f37c5

Observation eeec9c18-8edd-42c3-8eec-fa63b78c6e70 · outbound

This paper cites ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks ClassEval: A Manually-Crafted Benchmark for Evaluating LLMs on Class-level Code Generation

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.226296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.226296Z digest=sha256:5157c507e6570673a7048133ccf7640fd4ed0cea208cbd1402d7335411dc0c60

Observation c98449f9-fd4c-4965-b249-d7d226fe62b0 · outbound

This paper cites Large Language Models for Software Engineering: A Systematic Literature Review.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Large Language Models for Software Engineering: A Systematic Literature Review

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.292513Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.292513Z digest=sha256:91e67b3854dfd965334d18445abef7046621942aa2d5ea118e55f2492580a0e8

Observation e1415567-f509-4d01-820e-e1978cce8057 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 17

Resolution
verified exact
doi, observed 2026-08-12T14:18:33.596964Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-12T14:18:33.298965Z digest=sha256:854409acc6b684328520bb052770f9dbf2164f5f6ee68ab4389426a46a91675c

Observation 0428b1a5-a8cb-4c65-976b-07f101dcf264 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.329781Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.329781Z digest=sha256:0cc5e7edcf9e1ae0e219b401efed9c12ba3e6a631b8dc00326553ee4813c454d

Observation a7d1141c-347c-4e0e-8e5b-76646a087c6f · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 19

Resolution
unresolved
raw_fallback, observed 2026-08-12T14:18:34.302782Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-23T06:30:58.430688+00:00.

source=pdf_text observed=2026-08-12T14:18:33.380722Z digest=sha256:70f73d734b5d54dd38da9fc6e177f90d48ef69d382d3aa8c786dfe69f976d33c

Observation 28182b45-7165-406a-84b6-3b78e2c79706 · outbound

This paper cites CodeBLEU: a Method for Automatic Evaluation of Code Synthesis.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeBLEU: a Method for Automatic Evaluation of Code Synthesis

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.390162Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.390162Z digest=sha256:4464df8ea3cbd9bf5f3774a8812f96fcbda2dce45cfb186fa2750df3729e19b5

Observation ca89cb8a-fb04-45c2-8e54-b0912b2619af · outbound

This paper cites CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation

Reference 21

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.395093Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.395093Z digest=sha256:fc2c24325908a5e1b71ffc9ad9f52ffc7a9d9947bb6f0371a4473da0de6341c4

Observation ac103ae9-9f7c-4b07-b64c-83b32906ca1b · outbound

This paper cites Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Exploring Parameter-Efficient Fine-Tuning Techniques for Code Generation with Large Language Models

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.401213Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.401213Z digest=sha256:b64e1d9760c6b5609a3979f56b37ed581022a9b63bbb9d4c8e78507cf59fb1ba

Observation 32e570a7-760e-4585-a6a7-d131d87e01f9 · outbound

This paper cites A Systematic Evaluation of Large Language Models of Code.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks A Systematic Evaluation of Large Language Models of Code

Reference 23

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.407633Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.407633Z digest=sha256:d7d9812de65502c82ef0d32db0cbe0787f23dc00aff6f9a954e101217fd5d8da

Observation 0702e6df-fc97-4507-bcfc-72e2a54aa6e3 · outbound

This paper cites an unresolved cited work.

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks Unresolved cited work

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.427466Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.427466Z digest=sha256:0d52ff4b7db5362b124c9565c345d58ce6b67699f22ad649703bf1350503c5ac

Observation 3e3254cc-eef4-463c-809c-ef6905da0b7a · outbound

This paper cites InInternational Conference on Mining Software Repositories (MSR).

A Preliminary Study of Multilingual Code Language Models for Code Generation Task Using Translated Benchmarks InInternational Conference on Mining Software Repositories (MSR)

Reference 2018

Resolution
unresolved
no resolver link, observed 2026-08-12T14:18:33.462725Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-12T14:18:33.462725Z digest=sha256:9d32711ab9ab05caf8328bf1917f2c4dadcf7d3ddb4533cf7c769a86e3dd0557

Pith citing papers

No inbound Pith citation observations are available.