Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-04T15:17:03.027678Z
Paper Citation Record · LEDGER
As of 5 August 2026, this Paper Citation Record lists 55 of 55 outbound references and 0 inbound Pith citation observations for arXiv:2509.20172.
A citation records a reference. It does not transfer a finding from one paper to another.
Typed states for the displayed outbound observations.
Source: paper_references, paper_reference_links, observed 2026-08-04T15:17:03.027678Z
One-hop event checks from named stored sources.
Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00
Pith citing papers itemized under the disclosed page cap.
Source: paper_references, paper_reference_links
A source-named dated measurement, never combined with another source.
Source: cited_works
55 of 55 outbound references displayed
External citation measurements
No source-named external measurement is stored.
Observation 9f886ea7-139f-471f-b4d5-efac0f22ccb5 · outbound
Benchmarking Web API Integration Code Generation API management market by platform, service – global forecast to 2029,
Reference 1
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation dba591db-f393-4c2e-951d-4f16beefdce7 · outbound
Benchmarking Web API Integration Code Generation 2024 state of the API report,
Reference 2
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c6877404-2ef4-408f-b85f-ecfd9595bd2c · outbound
Benchmarking Web API Integration Code Generation What Makes APIs Hard to Learn? Answers from Developers,
Reference 3
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation ef2cf524-5ef9-4c32-a9f5-c2aedb6eabfb · outbound
Benchmarking Web API Integration Code Generation A systematic mapping study of API usability evaluation methods,
Reference 4
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation c8568913-b302-44f2-906b-2ea176771fab · outbound
Benchmarking Web API Integration Code Generation The effects of generative ai on high skilled work: Evidence from three field experiments with software developers,
Reference 5
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 61591074-5619-4069-9546-f0ed32b2ed79 · outbound
Benchmarking Web API Integration Code Generation What’s Wrong with Your Code Generated by Large Language Models? An Extensive Study,
Reference 6
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9f532dfe-af01-4237-917f-3ed45e852067 · outbound
Benchmarking Web API Integration Code Generation Bugs in large language models generated code: an empirical study,
Reference 7
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2b0e08dc-6769-465e-8e05-257a82087b2a · outbound
Benchmarking Web API Integration Code Generation Asleep at the Keyboard? Assessing the Security of GitHub Copilot’s Code Contributions,
Reference 8
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2a0082ef-0b6a-4a6e-93ef-86a1d8e24ed4 · outbound
Benchmarking Web API Integration Code Generation Do Users Write More Insecure Code with AI Assistants?
Reference 9
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9b8d2475-35ed-45f6-974f-195565f3c70f · outbound
Benchmarking Web API Integration Code Generation AI copilot code quality: Evaluating 2024’s increased defect rate with data,
Reference 10
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation d5c1fc81-383d-4453-8aa6-dcf5b47d19a5 · outbound
Benchmarking Web API Integration Code Generation Pop Quiz! Do Pre-trained Code Models Possess Knowledge of Correct API Names?
Reference 11
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 19a3e1c7-667e-4b07-8f1c-66d5a820375c · outbound
Benchmarking Web API Integration Code Generation StarCoder: may the source be with you!
Reference 12
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a838c7a1-7976-474d-a22c-5ac750b25be0 · outbound
Benchmarking Web API Integration Code Generation StarCoder 2 and The Stack v2: The Next Generation
Reference 13
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f9dcc660-32aa-4528-b40b-9397484c39a3 · outbound
Benchmarking Web API Integration Code Generation DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligence
Reference 14
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation bffdae35-b5e3-47a9-aadb-895ce4ffa1b2 · outbound
Benchmarking Web API Integration Code Generation DeepSeek-Coder-V2: Breaking the Barrier of Closed-Source Models in Code Intelligence
Reference 15
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e90037e7-61e7-4d36-adc9-719bfec59e2b · outbound
Benchmarking Web API Integration Code Generation Qwen2.5-Coder Technical Report
Reference 16
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 94f27f53-fdfd-47a3-9503-ce81b3e1588c · outbound
Benchmarking Web API Integration Code Generation Code Llama: Open Foundation Models for Code
Reference 17
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f95bb112-add7-44ca-ba2b-cffb82d6dc76 · outbound
Benchmarking Web API Integration Code Generation The Llama 3 Herd of Models
Reference 18
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 03dc8307-8c15-4c0b-95fc-df7c082322b4 · outbound
Benchmarking Web API Integration Code Generation The state of API 2020 report,
Reference 19
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5bad4fd9-360c-4169-8b15-02a44fd7184d · outbound
Benchmarking Web API Integration Code Generation Most used programming languages among developers worldwide as of 2024,
Reference 20
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5e5bcab7-0833-4ec9-b8d5-c2a7709d812b · outbound
Benchmarking Web API Integration Code Generation State of JavaScript 2022,
Reference 21
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1aeb97e2-1dff-4070-b7cb-d008866ff414 · outbound
Benchmarking Web API Integration Code Generation Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm,
Reference 22
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0c79bca0-be8f-4b6f-ac8c-72c3221aa796 · outbound
Benchmarking Web API Integration Code Generation Out of the BLEU: How should we assess quality of the Code Generation models?
Reference 23
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 435cebe3-8a7f-4db7-9483-81c0fff94edd · outbound
Benchmarking Web API Integration Code Generation Evaluating Large Language Models Trained on Code
Reference 24
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 4b1edb8c-fb35-4a96-b846-a627def3e87e · outbound
Benchmarking Web API Integration Code Generation When to Stop? Towards Efficient Code Generation in LLMs with Excess Token Prevention,
Reference 25
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7f3fae43-74c2-4bb0-a78b-c343996b35e8 · outbound
Benchmarking Web API Integration Code Generation CodeT5+: Open Code Large Language Models for Code Understanding and Generation,
Reference 26
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 71cc2664-3144-45cb-a621-bc4fac3dca4c · outbound
Benchmarking Web API Integration Code Generation Building Natural Language Interfaces to Web APIs,
Reference 27
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5cca95d0-d948-4326-8580-78931d3e2bf5 · outbound
Benchmarking Web API Integration Code Generation Natural Language Interfaces with Fine-Grained User Interaction: A Case Study on Web APIs,
Reference 28
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f47ab8ae-8ae9-46c6-b0c1-4a409dce0010 · outbound
Benchmarking Web API Integration Code Generation Compositional Generalization for Natural Language Interfaces to Web APIs
Reference 29
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 1219ab74-f096-45eb-b829-27bc03a563d9 · outbound
Benchmarking Web API Integration Code Generation Dialog2API: Task-Oriented Dialogue with API Description and Example Programs
Reference 30
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 08c8fb11-0e0c-4107-a21e-6383c4024be2 · outbound
Benchmarking Web API Integration Code Generation On Mitigating Code LLM Hallucinations with API Documentation,
Reference 31
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 6db12b16-4228-4be1-81a1-028f0323574c · outbound
Benchmarking Web API Integration Code Generation Private- library-oriented code generation with large language models,
Reference 32
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5e331a65-27dc-4011-93fb-2cde3e66f2ff · outbound
Benchmarking Web API Integration Code Generation De-Hallucinator: Mitigating LLM Hallucinations in Code Generation Tasks via Iterative Grounding
Reference 33
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a2e8ae3e-ec0d-44ac-b4bb-24a00d688114 · outbound
Benchmarking Web API Integration Code Generation Applying RLAIF for Code Generation with API-usage in Lightweight LLMs
Reference 34
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 2ceb8590-d1f0-4e07-b11d-7259049fae68 · outbound
Benchmarking Web API Integration Code Generation Survey on Evaluation of LLM-based Agents
Reference 35
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5c5b9dbb-f00c-4f32-a965-1d319fd2a9d0 · outbound
Benchmarking Web API Integration Code Generation Toolformer: Language Models Can Teach Themselves to Use Tools,
Reference 36
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 04c7791b-5d00-4a55-a633-fc158382929f · outbound
Benchmarking Web API Integration Code Generation RestGPT: Connecting Large Language Models with Real-World RESTful APIs
Reference 37
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 5312b8c1-7cce-4bc2-ad72-504a2ad3cd83 · outbound
Benchmarking Web API Integration Code Generation API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMs,
Reference 38
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation e828686c-b513-4af0-a88c-d0d5d082f7bd · outbound
Benchmarking Web API Integration Code Generation ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIs,
Reference 39
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a680b009-e907-498b-9568-7ea9b14e69d7 · outbound
Benchmarking Web API Integration Code Generation Gorilla: Large Language Model Connected with Massive APIs,
Reference 40
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9f5e2faf-5ff2-4195-a381-f0049494b897 · outbound
Benchmarking Web API Integration Code Generation Berkeley function calling leaderboard,
Reference 41
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 93ec74f4-7fff-45a2-ae60-b626e64584ad · outbound
Benchmarking Web API Integration Code Generation ToolCoder: A Systematic Code-Empowered Tool Learning Framework for Large Language Models,
Reference 42
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation a4172447-56e8-4da9-a5f9-b5cd4243d4b9 · outbound
Benchmarking Web API Integration Code Generation Unveiling Memorization in Code Models,
Reference 43
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7e7fb5f7-a81d-4411-bca6-8c980192cd98 · outbound
Benchmarking Web API Integration Code Generation Exploring and Evaluating Hallucinations in LLM-Powered Code Generation,
Reference 44
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9a1502a5-27fd-4a73-a67e-dee8b3bce411 · outbound
Benchmarking Web API Integration Code Generation SAFEWAPI: web API misuse detector for web applications,
Reference 45
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 014cbe32-2936-4ec2-ba0c-6724d5c5629b · outbound
Benchmarking Web API Integration Code Generation A Large-scale Study on API Misuses in the Wild,
Reference 46
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 34866bfb-3cc5-413e-8767-d7bf9b64e74f · outbound
Benchmarking Web API Integration Code Generation APICAD: Augmenting API Misuse Detection through Specifications from Code and Documents,
Reference 47
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 9616dd24-ced3-43dd-a726-4beded3c57a0 · outbound
Benchmarking Web API Integration Code Generation jGuard: Program- ming Misuse-Resilient APIs,
Reference 48
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 0ae3d1d3-b9cf-42ad-b160-58433402a419 · outbound
Benchmarking Web API Integration Code Generation Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks,
Reference 49
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 891d55c3-d6e1-441e-a430-b33ce8812cad · outbound
Benchmarking Web API Integration Code Generation Lexically Constrained Decoding for Sequence Generation Using Grid Beam Search,
Reference 50
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 52371a09-1bda-4989-9bc3-ec4783d975b3 · outbound
Benchmarking Web API Integration Code Generation A General-Purpose Algorithm for Constrained Sequential Inference,
Reference 51
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation f48d7445-ae37-4e7d-9f8f-68907f545dc5 · outbound
Benchmarking Web API Integration Code Generation Available: https://doi.org/10.1016/j.cosrev.2019.05.001
Reference 2019
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 18129e41-dc94-4c81-8b5b-e5e86e3266ac · outbound
Benchmarking Web API Integration Code Generation Available: https://proceedings .neurips.cc/paper/2020/ hash/6b493230205f780e1bc26945df7481e5-Abstract.html
Reference 2020
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation 7a272bdd-7f2d-4de3-90dc-e6f452439e96 · outbound
Benchmarking Web API Integration Code Generation Available: http://papers .nips.cc/paper files/paper/2023/ hash/d842425e4bf79ba039352da0f658a906-Abstract-Conference.html
Reference 2023
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
Observation de6341d1-3f4b-40fb-838c-312fb97da6e4 · outbound
Benchmarking Web API Integration Code Generation Available: https://www .marketsandmarkets.com/Market- Reports/api-management-market-178266736.html
Reference 2024
Source-reported events for the cited work
Unavailable: canonical work link unavailable.
No inbound Pith citation observations are available.