LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs | Paper Citation Record

Observation a3673a36-0aec-45ff-bdbb-d2efb3f18b83 · outbound

This paper cites A Survey of LLM Inference Systems.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A Survey of LLM Inference Systems

Reference 1

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.344634Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e052671b-2ac7-412c-9ed1-46f88f719403 · outbound

This paper cites A survey on evaluation of large language models,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A survey on evaluation of large language models,

Reference 2

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.350275Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a444923f-0b42-4494-b014-1fd7ee42d66c · outbound

This paper cites Towards efficient generative large language model serving: A survey from algorithms to systems,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Towards efficient generative large language model serving: A survey from algorithms to systems,

Reference 3

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.354459Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation be419be5-d137-4cbc-a76c-4673cf824697 · outbound

This paper cites Thunderserve: High-performance and cost-efficient llm serving in cloud environments,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Thunderserve: High-performance and cost-efficient llm serving in cloud environments,

Reference 4

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.358230Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1a593f6f-8d64-4687-9eda-7fb9492f8522 · outbound

This paper cites Efficient memory management for large language model serving with page- dattention,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Efficient memory management for large language model serving with page- dattention,

Reference 5

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.362518Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 97a8ab5b-6ef9-4536-bcc7-6f47b6043a1b · outbound

This paper cites Sglang: Efficient execution of structured language model pro- grams,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Sglang: Efficient execution of structured language model pro- grams,

Reference 6

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.366508Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5533bfcc-abeb-4f38-b73e-1d70731c25e3 · outbound

This paper cites Official document of tensorrt,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of tensorrt,

Reference 7

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.370426Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a355b0e5-8cd3-4eaa-a0ed-df71cb5a72f1 · outbound

This paper cites Official document of lmdeploy,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of lmdeploy,

Reference 8

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.374482Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e9df915f-3e37-4ed3-a527-2226fa50f0ea · outbound

This paper cites Official document of flashinfer,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of flashinfer,

Reference 9

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.377992Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a1676db1-6079-4001-8d51-2da8faf011ae · outbound

This paper cites Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models

Reference 10

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.381697Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation ec33ef9f-be68-476f-8a3e-c89ac65c5000 · outbound

This paper cites Efficient Large Language Models: A Survey.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Efficient Large Language Models: A Survey

Reference 11

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.385913Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d6ffad8b-2c7e-4e33-997d-4f4dd601b778 · outbound

This paper cites A Survey of Resource-efficient LLM and Multimodal Foundation Models.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A Survey of Resource-efficient LLM and Multimodal Foundation Models

Reference 12

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.390091Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5df508dc-a31c-424f-828c-90152a5cc94c · outbound

This paper cites Unlocking efficiency in large language model inference: A comprehensive survey of speculative decoding,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Unlocking efficiency in large language model inference: A comprehensive survey of speculative decoding,

Reference 14

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.397429Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 689dfee7-f42a-425c-9be6-262a46233833 · outbound

This paper cites Model Compression and Efficient Inference for Large Language Models: A Survey.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Model Compression and Efficient Inference for Large Language Models: A Survey

Reference 15

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.400818Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation bbb05503-d6d7-459e-8704-7e3ab046db8f · outbound

This paper cites A survey on model compression for large language models,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A survey on model compression for large language models,

Reference 16

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.404285Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5835481e-a495-4a67-b0b1-29c78bc9202a · outbound

This paper cites Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Hybrid LLM: Cost-Efficient and Quality-Aware Query Routing

Reference 17

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.408267Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 90d5df3a-1865-46fa-834e-b508b34b7a38 · outbound

This paper cites {Cost-Efficient}large language model serving for multi-turn conversations with{CachedAttention},.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs {Cost-Efficient}large language model serving for multi-turn conversations with{CachedAttention},

Reference 18

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.413557Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 8b0c0ae6-aea2-4b2f-be65-e4d50e01addb · outbound

This paper cites Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity

Reference 19

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.417189Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 51420edf-b54f-4994-895d-517031d632bc · outbound

This paper cites Evaluation of tools and frame- works for machine learning model serving,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Evaluation of tools and frame- works for machine learning model serving,

Reference 20

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.420832Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 3fd652c3-fb28-401e-8674-b525ca14bc30 · outbound

This paper cites AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs AIBrix: Towards Scalable, Cost-Effective Large Language Model Inference Infrastructure

Reference 21

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.424216Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 49beadff-3266-48e5-ac2f-55b1f20591be · outbound

This paper cites Majidi, M.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Majidi, M

Reference 22

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.427615Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4fc7c856-2ce8-43c5-91f8-a1b6d37cc651 · outbound

This paper cites What is artificial intelligence (ai)?.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs What is artificial intelligence (ai)?

Reference 23

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.431184Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 06ee8274-b6c8-4cd4-9a77-07c008dfec4c · outbound

This paper cites an unresolved cited work.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Unresolved cited work

Reference 24

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.434447Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f8aed055-b4ce-4386-bc90-eecca482c520 · outbound

This paper cites Defining intelligence: Bridging the gap between human and artificial perspectives,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Defining intelligence: Bridging the gap between human and artificial perspectives,

Reference 25

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.437948Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a6156760-6396-491a-b093-fd00ef40b5a4 · outbound

This paper cites Generative ai,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Generative ai,

Reference 26

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.441337Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7293cc59-7ed0-4d35-86c2-b40bc2d4e7f4 · outbound

This paper cites Generative artificial intelligence,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Generative artificial intelligence,

Reference 27

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.444957Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 52292cf6-a111-4115-949f-751e87e6ae09 · outbound

This paper cites What is generative ai?.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs What is generative ai?

Reference 28

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.448436Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 205b5eae-0d39-49c0-b184-5a39a1b01124 · outbound

This paper cites A Comprehensive Overview of Large Language Models.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A Comprehensive Overview of Large Language Models

Reference 29

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.451963Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4833ccf9-aaab-4962-af0e-576380656b31 · outbound

This paper cites What are large language models (llms)?.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs What are large language models (llms)?

Reference 30

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.455877Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f05dd931-24fb-4f40-97a1-95c4bcd6a7fa · outbound

This paper cites Large language models meet nlp: A survey,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Large language models meet nlp: A survey,

Reference 31

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.717611Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6bf6f9b4-1226-488f-a548-774416c90592 · outbound

This paper cites Large Language Models: A Survey.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Large Language Models: A Survey

Reference 32

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.462860Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c718c359-8348-4b6d-a05a-c22ca13b928c · outbound

This paper cites A survey on multimodal large language models,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A survey on multimodal large language models,

Reference 33

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.466417Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 4d129d69-039e-410d-b9a0-61dc78d136cf · outbound

This paper cites A survey of state of the art large vision language models: Benchmark evaluations and challenges,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A survey of state of the art large vision language models: Benchmark evaluations and challenges,

Reference 34

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.699422Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c7285766-be12-450d-b2dd-7c9808334726 · outbound

This paper cites Large language models in medical and healthcare fields: applications, advances, and challenges,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Large language models in medical and healthcare fields: applications, advances, and challenges,

Reference 35

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.688799Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d9d65e2a-35af-47e7-aace-bd47879eaa4c · outbound

This paper cites A Survey on Large Language Model-empowered Autonomous Driving.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A Survey on Large Language Model-empowered Autonomous Driving

Reference 37

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.481199Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f6c7899e-710a-4547-adc7-559069842108 · outbound

This paper cites Actuarygpt: Applications of large language models to insurance and ac- tuarial work,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Actuarygpt: Applications of large language models to insurance and ac- tuarial work,

Reference 38

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.678448Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 22b1023a-e8a0-462f-be27-d48ff8304e2c · outbound

This paper cites A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challenges

Reference 39

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.488867Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 5cdbc65a-d476-4065-995d-633553ff63fb · outbound

This paper cites A Survey on Efficient Inference for Large Language Models.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A Survey on Efficient Inference for Large Language Models

Reference 40

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.492897Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 6fbaf3cc-a677-418e-8cd6-2a0e0d9f82a5 · outbound

This paper cites An efficient model maintenance ap- proach for mlops,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs An efficient model maintenance ap- proach for mlops,

Reference 41

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.667615Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 93cc29c3-d876-434e-b738-9137fc52438f · outbound

This paper cites Sprout: Green generative ai with carbon- efficient llm inference,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Sprout: Green generative ai with carbon- efficient llm inference,

Reference 42

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.657256Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 625cb309-6809-4c0f-91b8-19299cb14870 · outbound

This paper cites Measuring and improving the energy effi- ciency of large language models inference,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Measuring and improving the energy effi- ciency of large language models inference,

Reference 43

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.644823Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 219c144b-7d78-43c2-9905-b4567c2a87fd · outbound

This paper cites An empirical study on the usage of au- tomated machine learning tools,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs An empirical study on the usage of au- tomated machine learning tools,

Reference 44

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.634208Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation fa04e472-1d81-4c54-9ab0-ae4e4143b3b0 · outbound

This paper cites Github rest api,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Github rest api,

Reference 45

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.623460Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 147f1170-cb17-4c54-ab00-a9c96bbc7e6b · outbound

This paper cites Real Faults in Model Context Protocol (MCP) Software: a Comprehensive Taxonomy.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Real Faults in Model Context Protocol (MCP) Software: a Comprehensive Taxonomy

Reference 46

Resolution: verified exact; local_arxiv, observed 2026-08-15T14:55:57.069621Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 20350623-d13c-4078-a282-0b5eb82422d4 · outbound

This paper cites Characterizing Faults in Agentic AI: A Taxonomy of Types, Symptoms, and Root Causes.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Characterizing Faults in Agentic AI: A Taxonomy of Types, Symptoms, and Root Causes

Reference 47

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.521463Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 9a4e3fc1-a82b-4b69-ba6a-1e75fa6dbccf · outbound

This paper cites The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs The Rise of AI Teammates in Software Engineering (SE) 3.0: How Autonomous Coding Agents Are Reshaping Software Engineering

Reference 48

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.526054Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation da7f103a-799b-4d3f-8885-db3ae56842a1 · outbound

This paper cites Bug character- ization in machine learning-based systems,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Bug character- ization in machine learning-based systems,

Reference 49

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.613124Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 119aeb00-9a17-4e66-93c0-011282f4c180 · outbound

This paper cites Fault Localization in Deep Learning-based Software: A System-level Approach.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Fault Localization in Deep Learning-based Software: A System-level Approach

Reference 50

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.534446Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 663148f4-c589-4b8d-9978-0d8b1d596766 · outbound

This paper cites Bugs in machine learning- based systems: a faultload benchmark,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Bugs in machine learning- based systems: a faultload benchmark,

Reference 51

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.602363Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 8fb0cac4-0a9d-4619-a098-9d5b5419d5f0 · outbound

This paper cites Official document of vllm,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of vllm,

Reference 52

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.592224Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 233b346d-d04d-4891-aff1-e68d7816e3c1 · outbound

This paper cites Abstract syntax tree,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Abstract syntax tree,

Reference 53

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.581807Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 568902fa-dfa8-4be8-b60d-a58e50ff187f · outbound

This paper cites About readmes,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs About readmes,

Reference 54

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.571366Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4a71f241-c938-4098-a0fa-730335c44cf3 · outbound

This paper cites Study the correlation between the readme file of github projects and their popularity,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Study the correlation between the readme file of github projects and their popularity,

Reference 55

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.560480Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 230de082-ba69-4f03-9b83-a72331ec6f7d · outbound

This paper cites Classifying your repository with topics,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Classifying your repository with topics,

Reference 56

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.549530Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4115aaaa-a834-4cac-8b3b-cf5e5c1e362d · outbound

This paper cites (2026) Gpt-4o mini.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs (2026) Gpt-4o mini

Reference 57

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.539557Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 79e4948d-3af9-4534-8d71-b3071fcfc877 · outbound

This paper cites Generating GitHub Repository Descriptions: A Comparison of Manual and Automated Approaches.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Generating GitHub Repository Descriptions: A Comparison of Manual and Automated Approaches

Reference 58

Resolution: verified exact; local_arxiv, observed 2026-08-15T14:55:57.024863Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4a2081d3-4ceb-4b47-8413-9f3f50fdafe4 · outbound

This paper cites Mining software reposito- ries for software architecture—a systematic mapping study,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Mining software reposito- ries for software architecture—a systematic mapping study,

Reference 59

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.529568Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation c25d43a7-5d1c-461a-8638-3f6271a93321 · outbound

This paper cites Uncovering concerns of citizens through machine learning and social network sentiment analysis,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Uncovering concerns of citizens through machine learning and social network sentiment analysis,

Reference 60

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.517971Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 7c71447d-61ae-4520-aa30-57f746a34966 · outbound

This paper cites Prioritizing App Reviews for Developer Responses on Google Play.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Prioritizing App Reviews for Developer Responses on Google Play

Reference 61

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.580296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation a18d5f94-057a-402b-a738-920493e98e2f · outbound

This paper cites Sentence-bert: Sentence embeddings using siamese bert- networks,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Sentence-bert: Sentence embeddings using siamese bert- networks,

Reference 62

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.507735Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9d2d3e66-3bc5-484f-8375-8b3caf4bbee6 · outbound

This paper cites Llm-assisted topic reduction for bertopic on social media data,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Llm-assisted topic reduction for bertopic on social media data,

Reference 63

Resolution: verified exact; raw_fallback, observed 2026-08-15T14:55:56.996567Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9e997147-2d58-4a1d-a749-2f409b2163b6 · outbound

This paper cites Security vulnerabilities in ai-generated code: A large-scale analysis of public github repositories,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Security vulnerabilities in ai-generated code: A large-scale analysis of public github repositories,

Reference 64

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.496809Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 12360636-8f0d-4252-b93d-44bee94fc1ad · outbound

This paper cites An empirical study of blockchain repositories in github,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs An empirical study of blockchain repositories in github,

Reference 65

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.485807Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 5e873c3e-7d3b-48b4-9549-5509f6dcc8df · outbound

This paper cites Ray: A distributed framework for emerging{AI}applica- tions,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Ray: A distributed framework for emerging{AI}applica- tions,

Reference 66

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.475711Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 43c24151-d9e2-48c4-8cd5-3711688439d1 · outbound

This paper cites Official document of openllm,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of openllm,

Reference 67

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.465565Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 71fd8b85-737f-4d26-b777-051b3a015437 · outbound

This paper cites Official document of routellm,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of routellm,

Reference 68

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.453789Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation d2324a7b-271f-4bad-a74c-2bb86b68ba66 · outbound

This paper cites Official document of sglang,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of sglang,

Reference 69

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.443311Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 03b5b94a-5d94-4b95-a877-8af975eef4d9 · outbound

This paper cites Official document of ray,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of ray,

Reference 70

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.432118Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9bad6075-9da0-4da4-b9e1-31b822136084 · outbound

This paper cites Official document of lightllm,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of lightllm,

Reference 71

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.421356Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 3a7c6662-97b8-41f3-ad7f-70b41ce76994 · outbound

This paper cites Official document of fastdeploy,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Official document of fastdeploy,

Reference 72

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.411029Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4d926ca6-5db6-4c6f-9c7c-25a4960d64e8 · outbound

This paper cites Flashinfer: Efficient and customizable attention engine for llm inference serving,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Flashinfer: Efficient and customizable attention engine for llm inference serving,

Reference 73

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.400858Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 87c72b18-1423-4970-92e9-e9b572cdfcb1 · outbound

This paper cites Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Mell: Memory-Efficient Large Language Model Serving via Multi-GPU KV Cache Management

Reference 74

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.631328Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation c7ca2c38-8a98-4558-a2ac-70554602d9cb · outbound

This paper cites A universal load balanc- ing principle and its application to large language model serving,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A universal load balanc- ing principle and its application to large language model serving,

Reference 75

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.635306Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation d0d9493b-b3e0-48a0-b357-12967a5b239f · outbound

This paper cites Layerskip: Enabling early exit inference and self-speculative decoding,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Layerskip: Enabling early exit inference and self-speculative decoding,

Reference 76

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.389994Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6a861287-9e5e-4a0f-9a27-43f70c7f2f76 · outbound

This paper cites Llm inference serving: Survey of recent advances and opportunities,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Llm inference serving: Survey of recent advances and opportunities,

Reference 77

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.379657Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 554022d7-55d5-4ee5-9109-d323309fb824 · outbound

This paper cites Efficiently scaling transformer inference,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Efficiently scaling transformer inference,

Reference 78

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.646376Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 06070ec0-ff47-4d03-9eaa-e1f5f9863956 · outbound

This paper cites Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Systematic Characterization of LLM Quantization: A Performance, Energy, and Quality Perspective

Reference 79

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.649990Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation f3d52ff8-0ba8-4744-8eb2-0dd4dc50c257 · outbound

This paper cites Qlora: Efficient finetuning of quantized llms,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Qlora: Efficient finetuning of quantized llms,

Reference 80

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.653752Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation e5e830db-a1d9-4681-90f6-41d890492775 · outbound

This paper cites LoRA: Low-rank adaptation of large language models,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs LoRA: Low-rank adaptation of large language models,

Reference 81

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.356960Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 76375f0f-5095-4700-9843-426a27d14a46 · outbound

This paper cites A survey on lora of large language models,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A survey on lora of large language models,

Reference 82

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.345808Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 496a5b22-079e-4db8-86cd-4c02b61f12ed · outbound

This paper cites Retentive Network: A Successor to Transformer for Large Language Models.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Retentive Network: A Successor to Transformer for Large Language Models

Reference 83

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.665126Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 7c3f2ae8-1e60-48f9-805c-417d72994f9e · outbound

This paper cites Rwkv: Reinventing rnns for the transformer era,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Rwkv: Reinventing rnns for the transformer era,

Reference 84

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.668960Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 51364055-1a37-4d9b-9f29-044e4e139b1c · outbound

This paper cites Non-Autoregressive Neural Machine Translation.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Non-Autoregressive Neural Machine Translation

Reference 85

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.672535Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 748413d1-95e3-4c70-b502-411f6d1d5367 · outbound

This paper cites Parallelism and scaling,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Parallelism and scaling,

Reference 86

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.328674Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 592c4a65-c676-44d9-8455-1b5b528f2304 · outbound

This paper cites Performance and tuning: Chunked prefill,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Performance and tuning: Chunked prefill,

Reference 87

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.317920Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation ed466b52-5300-4f47-ae7d-2fcb52c50d34 · outbound

This paper cites Quantization,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Quantization,

Reference 88

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.307349Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 283c8bc8-5eaf-4dc4-81d1-1184fef86652 · outbound

This paper cites Overview,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Overview,

Reference 89

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.296897Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 6edda610-8161-4981-b982-74b05aad2510 · outbound

This paper cites Multi-head, multi-query, and group-query attention,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Multi-head, multi-query, and group-query attention,

Reference 90

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.286012Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a457f8ad-baad-483a-b778-486b1194f0f9 · outbound

This paper cites Parallelism in tensorrt llm,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Parallelism in tensorrt llm,

Reference 91

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.274793Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 9a9eeff6-34cc-454e-a3dd-428aa712d656 · outbound

This paper cites Quantization,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Quantization,

Reference 92

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.263490Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation dace80fa-6d51-48a0-8e36-548887227b73 · outbound

This paper cites FlexGen: High-throughput generative inference of large language models with a single GPU,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs FlexGen: High-throughput generative inference of large language models with a single GPU,

Reference 93

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.251723Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 73187ce2-58d1-417a-840e-3e7a7745b292 · outbound

This paper cites DISP-LLM: Dimension-independent structural pruning for large language models,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs DISP-LLM: Dimension-independent structural pruning for large language models,

Reference 94

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.240861Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation a83e8c32-0a1b-4330-8389-015c3ff38218 · outbound

This paper cites Challenges in deploying machine learning: A survey of case studies,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Challenges in deploying machine learning: A survey of case studies,

Reference 95

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.229967Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 583995c2-ab6b-48c8-86de-041c811c935b · outbound

This paper cites A survey of machine learning in edge computing: Techniques, frameworks, applications, issues, and research directions,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A survey of machine learning in edge computing: Techniques, frameworks, applications, issues, and research directions,

Reference 96

Resolution: verified exact; doi, observed 2026-08-15T14:55:56.773616Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4ee668c2-3338-4fac-9708-332017d83d63 · outbound

This paper cites Post-Training Large Language Models via Reinforcement Learning from Self-Feedback.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Post-Training Large Language Models via Reinforcement Learning from Self-Feedback

Reference 97

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.722273Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation eb5d1063-ebb3-4017-a5a0-6497f7720951 · outbound

This paper cites Reinforcement Learning for Reasoning in Large Language Models with One Training Example.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Reinforcement Learning for Reasoning in Large Language Models with One Training Example

Reference 98

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.726629Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation fe3d2808-d092-423a-8882-fa0b635a7de0 · outbound

This paper cites Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Demystifying Cost-Efficiency in LLM Serving over Heterogeneous GPUs

Reference 99

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.730544Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Observation 1ff31554-cb92-4038-98a2-64061ab87ccc · outbound

This paper cites A study of llms’ preferences for libraries and programming languages,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs A study of llms’ preferences for libraries and programming languages,

Reference 100

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.219332Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 936fbff5-9ebc-410a-aabd-7b63b1fad746 · outbound

This paper cites The promises and perils of mining github,.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs The promises and perils of mining github,

Reference 101

Resolution: verified fuzzy; raw_fallback, observed 2026-08-15T14:55:57.208455Z

Source-reported events for the cited work

No event found in the named queried sources as of 2026-08-15T06:32:42.880941+00:00.

Observation 4c301483-5469-4739-af58-26596bd809f9 · outbound

This paper cites Available: https://doi.org/10.1145/3533378.

LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs Available: https://doi.org/10.1145/3533378

Reference 2022

Resolution: unresolved; no resolver link, observed 2026-08-15T14:55:56.713551Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

Coverage vector

Reference resolution

Outbound references

Pith citing papers