Pith. sign in

Paper Citation Record · LEDGER

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads

As of 4 August 2026, this Paper Citation Record lists 59 of 59 outbound references and 0 inbound Pith citation observations for arXiv:2607.18253.

A citation records a reference. It does not transfer a finding from one paper to another.

pith.paper-citation-record.v1
2607.18253 v1

Coverage vector

measured 59 of 59 reference resolution

Typed states for the displayed outbound observations.

Source: paper_references, paper_reference_links, observed 2026-08-02T14:08:03.850772Z

measured 59 of 59 standing notices

One-hop event checks from named stored sources.

Source: scholarly_work_events, retraction_status_cache, observed 2026-08-04T06:34:03.388597+00:00

measured 0 of 0 inbound itemization

Pith citing papers itemized under the disclosed page cap.

Source: paper_references, paper_reference_links

measured 0 of 1 external citation measurements

A source-named dated measurement, never combined with another source.

Source: cited_works

Reference resolution

59 of 59 outbound references displayed

  • verified exact0
  • verified fuzzy0
  • unresolved58
  • parse uncertain0
  • malformed identifier1
  • metadata mismatch0

External citation measurements

No source-named external measurement is stored.

Outbound references

Observation 94c272d0-7507-4284-b9b4-a1a0799f5355 · outbound

This paper cites Gulavani, Ramachan- dran Ramjee, and Alexey Tumanov.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Gulavani, Ramachan- dran Ramjee, and Alexey Tumanov

Reference 1

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:57.586536Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:57.586536Z digest=sha256:5bde08faa2f8e4cd37edd35f1dbb954e68a10412a74c97c1550c7520b60d7ab4

Observation 9d553330-0b46-45dc-ae72-9ee05ce21503 · outbound

This paper cites Gulavani, Alexey Tumanov, and Ramachandran Ramjee.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Gulavani, Alexey Tumanov, and Ramachandran Ramjee

Reference 2

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:57.664635Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:57.664635Z digest=sha256:1a5d95d30b7f7542daab1fe5dce72fb1a2e5c39e07857cce96ed165d95eda901

Observation e50a210a-996c-4ce1-a368-50be045c6bfd · outbound

This paper cites Alibaba cloud model studio: Model invocation pricing, 2026.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Alibaba cloud model studio: Model invocation pricing, 2026

Reference 3

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:57.765184Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:57.765184Z digest=sha256:9a0bb5bbc1b25e5a3d2d11ee5d76e703f8347e903ec420e6b716044851878c43

Observation 1988d571-12fe-4f7b-ab32-c461e4bb4995 · outbound

This paper cites Federate the router: Learning language model routers with sparse and decentralized evaluations, 2026.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Federate the router: Learning language model routers with sparse and decentralized evaluations, 2026

Reference 4

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:57.847003Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:57.847003Z digest=sha256:acf404f17de4af66eed3e3feaede2e5432621a75d6596793d2b4ca57f1a82777

Observation 9eb0e72a-3a9d-4516-ab25-f964eaa85f0f · outbound

This paper cites Optimal scheduling algorithms for llm inference: Theory and practice.Proc.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Optimal scheduling algorithms for llm inference: Theory and practice.Proc

Reference 5

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.016742Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.016742Z digest=sha256:4f4c2fae49abee988f4449bace853c6a09b92280b1f1beafb2e5fd168302221e

Observation 2882e4c1-6b2d-4506-a53c-8b8f629b6bf4 · outbound

This paper cites Boerner, Stephen Deems, Thomas R.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Boerner, Stephen Deems, Thomas R

Reference 6

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.127113Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.127113Z digest=sha256:fba33cc3719aeca63a37b173206632c46aa48b5c1051a2d68f39e20b29fd75e4

Observation 67cb3181-0b62-4b1a-a1b9-ac0a076d55d0 · outbound

This paper cites Learning compact representations of llm abilities via item response theory, 2025.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Learning compact representations of llm abilities via item response theory, 2025

Reference 7

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.214930Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.214930Z digest=sha256:e3c26a613465dbe416d7124779c4147f2fd2fb60cd96a3c09a6af2df781dc6a2

Observation 337d635a-df40-4270-a9dc-06f8fabde3ef · outbound

This paper cites Frugalgpt: How to use large language models while reducing cost and improving performance.Transactions on Machine Learning Research, 2024.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Frugalgpt: How to use large language models while reducing cost and improving performance.Transactions on Machine Learning Research, 2024

Reference 8

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.301940Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.301940Z digest=sha256:825e3fc17ed285f046304ddc61c821e8fd6b88235134c4a9a34bd1d759435e6c

Observation 53536e45-15f4-417e-937b-f5844c40d498 · outbound

This paper cites Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Block: Balancing Load in LLM Serving with Context, Knowledge and Predictive Scheduling

Reference 9

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.436874Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.436874Z digest=sha256:8cd890f24d27502c113f852d1e624c5b07da4df2545e535935bdce7ee6b2097e

Observation ee889630-be2c-4c54-ab3f-9c2fd95a559b · outbound

This paper cites A unified approach to routing and cascading for LLMs.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads A unified approach to routing and cascading for LLMs

Reference 10

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.544887Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.544887Z digest=sha256:3aebe2493f0c85e78e1c64fd04107e8b29d9c083a7933e15cd5e44d8df79eaa6

Observation ea5db281-1b53-4154-9325-4490bbd4262a · outbound

This paper cites an unresolved cited work.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Unresolved cited work

Reference 11

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.722462Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.722462Z digest=sha256:f6000766c3a03f2103cb660d72150cf140e6c8e74bf1d7d0a5605470a18c8844

Observation ba790edc-b622-499e-9cac-c33e551b1ba9 · outbound

This paper cites an unresolved cited work.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Unresolved cited work

Reference 12

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.839066Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.839066Z digest=sha256:be6e4c2d027a8c761a88ba0d5360886500df09c317e4dd7b4504f358f02b5c81

Observation 1427b21b-0e0a-4210-84ac-28623b2307ab · outbound

This paper cites Hierarchical neural story generation.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Hierarchical neural story generation

Reference 13

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:58.952345Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:58.952345Z digest=sha256:239b9aef4ac1025f1ad1255acd1bf4bc7ae851c87531e896439b03bd5015e3d3

Observation 691c541f-f017-4fdf-a61d-6d2781a0ecbc · outbound

This paper cites The markov-modulated poisson process (mmpp) cookbook.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads The markov-modulated poisson process (mmpp) cookbook

Reference 14

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.046008Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.046008Z digest=sha256:bd7118c39e8981b2f072638f9e9b4397938bdfb5a97e04c7a97a31d5e1f3848b

Observation dd117b2c-c564-4712-be53-68089e231555 · outbound

This paper cites Efficient LLM scheduling by learning to rank.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Efficient LLM scheduling by learning to rank

Reference 15

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.175611Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.175611Z digest=sha256:7423ffabc2f0cf01778d2bc2271e441a3d692d8c8bb005eea4e23613053c48c1

Observation c847f8e6-7bb2-40c9-b76c-0e84965261b6 · outbound

This paper cites Gemini: A Family of Highly Capable Multimodal Models.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Gemini: A Family of Highly Capable Multimodal Models

Reference 16

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.294487Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.294487Z digest=sha256:7b0609b836274450622fc479324fb8ba29027051242f67d08e3a0cea97d5a3af

Observation c323f8ff-94e5-47e9-ac67-271631dbec0d · outbound

This paper cites Past-future scheduler for llm serving under sla guarantees.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Past-future scheduler for llm serving under sla guarantees

Reference 17

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.382553Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.382553Z digest=sha256:741c6756d1ea415883bee259932559384bcaae4b122ed6f7821218c892fd9f8a

Observation 7c3ddefb-1ac5-4aaa-a9b2-35192348b966 · outbound

This paper cites Li, and Richard Socher.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Li, and Richard Socher

Reference 18

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.462587Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.462587Z digest=sha256:42a7cf39d04b8be6677db498b2c79d860a26445d881ae77ba8cafe989a2bf8b8

Observation 26770c53-fb4b-4c55-86ba-cfa95541c43a · outbound

This paper cites Routerbench: A benchmark for multi-LLM routing system.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Routerbench: A benchmark for multi-LLM routing system

Reference 19

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.542939Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.542939Z digest=sha256:54a3764897b08384cd0246328bd816fc27c68f6d971f0731a275881658772512

Observation 03f5a96c-5519-45f6-9c5f-917449ee6274 · outbound

This paper cites SLO-Aware Scheduling for Large Language Model Inferences.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads SLO-Aware Scheduling for Large Language Model Inferences

Reference 20

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.627222Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.627222Z digest=sha256:ee998231e678f259922d0d304ef06a123dd98d3fc3d2951a816d603f66416f62

Observation d3948040-18a7-42c1-8505-f1f0860984a3 · outbound

This paper cites Efficient attentions for long document summarization.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Efficient attentions for long document summarization

Reference 21

Resolution
malformed identifier
no resolver link, observed 2026-08-02T14:07:59.709780Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.709780Z digest=sha256:9d1b6757ad409039cd4be54c7e4f3f2df49abaddd99d81ef0e9b6944e93a053d

Observation e6231b84-e9a5-44f9-a2bb-bab933f79809 · outbound

This paper cites Predicting llm inference latency: A roofline-driven ml method.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Predicting llm inference latency: A roofline-driven ml method

Reference 22

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.792244Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.792244Z digest=sha256:766abd27d9fec43096abc6e79b19762ffcabff2e35a285ae67029b8af27e6e33

Observation 9c32df46-bcf5-4941-8ca6-0959b5d8e5d5 · outbound

This paper cites Universal model routing for efficient LLM inference.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Universal model routing for efficient LLM inference

Reference 24

Resolution
unresolved
no resolver link, observed 2026-08-02T14:07:59.951925Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:07:59.951925Z digest=sha256:1f0f02b5f39edb984c339bd5dc580496b34db700ee9c73045d94fc0b8ba4673a

Observation 99f356c4-6c66-46a0-b2a0-6dd908d90882 · outbound

This paper cites Lightgbm: A highly efficient gradient boosting decision tree.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Lightgbm: A highly efficient gradient boosting decision tree

Reference 25

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.010405Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.010405Z digest=sha256:d1b90236a3696042f89dfd2042575b3b540847d62c6f68a388935956e5f97f4c

Observation f6e95019-0927-4f7a-b511-8c979f44582d · outbound

This paper cites Efficient memory management for large language model serving with pagedattention.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Efficient memory management for large language model serving with pagedattention

Reference 26

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.095071Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.095071Z digest=sha256:f45a9a50cd41fb29908af40c418053e487a8a47980d763861d959db11aa43d2a

Observation 6f602431-65bb-43a2-96db-3f7d7097cbc2 · outbound

This paper cites Faster, cheaper, just as good: Cost- and latency constrained routing for llms.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Faster, cheaper, just as good: Cost- and latency constrained routing for llms

Reference 27

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.184734Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.184734Z digest=sha256:ce2da555c9e44f91de799ee8660cf37f5ffe1a4d2493363005097ae88734e088

Observation 764717b5-0207-464d-a481-3ab4dfb704b5 · outbound

This paper cites Deterministic non-autoregressive neural sequence modeling by iterative refinement.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Deterministic non-autoregressive neural sequence modeling by iterative refinement

Reference 28

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.264011Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.264011Z digest=sha256:f7ff25b688f3036165b7bd4d8b2b22e1c35fbb9b85e4b40ffa35b011aa9f0a56

Observation 9d90e6cd-18dc-4871-ad47-07d53163657f · outbound

This paper cites Fromgenerationtojudgment: Oppor- tunities and challenges of LLM-as-a-judge.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Fromgenerationtojudgment: Oppor- tunities and challenges of LLM-as-a-judge

Reference 29

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.349711Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.349711Z digest=sha256:fae345dbb74d5ef26962381fac30487d88bc5bf97f8969d9bbbe68feee205d9a

Observation eb4577bd-b575-4dae-b524-4eb83a24fdc2 · outbound

This paper cites Diffusion-LM improves controllable text generation.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Diffusion-LM improves controllable text generation

Reference 30

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.435794Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.435794Z digest=sha256:f1c465fd4e075218eab0eaf725f2f27b126c1f5e806e1a3861f38bd53db813e8

Observation 5f5cfe90-3d48-48e0-8a55-7f22b2c44131 · outbound

This paper cites Throughput-optimal scheduling algorithms for llm inference and ai agents,.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Throughput-optimal scheduling algorithms for llm inference and ai agents,

Reference 31

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.512272Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.512272Z digest=sha256:ed1337c6d237dd6e3e8e469998e8a405341e41bb1a313a2913065108223fdb50

Observation f20963aa-b673-40bb-b283-be782f28f27f · outbound

This paper cites ROUGE: A package for automatic evaluation of summaries.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads ROUGE: A package for automatic evaluation of summaries

Reference 32

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.736056Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.736056Z digest=sha256:5eaead24039716f71ce58eaf0cba5320077867a8088907675c4b23d4c89b1734

Observation b1a212d1-eb34-4a51-8ea6-a0bb161ed5b6 · outbound

This paper cites Queueing, Predictions, and LLMs: Challenges and Open Problems.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Queueing, Predictions, and LLMs: Challenges and Open Problems

Reference 33

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.817791Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.817791Z digest=sha256:b1a209093975f38c8d9f8aaba67950550a01f3ad79c2e29f4141f1bf94ca5190

Observation 6903b784-b2cf-416b-b325-7ff3bb088384 · outbound

This paper cites Deferred prefill for throughput maximization in llm inference.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Deferred prefill for throughput maximization in llm inference

Reference 34

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.901084Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.901084Z digest=sha256:dc95646c71932baf48544cafe5f38ae57d7b6b2419862b497d2612fdbd8f3915

Observation a693ce8b-4157-41f5-a9e0-2ba4dba9d6ca · outbound

This paper cites Nvidia h100 pcie gpu — product brief.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Nvidia h100 pcie gpu — product brief

Reference 35

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.978274Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.978274Z digest=sha256:be2479c083ea797342eca93e18a88254e58adcb2ba7f6ee98afed0c245492893

Observation 1a93cffa-6aa5-4d34-a6cb-474202ae568c · outbound

This paper cites Gonzalez, M Waleed Kadous, and Ion Stoica.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Gonzalez, M Waleed Kadous, and Ion Stoica

Reference 36

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.058602Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.058602Z digest=sha256:f8cca6e9fab3019f874c06322a3218a83108216ef1a117904a10e6369d0c0b18

Observation 0f701194-cf7e-4204-ad78-c3bb7a650135 · outbound

This paper cites Proxrouter: Proximity-weighted llm query routing for improved robustness to outliers, 2025.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Proxrouter: Proximity-weighted llm query routing for improved robustness to outliers, 2025

Reference 37

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.126930Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.126930Z digest=sha256:a660baf996f757ea71ed14b477912a19737e094e0b2324abf590d298e00dca71

Observation cab66dec-5dd7-49ed-90a2-d0afedfaaf6c · outbound

This paper cites Locus: Low-dimensional model embeddings for efficient model exploration, comparison, and selection, 2026.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Locus: Low-dimensional model embeddings for efficient model exploration, comparison, and selection, 2026

Reference 38

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.212956Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.212956Z digest=sha256:d870a7d983903a2ccfd9db92cf38a5cad2f4cdbb407c0a82746052d93470d353

Observation b10aa5f2-416a-42e3-b7e6-8d3c79555296 · outbound

This paper cites Queue management for slo-oriented large language model serving.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Queue management for slo-oriented large language model serving

Reference 39

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.324988Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.324988Z digest=sha256:1ea47d29996db46a8641e2b07633487e0509ea9e807f5824e1e521f002a7b696

Observation a0cc7d53-d048-4ecf-a8c3-fc982818a9df · outbound

This paper cites Efficiently scaling transformer inference.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Efficiently scaling transformer inference

Reference 40

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.577296Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.577296Z digest=sha256:d036037e048bf5ff8220c45f629b424ffaf281b6d15887e6093317c5f6fd8b87

Observation 40f7be56-8d81-42b3-9471-bc6ae3e318cb · outbound

This paper cites Kalbarczyk, Tamer Başar, and Ravishankar K.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Kalbarczyk, Tamer Başar, and Ravishankar K

Reference 41

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.708519Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.708519Z digest=sha256:6a7b2679b2f7fe0b1c9281ef055c2180325d510e3cfdd5b7cdfe922338c1cbed

Observation 02f6e61f-ed56-4469-83b8-2b901c125e57 · outbound

This paper cites Qwen3 Technical Report.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Qwen3 Technical Report

Reference 42

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.830316Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.830316Z digest=sha256:dc5448397e471951681dd38d253c340fcf01cbae7c17cf06a82c15d627539bf1

Observation f665b1b4-7509-415f-ace1-b0c105c6e4e8 · outbound

This paper cites Don’t stop me now: Embedding based scheduling for llms.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Don’t stop me now: Embedding based scheduling for llms

Reference 43

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.966203Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.966203Z digest=sha256:1ad1b555365abe52f8adf03e9d30d9c7dcc72f06cd8051d951d964e61f06cbfe

Observation 0f12ea98-663a-4c15-87ab-d9c99f031471 · outbound

This paper cites IRT-router: Effective and interpretable multi-LLM routing via item response theory.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads IRT-router: Effective and interpretable multi-LLM routing via item response theory

Reference 44

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.164008Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.164008Z digest=sha256:d8485b2a9eeac089df042b39fc18d90e4d2e1034fbc39ac2ec989ed797569271

Observation a89824c2-a1ff-47ec-aaa9-623a07dc700d · outbound

This paper cites Llumnix: dynamic scheduling for large language model serving.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Llumnix: dynamic scheduling for large language model serving

Reference 45

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.387731Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.387731Z digest=sha256:d396dedab34834b88d281e779e06cc5955a233f8db362dfa856704259b79fe58

Observation 9c3c6777-309f-45f6-9d8f-14a0c474dafa · outbound

This paper cites Hashimoto.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Hashimoto

Reference 46

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.465271Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.465271Z digest=sha256:74c39ed82dff648252dea1ecaa33188d45196dae4e28d3d052673a194f38f607

Observation d3331bd0-4fe6-44ea-a110-5a03fc6c2ef9 · outbound

This paper cites ISBN 979-8-89176-251-0.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads ISBN 979-8-89176-251-0

Reference 47

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.276883Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.276883Z digest=sha256:26f78d34dd0d3b435eb8b6890f2a4c7b725615c5f56cef58ffa8bd3dedd5a472

Observation a7cf780b-6b9f-4ce5-b1ba-9dbb71b7c262 · outbound

This paper cites an unresolved cited work.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Unresolved cited work

Reference 48

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.635380Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.635380Z digest=sha256:fdcf943a39c3485258e07c21931287196a36f237522c449cddf7d4626cf50ade

Observation 3137dcd9-e144-4847-99c0-fec1d0608697 · outbound

This paper cites Cohen, Ruslan Salakhutdinov, and Christo- pher D.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Cohen, Ruslan Salakhutdinov, and Christo- pher D

Reference 49

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.730723Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.730723Z digest=sha256:618c237f90e2a2dd077998258121e8ccbe2de40c024c7ff73b21976d35ffbcdf

Observation f67ff5dd-0810-487c-9c06-2b75c2e36288 · outbound

This paper cites Attention is all you need.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Attention is all you need

Reference 50

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.540327Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.540327Z digest=sha256:8ef00c205be50a03269a96125337b2f2d68f0762c684055833dde241e470360d

Observation cd3715e1-a84c-4d96-8d8c-e88cbe7c0096 · outbound

This paper cites BARTScore: Evaluating generated text as text generation.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads BARTScore: Evaluating generated text as text generation

Reference 51

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.980770Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.980770Z digest=sha256:cf06e97ebedfa76ba7ea263a7289ffa84559cfdb7f4baf8f3ece07b603aead22

Observation e055f8cc-93bb-42a7-bcd9-de6894a6e278 · outbound

This paper cites PhD thesis, Georgia Institute of Technology, August 2009.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads PhD thesis, Georgia Institute of Technology, August 2009

Reference 52

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:03.135243Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:03.135243Z digest=sha256:f2ef795ecf6abb95a3c807df78edc1b4ddc9dc90d6b59f161b68b60cbe090bb0

Observation 89d3d3f6-7723-41d2-a43f-f77cbf056a52 · outbound

This paper cites Orca: A distributed serving system for Transformer-Based generative models.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Orca: A distributed serving system for Transformer-Based generative models

Reference 53

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:02.828169Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:02.828169Z digest=sha256:fa6ed1e2f7dd2db4a82ca68aa4be555efe80d3376b7dae73e5054a22a24afbdd

Observation 817b5903-4bfd-4603-86f3-1b32786bc0ad · outbound

This paper cites scores". The.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads scores". The

Reference 56

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:03.298249Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:03.298249Z digest=sha256:80b906ed58674e15171c74977b5431de80eb78cbc545e034ac21a73f2315db69

Observation 86558925-525d-475c-b668-498e388567fb · outbound

This paper cites Alternatively, generation work for queries follows the memoryless distribution [34].

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Alternatively, generation work for queries follows the memoryless distribution [34]

Reference 57

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:03.437194Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:03.437194Z digest=sha256:95d8e0f16f3d02933a1e9df7d500affd7c6c2cc7e70b760d4037211022003a2b

Observation 719892b6-9c99-490c-ac66-de7083f22cc2 · outbound

This paper cites an unresolved cited work.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Unresolved cited work

Reference 58

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:03.579451Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:03.579451Z digest=sha256:38f1744dd41b5a52290acb25e7fa469ad3e5e94bf757b56564a795523bb358d5

Observation 0c522c42-823f-4001-8522-057759fabc73 · outbound

This paper cites an unresolved cited work.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Unresolved cited work

Reference 59

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:03.701007Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:03.701007Z digest=sha256:258ed8e2a4cd5a323450dda34429a80c5a100c7b2c8398db058aa7acdd98f979

Observation 83887fa6-2f98-4762-a30d-28e258d74612 · outbound

This paper cites State process and stationary distribution.Queries arrive according to a Poisson process of rateαj, so whenever a new query arrives, the state|Rj(t)| increases by one.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads State process and stationary distribution.Queries arrive according to a Poisson process of rateαj, so whenever a new query arrives, the state|Rj(t)| increases by one

Reference 60

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:03.850772Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:03.850772Z digest=sha256:92db3ced81c75cabfb278d31b7a47e49ae13b944b9af71f6db989748477ad776

Observation 4d867fb0-65e6-4968-8f07-0664ac952bbc · outbound

This paper cites ISBN 9798400712869.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads ISBN 9798400712869

Reference 2024

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:01.433404Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:01.433404Z digest=sha256:93965efca1c0ea0d02a4956d1fbaa0ddbc9451097d58472eb38c5a9e6cb1ea37

Observation 0dfe617e-386a-40c1-9950-183a1a62f5aa · outbound

This paper cites Throughput-Optimal Scheduling Algorithms for LLM Inference and AI Agents.

Beyond Accuracy and Cost: Latency-Aware LLM Query Routing for Dynamic Workloads Throughput-Optimal Scheduling Algorithms for LLM Inference and AI Agents

Reference 2025

Resolution
unresolved
no resolver link, observed 2026-08-02T14:08:00.632928Z

Source-reported events for the cited work

Unavailable: canonical work link unavailable.

source=pdf_text observed=2026-08-02T14:08:00.632928Z digest=sha256:c6f05c8b0edbbc0e5d1bef89e7e9ac4d5619489d18837699c08edd9bda18c90a

Pith citing papers

No inbound Pith citation observations are available.