ALA predicts LLM inference throughput for unobserved workloads by fitting an exponential throughput curve per configuration and using XGBoost to predict curve parameters for new configurations.
Llm-inference- bench: Inference benchmarking of large language models on ai acceler- ators,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.PF 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Statistical Modeling and Uncertainty Estimation of LLM Inference Systems
ALA predicts LLM inference throughput for unobserved workloads by fitting an exponential throughput curve per configuration and using XGBoost to predict curve parameters for new configurations.