SneakPeek estimates each model's accuracy from live data with a fast kNN and Bayesian update, then uses those estimates in grouped scheduling and short-circuit inference to raise utility on a single GPU.
INFaaS: Automated model-less inference serving,
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.DC 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
SneakPeek: Data-Aware Model Selection and Scheduling for Inference Serving on the Edge
SneakPeek estimates each model's accuracy from live data with a fast kNN and Bayesian update, then uses those estimates in grouped scheduling and short-circuit inference to raise utility on a single GPU.