CP-Router uses conformal prediction set sizes from an LLM to decide whether to route a prompt to that LLM or to a more expensive reasoning model, cutting token use with minimal or no accuracy loss.
If this probability exceeds a predefined threshold, the LLM is used; otherwise, the LRM is chosen
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.CL 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
CP-Router: An Uncertainty-Aware Router Between LLM and LRM
CP-Router uses conformal prediction set sizes from an LLM to decide whether to route a prompt to that LLM or to a more expensive reasoning model, cutting token use with minimal or no accuracy loss.