On-device small language models succeed in production mobile apps only when given minimal responsibility, such as generating three short hints from curated lists rather than complete structured puzzles.
Machine Learning Compilation for Large Language Models.https://llm.mlc
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2026 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Less Is More: Engineering Challenges of On-Device Small Language Model Integration in a Mobile Application
On-device small language models succeed in production mobile apps only when given minimal responsibility, such as generating three short hints from curated lists rather than complete structured puzzles.