PIM-AI is a simulated DDR5/LPDDR5 processing-in-memory architecture that claims up to 6.94x better cloud TCO per QPS and 6.9-13.4x lower mobile energy per query versus state-of-the-art GPUs and SoCs.
Introducing Apple’s On-Device and Server Found ation Models
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.AR 1years
2024 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
PIM-AI: A Novel Architecture for High-Efficiency LLM Inference
PIM-AI is a simulated DDR5/LPDDR5 processing-in-memory architecture that claims up to 6.94x better cloud TCO per QPS and 6.9-13.4x lower mobile energy per query versus state-of-the-art GPUs and SoCs.