TaiChi is claimed to unify prefill-decode aggregation and disaggregation into one slider-based system that reaches optimal goodput under any TTFT/TPOT SLO combination, with up to 77% better goodput than prior systems under balanced SLOs.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.DC 1years
2025 1verdicts
UNVERDICTED 1representative citing papers
citing papers explorer
-
Prefill-Decode Aggregation or Disaggregation? Unifying Both for Goodput-Optimized LLM Serving
TaiChi is claimed to unify prefill-decode aggregation and disaggregation into one slider-based system that reaches optimal goodput under any TTFT/TPOT SLO combination, with up to 77% better goodput than prior systems under balanced SLOs.