MLego reuses and merges materialized LDA models to answer ad-hoc topic queries quickly, using hierarchical plan search and batch reordering to keep the cost low.
Streaming Gibbs Sampling for LDA Model
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
abstract
Streaming variational Bayes (SVB) is successful in learning LDA models in an online manner. However previous attempts toward developing online Monte-Carlo methods for LDA have little success, often by having much worse perplexity than their batch counterparts. We present a streaming Gibbs sampling (SGS) method, an online extension of the collapsed Gibbs sampling (CGS). Our empirical study shows that SGS can reach similar perplexity as CGS, much better than SVB. Our distributed version of SGS, DSGS, is much more scalable than SVB mainly because the updates' communication complexity is small.
citation-role summary
background 1
citation-polarity summary
fields
cs.DB 1years
2025 1verdicts
CONDITIONAL 1roles
background 1polarities
unclear 1representative citing papers
citing papers explorer
-
MLego: Interactive and Scalable Topic Exploration Through Model Reuse
MLego reuses and merges materialized LDA models to answer ad-hoc topic queries quickly, using hierarchical plan search and batch reordering to keep the cost low.