Template-Adapted Mixture Model uses many biased simulations for data-driven estimates of signal and background distributions, yielding unbiased signal fraction estimates with well-calibrated uncertainties.
Autoencoding Variational Inference For Topic Models
4 Pith papers cite this work. Polarity classification is still indexing.
4
Pith papers citing it
abstract
Topic models are one of the most popular methods for learning representations of text, but a major challenge is that any change to the topic model requires mathematically deriving a new inference algorithm. A promising approach to address this problem is autoencoding variational Bayes (AEVB), but it has proven diffi- cult to apply to topic models in practice. We present what is to our knowledge the first effective AEVB based inference method for latent Dirichlet allocation (LDA), which we call Autoencoded Variational Inference For Topic Model (AVITM). This model tackles the problems caused for AEVB by the Dirichlet prior and by component collapsing. We find that AVITM matches traditional methods in accuracy with much better inference time. Indeed, because of the inference network, we find that it is unnecessary to pay the computational cost of running variational optimization on test data. Because AVITM is black box, it is readily applied to new topic models. As a dramatic illustration of this, we present a new topic model called ProdLDA, that replaces the mixture model in LDA with a product of experts. By changing only one line of code from LDA, we find that ProdLDA yields much more interpretable topics, even if LDA is trained via collapsed Gibbs sampling.
citation-role summary
method 1
citation-polarity summary
roles
method 1polarities
use method 1representative citing papers
An unsupervised Bayesian inference method with amortized variational inference detects coordinated inauthentic accounts on Twitter by clustering on account-level traits and shared narratives, substantially outperforming naive baselines and approaching supervised performance.
Hugging Face releases an open-source Python library that supplies a unified API and pretrained weights for major Transformer architectures used in natural language processing.
LLMs recover interpretable topic structures via attention and achieve competitive topic modeling performance as long-context generators.
citing papers explorer
-
Many Wrongs Make a Right: Leveraging Biased Simulations Towards Unbiased Parameter Inference
Template-Adapted Mixture Model uses many biased simulations for data-driven estimates of signal and background distributions, yielding unbiased signal fraction estimates with well-calibrated uncertainties.
-
Unsupervised detection of coordinated information operations in the wild
An unsupervised Bayesian inference method with amortized variational inference detects coordinated inauthentic accounts on Twitter by clustering on account-level traits and shared narratives, substantially outperforming naive baselines and approaching supervised performance.
-
HuggingFace's Transformers: State-of-the-art Natural Language Processing
Hugging Face releases an open-source Python library that supplies a unified API and pretrained weights for major Transformer architectures used in natural language processing.
-
LLM as Attention-Informed NTM and Topic Modeling as long-input Generation: Interpretability and long-Context Capability
LLMs recover interpretable topic structures via attention and achieve competitive topic modeling performance as long-context generators.