Pith. sign in

REVIEW 4 cited by

The Dynamic Embedded Topic Model

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1907.05545 v2 pith:N7JPHKES submitted 2019-07-12 cs.CL stat.ML

Adji B. Dieng , Francisco J. R. Ruiz , David M. Blei This is my paper · ORCID
classification cs.CLstat.ML
keywords d-etmtopicdynamicd-ldadocumentsembeddingmodelword
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

Topic modeling analyzes documents to learn meaningful patterns of words. For documents collected in sequence, dynamic topic models capture how these patterns vary over time. We develop the dynamic embedded topic model (D-ETM), a generative model of documents that combines dynamic latent Dirichlet allocation (D-LDA) and word embeddings. The D-ETM models each word with a categorical distribution parameterized by the inner product between the word embedding and a per-time-step embedding representation of its assigned topic. The D-ETM learns smooth topic trajectories by defining a random walk prior over the embedding representations of the topics. We fit the D-ETM using structured amortized variational inference with a recurrent neural network. On three different corpora---a collection of United Nations debates, a set of ACL abstracts, and a dataset of Science Magazine articles---we found that the D-ETM outperforms D-LDA on a document completion task. We further found that the D-ETM learns more diverse and coherent topics than D-LDA while requiring significantly less time to fit.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 4 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. DENSE: Longitudinal Progress Note Generation with Temporal Modeling of Heterogeneous Clinical Notes Across Hospital Visits

    cs.CL 2025-07 reject novelty 5.0 of 10

    DENSE synthesizes progress notes across hospital visits using retrieval over heterogeneous clinical notes, claiming temporal continuity that even exceeds gold-standard notes.

  2. DTECT: Dynamic Topic Explorer & Context Tracker

    cs.CL 2025-07 conditional novelty 4.0 of 10

    DTECT provides a single platform that trains DTM, DETM, and CFDTM, evaluates topic quality, labels topics with LLMs, finds temporally salient words, and answers follow-up questions about retrieved documents.

  3. CLI-RAG: A Retrieval-Augmented Framework for Clinically Structured and Context Aware Text Generation with LLMs

    cs.CL 2025-07 reject novelty 4.0 of 10

    CLI-RAG uses two-stage retrieval over hierarchically chunked EHR notes to generate SOAP progress notes, but its headline 87.7% temporal alignment result is inconsistent across models.

  4. Temporal Analysis of Climate Policy Discourse: Insights from Dynamic Embedded Topic Modeling

    cs.CL 2025-07 conditional novelty 4.0 of 10

    DETM applied to UNFCCC decisions (1995-2023) reveals a thematic shift from foundational climate agreements to implementation, finance, and technical collaboration.

Pith tools