Unifying Generative Models with GFlowNets and Beyond
Reviewed by Pithpith:ZZWIW6ZQopen to challenge →
read the original abstract
There are many frameworks for deep generative modeling, each often presented with their own specific training algorithms and inference methods. Here, we demonstrate the connections between existing deep generative models and the recently introduced GFlowNet framework, a probabilistic inference machine which treats sampling as a decision-making process. This analysis sheds light on their overlapping traits and provides a unifying viewpoint through the lens of learning with Markovian trajectories. Our framework provides a means for unifying training and inference algorithms, and provides a route to shine a unifying light over many generative models. Beyond this, we provide a practical and experimentally verified recipe for improving generative modeling with insights from the GFlowNet perspective.
This paper has not been read by Pith yet.
Forward citations
Cited by 3 Pith papers
-
A Distributional Framework for Generative Modeling of Molecular Crystals
MXtalGFlow combines a canonical crystal parameterization with energy-based GFlowNet training to sample thermodynamic distributions of molecular crystals, recovering known polymorphs and predicting new competitive pack...
-
Your GFlowNet Secretly Learns an Optimal Transport Plan
Minimum-flow GFlowNets on graphs encode optimal transport plans, with the learned policy recovering the optimal coupling between source and target distributions.
-
Stable GFlowNets with Probabilistic Guarantees
Derives loss-to-TV bounds providing probabilistic guarantees for GFlowNets and introduces Stable GFlowNets algorithm for improved training stability and distributional fidelity.
discussion (0)
Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.