Generative Modeling
Developing state-of-the-art generative models including diffusion models and flow-based approaches with applications to molecular design, language modeling, and scientific computing.
Our group develops state-of-the-art generative models with a focus on diffusion and flow-based approaches. We work on both the theoretical foundations—understanding the geometry of generative processes, designing efficient training objectives, and analyzing sampling dynamics—and practical applications spanning molecular design, language modeling, and scientific computing.
Flow matching, introduced in our foundational work on minibatch optimal transport for flow-based generative models, has become a widely adopted training paradigm for continuous normalizing flows and diffusion models. Our current research pushes the boundaries of flow matching in several directions: topological flow matching for structured generation, stochastic flow maps for few-step sampling, and guided generation via Feynman-Kac correctors.
Key Directions
- Diffusion Models: Progressive inference-time annealing, score-based models, sampling from complex distributions
- Flow Matching: Optimal transport-based generative modeling, stochastic and topological flow matching
- Theory & Discretization: Entropy-aware scheduling, superposition of diffusion models, and understanding copying behavior in distillation
- Applications: Protein design, crystal structure prediction, molecular generation, and language modeling
People
Selected Publications
-
Strong Stochastic Flow Maps
Sam McCallum, Zander W. Blasingame, Timothy Herschell, Niklas Rindtorff, Alexander Tong, James Foster
In ICML 2026 Workshop on Structured Probabilistic Inference & Generative Modeling (SPIGM)
July 2026
-
Why Are DMD Students Lazy? Understanding the Copying Behavior in Few-Step Distillation
Shucheng Li, Iolo Jones, Alexander Tong, Michael M. Bronstein
In ICML 2026 Workshop on High-dimensional Learning Dynamics
July 2026
-
Hacking Generative Perplexity: Why Unconditional Text Evaluation Needs Distributional Metrics
Antonio Franca, Alexander Tong
In ICML 2026 Workshop on Structured Probabilistic Inference & Generative Modeling (SPIGM)
July 2026
-
Entropy Across the Bridge: Conditional-Marginal Discretization for Flow and Schrödinger Samplers
Bruno Trentini, Dejan Stancevic, Michael M. Bronstein, Alexander Tong, Luca Ambrogioni
Preprint
May 2026
-
Topological Flow Matching
Kacper Wyrwal, Ismail Ilkan Ceylan, Alexander Tong
In ICLR 2026
May 2026
-
Curly Flow Matching for Learning Non-gradient Field Dynamics
Katarina Petrović, Lazar Atanackovic, Viggo Moro, Kacper Kapuśniak, İsmail İlkan Ceylan, Michael Bronstein, Avishek Joey Bose, Alexander Tong
In NeurIPS 2025
December 2025
-
Foundations of Diffusion Models in General State Spaces: A Self-Contained Introduction
Vincent Pauline, Tobias Höppe, Kirill Neklyudov, Alexander Tong, Stefan Bauer, Andrea Dittadi
arXiv preprint
December 2025
-
Feynman-Kac Correctors in Diffusion: Annealing, Guidance, and Product of Experts
Marta Skreta, Tara Akhound-Sadegh, Viktor Ohanesian, Roberto Bondesan, Alán Aspuru-Guzik, Arnaud Doucet, Rob Brekelmans, Alexander Tong, Kirill Neklyudov
In ICML 2025 (spotlight)
July 2025
-
The Superposition of Diffusion Models Using the Itô Density Estimator
Marta Skreta, Lazar Atanackovic, Avishek Joey Bose, Alexander Tong, Kirill Neklyudov
In ICLR 2025 (spotlight)
May 2025
-
Improving and Generalizing Flow-Based Generative Models with Minibatch Optimal Transport
Alexander Tong, Nikolay Malkin, Guillaume Huguet, Yanlei Zhang, Jarrid Rector-Brooks, Kilian Fatras, Guy Wolf, Yoshua Bengio
In Transactions on Machine Learning Research (TMLR), 2024
May 2024