This is a really nice blogpost by
@RuiqiGao and team that I enjoyed being a part of. My favorite key learnings are:
- DDIM sampler == flow matching sampling
- (Not) straight?
- SD3 weighting (Esser, Rombach, et al) is very similar to the EDM weighting (Karras, et al).
π
03.12.2024 13:26 β π 10 π 2 π¬ 2 π 0
Thanks for the great summary of our post! π
03.12.2024 09:10 β π 1 π 0 π¬ 0 π 0
Yup yup that's our goal for this post, making it more accessible :).
03.12.2024 00:21 β π 0 π 0 π¬ 0 π 0
haha thanks! Credit to Flux.
02.12.2024 20:51 β π 2 π 0 π¬ 1 π 0
With amazing colleagues: @emielhoogeboom.bsky.social, Jonathan Heek, @vdebortoli.bsky.social, @sirbayes.bsky.social, @timsalimans.bsky.social
02.12.2024 18:45 β π 12 π 0 π¬ 1 π 0
We hope this helps practitioners understand the true degrees of freedom when tuning the algorithm. For example, a flow matching sampler doesnβt have to be deterministic.
02.12.2024 18:45 β π 13 π 0 π¬ 1 π 1
Diffusion Meets Flow Matching
Flow matching and diffusion models are two popular frameworks in generative modeling. Despite seeming similar, there is some confusion in the community about their exact connection. In this post, we a...
Blog post link: diffusionflow.github.io/
Despite seeming similar, there is some confusion in the community about the exact connection between the two frameworks. We aim to clear up the confusion by showing how to convert one framework to another, for both training and sampling.
02.12.2024 18:45 β π 38 π 8 π¬ 1 π 0
A common question nowadays: Which is better, diffusion or flow matching? π€
Our answer: Theyβre two sides of the same coin. We wrote a blog post to show how diffusion models and Gaussian flow matching are equivalent. Thatβs great: It means you can use them interchangeably.
02.12.2024 18:45 β π 254 π 58 π¬ 6 π 7
Research Scientist at Google DeepMind
stanniszhou.github.io
Research Scientist Meta/FAIR, Prof. University of Geneva, co-founder Neural Concept SA. I like reality.
https://fleuret.org
Research scientist at Google Deepmind
generative modeling, rl, birds, poetry, games, robots
πLondon π edouardleurent.com
Stats, ML and open-source
Bio/ML. Co-founder at EvoScale, worked on Pytorch and StarCraft back at meta. Most likely not skynet.
junior fellow at @Harvard.edu, incoming prof at @HSEAS and @Kempnerinstitute.bsky.social studying machine learning and its applications to nature and the sciences
Researcher (OpenAI. Ex: DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian.
Anon feedback: https://admonymous.co/giffmana
π ZΓΌrich, Suisse π http://lucasb.eyer.be
Research scientist at Anthropic. Prev. Google Brain/DeepMind, founding team OpenAI. Computer scientist; inventor of the VAE, Adam optimizer, and other methods. ML PhD. Website: dpkingma.com
Probabilistic ML researcher at Google Deepmind
messing up with gaussians
Researcher at Google DeepMind. I make LLMs go fast. I also play piano and climb sometimes. Opinions my own
Blog: https://sander.ai/
π¦: https://x.com/sedielem
Research Scientist at Google DeepMind (WaveNet, Imagen 3, Veo, ...). I tweet about deep learning (research + software), music, generative models (personal account).
Recently a principal scientist at Google DeepMind. Joining Anthropic. Most (in)famous for inventing diffusion models. AI + physics + neuroscience + dynamical systems.
AI/generative artist. Writes her own code. Absolute power is a door into dreaming.
works @ runway in π½
www.ethanrosenthal.com
Internet pedestrian. Machine learning mercenary. α(γ)α (he/him/his)
https://laurent-dinh.github.io/
Machine Learning Researcher
https://alexalemi.com
https://blog.alexalemi.com
I do SciML + open source!
π§ͺ ML+proteins @ http://Cradle.bio
π Neural ODEs: http://arxiv.org/abs/2202.02435
π€ JAX ecosystem: http://github.com/patrick-kidger
π§βπ» Prev. Google, Oxford
π ZΓΌrich, Switzerland