Durk Kingma

Interesting!

GitHub - sinhasam/CRVAE: Official code release for Consistency Regularization for VAEs Official code release for Consistency Regularization for VAEs - sinhasam/CRVAE

Actually, my bad, there's code: github.com/sinhasam/CRVAE

Impressive!!

I'm curious if anyone tried to reproduce that 2.51 number from CR-NVAE. It's much lower than I would suspect for a method like hat so I'm curious if it's real, afaik they didn't share code.

Typo: it => of.

Probably my biggest naming blunder was the name "auto-encoding variational Bayes" for a method that (in its default version) is only Bayesian over the latent variables, not the parameters. Blasphemy in the church it Bayes 😂

Yeah, but I was born in darkness. The first paper I ever cited was Aapo Hyvarinen's paper introducing score matching from 2007, in which the term is "abused" that way the first time, but he had the excuse since there were no good alternatives! Inference, however...

In arxiv.org/abs/2303.00848, @dpkingma.bsky.social and @ruiqigao.bsky.social had suggested that noise augmentation could be used to make other likelihood-based models optimise perceptually weighted losses, like diffusion models do. So cool to see this working well in practice!

I completely agree that it's not an ideal situation that the meaning of the word inference is now overloaded, but its use in this context is now extremely widespread. Better embrace this strange new wor(l)d ;)

My take is that the similarity stems from (1) the true score is identical across models except for stretching of time & space, (2) the only fundamental difference between diffusion objectives is the weighting, and (3) many common weightings are fairly similar (support over a similar range of SNRs).

Do you mean the intuition behind the fact that flow matching with the optimal transport (FM-OT) objective = diffusion objective with exponential weighting? I should probably read the other paper you linked ;)

Jealous!! Enjoy!

No, CS. But intrigued by starlink's phased array :-)

It's 2024 and microwave ovens still heat food unevenly. I need a phased array microwave oven that warms food evenly, adaptively. Who is building this?

I don't usually talk about politics, but if I could change one thing in the US democracy, it might be replacing winner-takes-all representation with proportional representation. Would fix a lot of issues. Agree or disagree that this would be a net positive change?