An Introduction to Flow Matching

https://mlg.eng.cam.ac.uk/blog/2024/01/20/flow-matching.html

by sebg • 2 years ago

72 10 2 years ago

mlg.eng.cam.ac.uk

This is my problem with articles like this https://imgur.com/a/QYiXKE0 What is x, what is q0, where did this derivative come from and why? would be real nice if people actually explained what all this stuff means instead of copy pasting equations

p1esk• 2 years ago

Both x and q0 are clearly defined there. In fact the post is very well written. Are you sure you are ready to learn “this stuff”?

pama• 2 years ago

Per the text: x is a sample (see the tilde symbol) from the density q0; the Jacobian comes from the change of variables in the density. The typesetting could use some work but the definitions are in the snippet you pasted. I agree that people are often sloppy when writing though this is not such a case. If you want to get into this area of research, it still helps to read a bunch, especially the earlier works or review papers, and you tend to pick things up gradually. Some basic math background is required, probably at advanced undergrad level.

cpill• 2 years ago

it would be nice if there was some way, like a map of what concepts you needed to know, that you could follow, so if you did want to get into this you could ram up from nothing (or at least high school maths)

m-murphy• 2 years ago

... it says exactly what they are, q0 is an arbitrary density on R^d, and x is a realization from that density, p1 is the transformed density. This is intro graduate level probability.

underanalyzer• 2 years ago

It's also been a while since I had to flex my math muscles and they are quite flabby. I recommend reading things like this slow, they are written by people who know the field forward and backward and aren't supposed to be trivial. If you aren't in the field you got to be a little bit of an active reader.

For example, I also didn't remember why you needed a determinant in the equation you linked so I made a simple example and saw the determinant was there to keep the density normalized, (i.e the indefinite integral of the density = 1).

In this case, the simple example I used was a distribution q0(x) = 1 where x>=0 and x <= 1 (zero elsewhere) and scaling transformation y = ax

ein0p• 2 years ago

People who have not been exposed to math heavy content on a routine basis often have the unrealistic expectation of understanding everything on first read. That almost never happens unless the paper is very close to the reader’s own field of expertise. Denser papers, in fact, may take days of effort to fully internalize even for someone mathematically inclined and accustomed to reading papers.

JustFinishedBSG• 2 years ago

$q_0$ and $x$ are explicitly defined.

This is "misleading" because it's presented as a blog post but really it should be read as a paper or book section. Take your time. Take a pen and paper out. Reread things multiple times. Go back to definitions. I don't mean mean that dismissively, math is just read very very very differently than natural text. ( I'm sure there are just brilliant people who can read math like a novel but for me, and I assume most people but maybe I'm just dumb, that's not the case )

Here q_0 is some density, whatever you want. x is a random variable distributed according to q_0

dazzaji• 2 years ago

I’m way out of my depth here but if I’m reading this right a flow model would not base outputs on a prompt but instead, after it’s sampling/inverse flow pipeline (if I got that right?) is activated it would somehow just output whatever image it’s statistically sampling at the moment. Is that even close?

An Introduction to Flow Matching

Related Stories