Image synthesis and editing with stochastic differential equations

by lnyan • 5 years ago

84 8 5 years ago

Although the application is interesting, as someone who studies SDEs the notion of "reverse SDEs" is frustrating to me, as Brownian motion really isn't reversible. The citation provided is from 1982, but I'm not convinced the theory can't be situated in the more modern interpretation of "backward SDEs" which became more popular with Peng's work in 1992.

Backward SDEs aren't time-reversed, but satisfy conditions at the end of the time interval instead of the beginning. The idea of time-reversing Brownian motion is like saying that you're running thermodynamics backward--it only makes sense if you sample them forward, then move backwards along the forward sampled motion.

It feels like (2) is just a backward SDE arrived at via the Feynman-Kac theorem applied to the Kolmogorov backward equations.

AstralStorm• 5 years ago

Yeah, someone rediscovered Kolmogorov path-dependent equations (probably Smoluchowski's in this case) and applied them to another optimization problem. Shock horror that well described old optimization technique works better than winging it with pure variant of gradient descent for some problems.

Rediscovery of anomalous diffusion statistics.

dr_dshiv• 5 years ago

How does this relate to what Friston calls free energy minimization (or simulated annealing) if I might ask?

stablechaos2• 5 years ago

A stochastic optimal control problem can be interpreted as a free energy minimization problem [0], but this is a more general result than what is looked at in the paper OP linked.

I'm not sure the "reverse SDE" is technically doing this sort of minimization since it seems like it's just trying to reconstruct an unknown forward process. It's possible there's some sort of minimization going on here over some slack variable though.

[0] https://ieeexplore.ieee.org/abstract/document/6426381?casa_t...

disabled2• 5 years ago

Yeah, the application is definitely interesting.

The idea of time-reversing Brownian motion is like saying that you're running thermodynamics backward--it only makes sense if you sample them forward, then move backwards along the forward sampled motion.

You are conceptually 100% correct on this matter.

...As for me, I usually solve SDEs using Markov chain Monte Carlo, using esoteric software known as WinBUGS/OpenBUGS/MultiBUGS. I use MultiBUGS [1] (don't bother installing it on Windows or Mac), which is integrated with BlackBox Component Builder [2]. It all runs on a really cool but esoteric language called Component Pascal. Anyways, developers over the years have kept BlackBox in particular alive. But, I always have to say, differential equations are awesome :-) But, Julia is where it is at for DiffEqs in open source.

[1] https://www.multibugs.org/

[2] https://blackbox.oberon.org/

nerdponx• 5 years ago

I only ever used BUGS for Bayesian statistical inference. It seems like there's a whole world of math, applications thereof, and related software that I don't know about -- exciting!

What do you use SDEs for? I always skipped diff eq topics because I never had a sensible application for them in the social sciences.

Image synthesis and editing with stochastic differential equations

Related Stories