The almost-magical "content aware fill" plugin from a few days ago...on gimp.

by blhack • 16 years ago

194 39 16 years ago

aidenn0• 16 years ago

Not nearly as good as what the photoshop demo did. In particular, the photoshop demo had examples of content aware fill with shadows moving through the object to be removed. In this example you can see the line/shadow of the overhang being eliminated with the purse. Maybe the photoshop fill would have done the same and they just cherry-picked some examples, but right now I'm thinking it's just better.

jerf• 16 years ago

It's hard to tell, because unless you had access to a different video than I did you can't really see what Photoshop did, even after bumping it up to 480p. In this case I think we have the raw files, so you have the chance to examine the results up close and personal. It's not a direct comparison.

Batsu• 16 years ago

Indeed, if there ever was a problem with true verification, it is the requirement that you have to do it yourself without anyone involved in the steps.

Qz2• 16 years ago

Agreed -- when the trash is removed in the GIMP plugin, you can see that the line on the wall vanishes too -- the CS5 version seems like it would have extended it.

blhack2• 16 years ago

As far as I know, they're using the same algorithm. If you can find me a high-enough resolution desert picture like the one they used, I'll apply the filter to see...

wazoox2• 16 years ago

Even if it's only 75% as good, it's 1° free 2° free 3° free so it doesn't cost any money, and you can adapt it / enhance it. So it beats photoshop hands down easily.

twinwing• 16 years ago

http://o3.tumblr.com/post/470608946/photoshops-caf-content-a...

Same pictures as the Video. Gimp actually does better here.

SlyShy• 16 years ago

Except those aren't actually the original picture. That's the picture with the trash already removed.

Not that I'm saying Gimp can't do as good of a job. It's exactly the same technology based on the same research. But I am saying that blog post is a tad dishonest.

danudey• 16 years ago

In the third picture, if you look in the bottom left and right corners, you can see a sudden colour change along the lines where the original picture's content ended. On the right, for example, the original cloud is sort of yellowish, then it suddenly becomes a more neutral grey along a diagonal line.

In the sky it's harder to tell, but it's still there too.

Qz2• 16 years ago

I agree, the CS5 version seems to be better.

naner• 16 years ago

Isn't it the exact same algorithm? The differences are probably only to do with how things are selected.

jcl• 16 years ago

Probably not. There are a number of image inpainting, texture synthesis, and reconstruction algorithms that can be applied, with different behaviors regarding noise, color correction, detail scale, handling of regularity/irregularity, temporal coherence, run time, etc.

GIMP's Resynthesizer is based on a 2005 PhD thesis, while the Photoshop thing is probably based on a 2009 SIGGRAPH paper.

http://www.logarithmic.net/pfh/thesis

http://www.cs.princeton.edu/gfx/pubs/Barnes_2009_PAR/index.p...

bluesmoon• 16 years ago

I actually posted that to hackernews a while ago: http://news.ycombinator.com/item?id=1221594 and it got only 5 votes. I guess the story title really matters.

rmc2• 16 years ago

If you are using Ubuntu (or Debian), installing this is even easier. Just install gimp-resynthesizer using aptitude or Ubuntu software centre

FlorinAndrei3• 16 years ago

You also need gimp-plugin-registry if it's not installed. It contains the smart-remove filter.

csmeder• 16 years ago

Thank you! I couldn't find this info anywhere.

rmc2• 16 years ago

You shouldn't have to manually install anything, in my experience. The package manager should take care of things.

drats2• 16 years ago

thanks for the tip, made it very easy to try out

blasdel• 16 years ago

It looks like it doesn't really have a UI -- is there a version factored out of GIMP that just takes the source image and a mask image as arguments?

For the art producers the Photoshop version would me massively superior just for integrating with the UI, but for our purposes a version of this as a standalone utility or baked into PIL or ImageMagick would be fucking awesome.

ricree• 16 years ago

Gimp has a batch mode that lets you run commands without loading the UI. That would probably achieve the same thing, although it might be a little much if you're sure that all you want is resynthesizer.

eam• 16 years ago

This is a response to http://news.ycombinator.com/item?id=1215756

FlorinAndrei3• 16 years ago

On Ubuntu 9.10, the packages you need to install are:

gimp-plugin-registry (it contains the smart-remove filter)

gimp-resynthesizer

FlorinAndrei3• 16 years ago

My first attempt. Here's the before:

http://i.imgur.com/LHvih.jpg

Here's the after:

http://i.imgur.com/jSRoy.jpg

Not perfect, but not too bad either, given that it took 30 seconds to do it. I'm sure the size and shape of the selection changes the result, and then the filter has a "radius" parameter which by default is set to 100 and can be changed, and I guess it will change the result.

dutchflyboy• 16 years ago

Well, in the worst case, you just re-apply the filter on the part you're not satisfied with (for example, those white areas at the bottom).

cma• 16 years ago

Another technique is to normal-crop out the sky and the distant grass that is so blurry, "content-aware" crop out the duck, then paste back in the stuff you originally cropped out. The white bits at the bottom are sky. The blurry bits are where grass far in the background was stitched in.

drats2• 16 years ago

It is a great starting point to make Trotsky-duck disappear on Stalin's orders. http://i.imgur.com/xK6Jl.jpg The wealth of free tools is just amazing these days.

Vivtek• 16 years ago

I would like to say, though, that the original is a fantastic picture.

ableal• 16 years ago

A camelduck, from one of Neal Asher's worlds ? Must be harmless, don't remember it being written up. (So, the runcible network is up ?)

aw3c2• 16 years ago

Haha, I played with exactly that picture with resynth yesterday too. :)

makmanalp2• 16 years ago

Does anyone have a link to the original research / paper?

makmanalp2• 16 years ago

Never mind, found it: http://graphics.stanford.edu/projects/texture/

CWuestefeld• 16 years ago

As I said in the CS story, this is cool but nothing new. I don't see how it's different from Alien Skin's Image Doctor (http://www.alienskin.com/imagedoctor/index.aspx ), which has been available as a plugin for years. I've been using it from PaintShopPro for quite some time.

shimonamit2• 16 years ago

Too bad this plugin isn't being maintained by the author. It only works with GIMP 2.4 from what I'm reading. This tool should be adopted as a first class GIMP tool.

wazoox2• 16 years ago

Works fine under Linux for me (Slack 13).

blhack2• 16 years ago

I've got it working on 2.6 (as well as 2.4).

What's the error that you're getting when you try to run it? Are you using the patched file from my tutorial?

shimonamit2• 16 years ago

The author writes on his homepage he is no longer maintaining it and hasn't been following the GIMP API changes. He is also looking for someone to take over:

http://www.logarithmic.net/pfh/resynthesizer.

(I forgot where I read about the "since 2.4" part.)

brfox• 16 years ago

This dust removal GIMP tool seems nice, too: http://registry.gimp.org/node/13289

Does anyone have experience with it or something better to suggest?

The almost-magical "content aware fill" plugin from a few days ago...on gimp.

Related Stories