Moviebarcode - Movies compressed to a single frame

http://moviebarcode.tumblr.com/

by boredguy8 • 15 years ago

244 67 15 years ago

moviebarcode.tumblr.com

boredguy84• 15 years ago

I find just seeing the color palette says a lot about a movie. And of course "Hero"/"Ying Xiong" is amongst the compressed movies: http://moviebarcode.tumblr.com/post/3515529474/hero-ying-xio...

sharkbot• 15 years ago

I was just thinking the same thing; see "Traffic": http://moviebarcode.tumblr.com/post/3432016573/traffic-2000

lists• 15 years ago

Probably my favorite movie in east Asian cinema.

camdykeman• 15 years ago

This is very cool and pretty insightful. The Matrix represents itself perfectly, looking very similar to the code itself. Pan's Labyrinth was also close, and Bambi for that matter. Its interesting to see how closely we associate a movie with the colours in it, even if we dont recognize that association.

ojilles• 15 years ago

Yes, loved the Matrix representation myself too. But then again, look at the Kill Bill one. It's not as "yellow" as I associate with the movie (I think the packaging gives me that "yellow feeling"). But then, there is this one lonesome yellow stripe in the moviebarcode for Kill Bill! I thought that captured the movie well on a higher plane (e.g. main character being quite a lone, too).

http://moviebarcode.tumblr.com/post/3509777216/kill-bill-vol...

zcid• 15 years ago

That was definitely the one that stood out the most to me. It's always one of the first movies that comes to mind when I'm thinking about color in film.

boredguy84• 15 years ago

Agreed, though at times "Hero" is borderline heavy-handed with color. However it manages to remain beautiful. One thing I've learned, though, from a set-designer friend, is that nearly every movie is highly attuned to color and lighting.

If you're looking for other films that use color in interesting ways, check out the "Three Colors Trilogy" by Kieslowski.

bobds2• 15 years ago

Same here, I remember loving the vivid imagery of that movie.

I watched "The Fall" recently and this is the first one that came to mind. Highly recommended: http://www.imdb.com/title/tt0460791/

mbenjaminsmith• 15 years ago

I like it. What about:

1. Grouping by director / DP 2. Color analysis (by genre, decade, etc)

frading• 15 years ago

This suits PleasantVille perfectly. http://moviebarcode.tumblr.com/photo/1280/3542457911/1/tumbl...

torme• 15 years ago

Does anyone have info on exactly what was done to make these? Is it just taking frames and stretching them vertically?

weaksauce• 15 years ago

If I was to do it I would take every digital frame and then take each pixel from top left to bottom right and make one long chain. Either that or average x neighboring pixels to fit the size vertically. I have no idea how they did this specifically though.

boredguy84• 15 years ago

The authors of the blog don't say, but here's one approach: http://wordpress.mrreid.org/moviebarcode/

A discussion using mplayer for faster output is also attached at http://projects.metafilter.com/2996/Make-your-own-Movie-Barc...

bobds2• 15 years ago

I think it takes the dominant color from each scene. You can probably do that by resizing each frame to a 1x1 px image.

I'd love a script that takes a batch of movies, feeds them to ffmpeg or something and slowly makes barcodes for my movie collection.

blahedo• 15 years ago

Given the letter artifacts in "Kill Bill" it looks like they're preserving vertical position. So, possibly making each vertical pixel stripe a horizontal average of several consecutive frames---all pixels at height y in an adjacent batch of a few dozen frames.

mikeytown2• 15 years ago

AviSynth Script http://forum.doom9.org/showthread.php?p=1480852#post1480852

jwomers• 15 years ago

It would be awesome to know the exact details on how these are made. Is it a histogram basis with thresholds to choose which colour is shown, or simply the entire frame compressed to a couple of pixels thick, and then just include some percentage (like 1%) of frames. These are great, you really can tell a lot about a movie, like how long mostly unchanging scenes last, and the overall colour palettes used. Great stuff!

agentultra• 15 years ago

I'd like to know more about the compression technique used as well. It would be nice to know how much "smear" or "lossiness" there is.

Now just free-wheel brainstorming here... but it seems to me that given an acceptably "clean" compression of the video, one could generate a good fingerprint from the hashes of the histograms of each frame.

Then a client-side app could sample a reasonable number of frames and given an algorithm for finding invariant histograms (given changes in lighting, capture quality, etc the algorithm would output a deterministic histogram within some acceptable but narrow tolerance) it could generate a fingerprint that is good enough for a heuristic algorithm to search a database of movie fingerprints...

essentially, shazam for video.

aperiodic• 15 years ago

I'm pretty sure it's some straightforward cropping/resizing of some subset of the frames in the movie. The barcode for Slumdog Millionaire[1] presents some pretty compelling evidence that this is the case.

That barcode has a persistent pattern in its lower part: every once and a while, there's the same four light blue lines straddling three sets of light grey lines. That movie is about a contestant on the Indian version of "Who Wants to Be a Millionaire". For reference, I found a screencap of the show on Wikimedia[2]. You'll notice that the location and pattern of the lines in the barcode correspond with the location and form of the question boxes in the show. The light blue lines are the outlines of the boxes, and the light grey ones are the text. I don't have a copy of the movie with me, but I suspect that if you linearly interpolate between horizontal position in the barcode and temporal position in the movie, then the scenes where the question boxes are on the screen will correspond with the locations in the barcode where the pattern appears.

As to whether the frame is cropped or resized to be 1-pixel wide, my guess is that they are resized. My reasoning is that if the frame were cropped, then you might not always see the light grey lines along with the light blue lines in the barcode, since you might take a slice of the frame that falls along spaces between words in the questions and answers. Since the appearance of the question box pattern is pretty much uniform, it's probable that the entire frame is resized, so each pixel in each slice corresponds to the "average" color value of pixels at that height in the sampled frame (I say "average" because I don't really know how downscaling algorithms work).

[1] http://s3.amazonaws.com/data.tumblr.com/tumblr_lh9wkoPf5s1qh... [2]: http://upload.wikimedia.org/wikipedia/en/thumb/a/a4/Ken_Basi...

gridspy2• 15 years ago

You see the same sort of artifact with kill bill, which often has titles at the bottom of the screen.

amiga5000• 15 years ago

I think it is made using a filmstrip of some frames of the movie then streched vertically. I tried to reverse the image to the filmstrip and this is what i've got: the probel is the image is so low res than the frames are recreated with a lot of difficulty. Anyway, i put a actual frame of the movie next to the filmstrip. You can still recognize figures. like body shapes, etc. My try here (Kill Bill vol 1: http://i.imgur.com/ZUUo0.jpg

jhamburger• 15 years ago

A fun addition to this would be tagging memorable scenes from the movie.

jokermatt999• 15 years ago

In some cases, the colors actually do that quite well.

For example, look at The Fifth Element. You see that patch of white between the beginning and the middle? That's the scene where Leelo is brought back, I believe. It's the only scene in the movie that I can think of where there's a significant amount of white (although it's possibly Corbin's apartment...). It struck me how recognizable it was before I saw your post, actually.

dstein• 15 years ago

Or for that matter I kind of want to hover over parts of the barcode to see a screenshot from that scene -- I wanna see what that one "red" part is really quickly.

invisible• 15 years ago

I'd like to see a movie like Sin City and House of the Flying Daggers :). Really neat idea, but tumblr might not be the best way to display the information.

ck22• 15 years ago

Completely predictable but still fascinating:

http://moviebarcode.tumblr.com/post/3514313860/the-matrix-19...

kbd• 15 years ago

That's actually the first movie I went looking for.

ck22• 15 years ago

I had to stop and try to remember what the white lines were about.

Twelve years ago, wow, sigh.

sandofsky• 15 years ago

A few years ago, I wrote a freeware app that did something similar, based on Brendan Dawes' "Cinema Redux".

http://threewordtitle.com/thumber/

revdinosaur• 15 years ago

Hey, this is really great. I love these apps which turn existing video into new forms of media. If you haven't seen it already, you should check out Cory Arcangel's "Colors PE."

http://colors-personal-edition.coryarcangel.com/

powrtoch• 15 years ago

This is cool and all, but are there any uses for it?

GrantS2• 15 years ago

This could be useful if placed along a timeline in an interface for seeking to a specific scene in a movie or video.

Representations like this are also sometimes used for automatic shot boundary detection (vertical edges in this type of image = an edit to a different camera shot) in video content retrieval systems.

Tomek_• 15 years ago

You can watch lots of movies in few minutes.

kapitalx• 15 years ago

Maybe another potential use could be fingerprinting/copyright content detection.

limmeau• 15 years ago

Interesting to see, but I still prefer the temporal compression applied in http://iwdrm.tumblr.com/ .

Cushman• 15 years ago

It's amazing how a couple of well-chosen frames can capture the spirit of an entire film.

klenwell• 15 years ago

I love the Blade Runner one:

http://iwdrm.tumblr.com/post/2927811283

I've been staring at it for minutes.

innes• 15 years ago

You can see how the teal and amber palette has become more and more popular in recent years.

pgbovine• 15 years ago

can anyone find 2001? that trippy space color light show near the end could be cool

GrantS2• 15 years ago

Interestingly, those shots were filmed using a technique called slit scan photography. Though not quite what you were asking for, someone has reversed that process in order to reveal the original images used to create the effect: http://seriss.com/people/erco/2001/

lkozma• 15 years ago

Someone also noticed that Pink Floyd's Echoes is nicely synchronized with the scene. AFAIR, both parties claimed it was a coincidence.

JeanPierre• 15 years ago

The end is not as fascinating as you might think, though the barcode itself is:

http://moviebarcode.tumblr.com/post/3432026155/2001-a-space-...

dhess• 15 years ago

This is great! It deserves to be hosted on a dedicated service, though: something with search, at least, and preferably with a link to the software used so that submissions could be crowdsourced.

taken11• 15 years ago

http://0xdb.org and http://pad.ma/ use similar timelines for all there videos. the code create the timelines can be found at http://code.0x2620.org/oxtimeline

krmmalik• 15 years ago

I was looking for Kung-Fu Hustle, but cant seem to find it(?). I suspect it'll have a lot of pink in the beginning

harshpotatoes• 15 years ago

Lots of blues, oranges, and green. I suppose there is either a bias for filmmakers to prefer these colors, or something in the algorithm 'prefers' these colors?

pedrokost• 15 years ago

This is why I don't really find the images of much use, but they are still fascinating. I think the images completely fail to show the spirit of a movie, all they are good for is for _reviving_ the partially lost feeling of a watched movie. I think they are a great example of computer art.

spot• 15 years ago

Kurt Ralske has done a lot of good work in this space: http://retnull.com/

teilo• 15 years ago

You mean, not every movie uses a Teal/Orange palette?

http://theabyssgazes.blogspot.com/2010/03/teal-and-orange-ho...

jcromartie• 15 years ago

You can see the trend, though. Most big movies since the 2000s seem to fit this.

Grepsy85• 15 years ago

Gee thanks for pointing that out. Now how am I supposed to ever watch a movie again without obsessing over this?

kmfrk• 15 years ago

Another way to browse the site is by the /archive/: http://moviebarcode.tumblr.com/archive.

Come to think of it, I might use some of these as my wallpaper.

toddwahnish• 15 years ago

it reminds me of some of ad reinhardt's earlier artwork.

bwindels• 15 years ago

I would love to see what Sin City looks like.

bane• 15 years ago

Looking at the archive, the ones that jumped out the most at me were

Bambi http://moviebarcode.tumblr.com/post/3658592877/bambi-1942

Hero http://moviebarcode.tumblr.com/post/3515529474/hero-ying-xio...

Tron (1982) http://moviebarcode.tumblr.com/post/3500707114/tron-1982

Surprisingly The wizard of Oz was less interesting than I would have thought. Though the scenes in the Emerald city (bookending the assault on the Witch's castle) do jump out.

http://moviebarcode.tumblr.com/post/3512965847/the-wizard-of...

juiceandjuice• 15 years ago

Bummer, I want to see Akira Kurosawa's Dreams

elvirs• 15 years ago

I dont know for why, but it really impresses me and gives me a feeling that what i am seeing is just amazing.

i guess i am starting to get art now :)

runinit• 15 years ago

Reminds me of the plugin for Amarok, moodbar.

http://amarok.kde.org/wiki/Moodbar

niels_olson• 15 years ago

Another "reminds me of...": amarok moodbar

http://amarok.kde.org/wiki/Moodbar

http://www.flickr.com/photos/niels_olson/504888318/

Can you pass movies through higher-dimensional fourier transform?

ChrisArchitect• 15 years ago

everyone going on about this check out Cinema Redux - movies distilled into one image, from 2004! Done with Processing! http://processing.org/exhibition/works/redux/index.html

zentechen• 15 years ago

Is it possible to associate each strip with a number, like the real barcode?

GeekZeke• 15 years ago

An interesting, abstract twist on cinema redux.

Moviebarcode - Movies compressed to a single frame

Related Stories