My First Recommendation to New Scientific Coders: Learn Visualization

http://vincebuffalo.org/2012/11/08/learn-visualization.html

by nkurz • 14 years ago

66 29 14 years ago

klochner• 14 years ago

More generally - be aggressive with your data: probe it, sort it, graph it, sanity check it, and never take it at face value.

neilbowers• 14 years ago

That's a terrible visualization. It takes way too long to work out what "the story" is.

sprobertson• 14 years ago

It's really only useful when interactive - http://www.jasondavies.com/parallel-sets/ - and it still takes a while to figure out what's going on.

TeMPOraL• 14 years ago

Clicking on a Show icicle plot! checkbox down in the article converts this visualization to something much more readable.

hagy2• 14 years ago

I wouldn’t say it’s a terrible visualization, although in general I do believe conditional 2D plots are the best way to show trends in higher dimensions. For example, here are some conditional plots for similar data (Kaggle Titanic competition) that I’ve found insightful.

http://i.imgur.com/C4uyH.png

The conditioning on Sex/Class seems to be the best way to illustrate the trends in these 4 dimensions.

zerostar07• 14 years ago

Curious about what other libraries people use. Matplotlib? Matlab?

NerdGGuy• 14 years ago

I've used VTK before. The learning curve is much larger and it's a huge library. But it does have a lot of inbuilt functionality like database access with filters/conversions to format the data the way you need it.

juanre• 14 years ago

In the color science community lots of people use matlab. I find matplotlib and numpy to be a great combination.

o1iver• 14 years ago

In engineering we use a lot of Matlab.

hagy2• 14 years ago

I’d strongly recommend matplotlib. It has a matlab like procedural interface that makes it very easy to pickup if you’re coming from matlab.

Additionally, it’s wonderful to be able to “dive under the hood” if you need to create a special type of visualization: i.e. the internal model is easy to understand and highly customizable. This has enabled me to create several awesome plots that would have been very difficult, if not impossible to create with any other plotting program or library.

marksbrown• 14 years ago

I completely agree about the breadth of matplotlib, though the difficulty can be looking for examples. I've often found the examples on the matplotlib website to be horribly out of date compared to features added in recent releases. Are the plots you've done available online / Any recommended blogs for interesting examples of plotting?

varjag• 14 years ago

Tulip is great if you deal with huge datasets that can be represented as graphs.

http://tulip.labri.fr/

dbecker• 14 years ago

Python is my go-to language, so I use matplotlib frequently. But I think R's ggplot2 is easily the best visualization library out there.

Bokeh is supposed to be a ggplot2 clone for python, but it's still in the very early stages.

saboot• 14 years ago

Physicist here.. I use CERN ROOT as it does just about everything. Occasionally I'll mix it up with python and matplotlib. GNUPlot is still great though too.

nicpottier• 14 years ago

Jesus, is that visualization supposed to help? I stared at it for minutes and I still don't really grok it. Seems like it is trying to channel a similar method as the Napolean March: http://bryanrulli.files.wordpress.com/2011/05/tufte_napolean...

But failing completely at it.

In any case, is this a common type of visualization now? Maybe with some experience it becomes easy to grok what is happening?

radicalbyte• 14 years ago

No, it's not common to see this kind of visualisation. Bad visualisations? Yeah, they're pretty common. The usual mistake is overuse of Pie Charts.

I'd recommend the OP (and anyone else who has an interest in communication) to read:

The Visual Display of Quantitative Information http://www.amazon.co.uk/The-Visual-Display-Quantitative-Info...

Information Dashboard Design http://www.amazon.co.uk/Information-Dashboard-Design-Effecti...

Now You See http://www.amazon.co.uk/Now-You-See-Stephen-Few/dp/097060198...

tgb• 14 years ago

Ironically, the OP recommends that you read The Visual Display of Quantitative Information, as well. I suspect that the mediocre example (I thought it was reasonably readable and somewhat interesting) was there more as a demonstration of the fact that R makes non-scatter plots easily, too.

SiVal• 14 years ago

I eventually figured it out, but there was no AHA! about it. I had to slowly pick it apart every step of the way, like working through an obfuscated C contest entry.

1wheel• 14 years ago

I've seen a clearer version of the same chart; when it doesn't show children it is much easier to understand what is going on.

pseut• 14 years ago

A dot chart would have been substantially better. I haven't seen that sort of visualization before. It's probably a mistake to try to show the relative size of each group in the same picture as the absolute size.

svramanan• 14 years ago

The table for "Age = Child, Survived = No" is the same as the table for "Age = Adult, Survived = No". Odd, to say the least. One wonders where this interesting fact is shown in the visualization.

mertd2• 14 years ago

If that were true, that would mean first and second class completely survived. But the visualization shows this is not the case.

hythloday• 14 years ago

This is true of really all programming disciplines. I've lost count of the times that dumping a CSV for Excel or a dot file for graphviz. Visualisation is just as much an essential part of my toolbox as a text editor or debugger.

nashequilibrium• 14 years ago

I really thought hard for a minute if the author was joking, the visualization is really terrible. I would rather look at the table than the visualization, i found this pycon talk really nice explaining dataViz patterns: http://pyvideo.org/video/637/data-design-meaning

bigsteve122• 14 years ago

learn visualization but not the underlying statistical common sense that allows you to produce meaningful data. yah right... R will do everything for you... no need to worry about the real work...

mertd2• 14 years ago

There is a mistake in the tables. Top two are copies of each other but they are supposed to show different things.

pardner• 14 years ago

It looks to me like the tabular data is inconsistent with the visualization - the tables showed 0 perished from first or second class or crew, the visualization showed something entirely different.

My First Recommendation to New Scientific Coders: Learn Visualization

Related Stories