Deep Chernoff Faces

https://www.ihatethefuture.com/2020/06/deep-chernoff-faces.html

by pxx • 6 years ago

138 33 6 years ago

this is a very interesting idea, but I think using gender and skin tone to represent data differences is potentially problematic, particularly if the data has any sort of normative meaning. the other variables are interesting though

ebg133• 6 years ago

I think this post is meant to be a joke.

ianai3• 6 years ago

It’s not funny.

w1• 6 years ago

Super cool! Also, a character visualizes data this way in Watts' "Blindsight" novel.

fab1an• 6 years ago

Came here to say this! That creepy cool chernoff face utilizing vampire captain. So cool.

outworlder3• 6 years ago

Given that humans were prey for vampires, the variables selected by the captain showed faces in different states of anguish, which the predator was well-equipped to detect. So it is even creepier.

outworlder3• 6 years ago

Yeap, that was my introduction to the concept.

Blindsight is wonderful. A bit difficult to follow at a time due to the 'unique' writing style. In the same novel it tackles uploading consciousness, vampires, artificial intelligence, aliens, psychology (heavily) and a few more things.

I've yet to find a better description of what would be an actual alien lifeform. Even if it is biased a bit on marine biology given the author's qualifications, the oceans are host to the most 'alien' environments we are aware of that still contain life.

I still can't wrap my head on the concept of the Icarus Array though.

Anyway, for the uninitiated: https://rifters.com/real/Blindsight.htm

ibrarmalik• 6 years ago

The idea behind Chernoff faces (or using faces for data visualization) seems good: we humans are very good at distinguishing faces, so we can quickly find groups and outliers if the data is encoded with a face.

But we have to be careful with this. Changing facial expressions is not the same as increasing the height of a barplot, we're relating features with expressions and the visualization might express things that you don't want.

There is a very famous example for this in "Life in Los Angeles" (1977) by Eugene Turner [1]. Maybe you can infer the data well but in the end this just ends up being a map of angry black people. The choice of features and how to visualize them is clearly racist.

[1] https://mapdesign.icaci.org/2014/12/mapcarte-353365-life-in-...

ebg133• 6 years ago

The idea behind Chernoff faces (or using faces for data visualization) seems good: we humans are very good at distinguishing faces

Except that:

1. We humans are actually _ABYSMAL_ at distinguishing faces (https://en.wikipedia.org/wiki/Cross-race_effect)

2. The ability to differentiate between two things and the ability to translate attributes into metrics are fundamentally so different from each other that any possible truth to the idea instantly becomes wildly irrelevant. https://eagereyes.org/criticism/chernoff-faces

sukilot2• 6 years ago

One case of being imperfect isn't "abysmal". Cross facial discrimination is far more accurate than cross-species body discrimination, or wood grain discrimination, or many other things. There are brain regions detected to be dedicated to facial recognition.

sukilot2• 6 years ago

Huh?

That map colored black people dark like their skin, and encoded misery as unhappy faces.

The result accurately showed happy white people and unhappy black people. How is it racist to acknowledge the racially biased distribution of suffering?

gnramires3• 6 years ago

See the legend. Things are ranked from "Good to bad", (Urban stress, unemployment) and proportion white population is right there in parallel, screaming "White"=="Good".

There are a number of other lesser reasons, including conflating regions of high urban stress as "Evil" or "Angry" instead of just unhappy[0]. The face visualization just implies too much of a value judgement on the data -- too correlated with the issue (yet misrepresentative) to be a good idea imo.

[0]: Even happy/unhappy may not reflect well at all this variable (again because that's a complicated human emotion, not a simple function of "Health crime and transportation factors").

Edit: I think it's also not necessary to call the map creator (or maybe the map itself) racist, this implies some kind of intentional discrimination (and is quite strong imo), but it does have to me grave mentioned problems.

peteretep• 6 years ago

I was involved with the development of a system once that was trying to show a required minimum diversity in hiring. Quite by accident, this ended up being an outline person that was filled in more as diversity got better, and both the outline and fill happened to be black. It took a while for this to be noticed, and I think they eventually swapped it out for a small pie chart instead.

outworlder3• 6 years ago

Turner does a good job of building a facial profile out of social conditions and ethnicity. It’s a simple map but one that characterises the spatial structure of socio-economic life in Los Angeles. It’s also a provocative and arresting image and one which is difficult to hide from.

That's a very successful application if you ask me. It shows unhappy black people. They are displayed as unhappy because they are unhappy. The focus should be on how to make them happy, not 'racism'. It is displaying the effects of racism for all to see.

ianai3• 6 years ago

I’ve got to pull the alarm on this one. This is a huge liability to objectify and promulgate prejudice. It’s literally teaching people to associate good or bad distinctions with specific faces or facial features. How is that not objectifying? I think this should be treated highly suspiciously and probably not done at all.

Edit-I see people may take this as a joke. Sorry, not funny. Especially not right now.

brokensegue• 6 years ago

it's definitely a joke. nobody uses chernoff faces

identity02• 6 years ago

You have to be joking. This is obviously one programmer's experiment on some esoteric data visualization mode that nobody ever used. The author even says in a footnote that:

"One of my favorite¹ concepts for multi-dimensional data visualization is the Chernoff Face"
1: "Favorite" might be code for "useless," going with the theme of this blog"

Don't act like this project will have actual real world uses and ramifications. No, it won't literally teach people to associate good or bad qualities with facial features, because nobody will ever use it for practical purposes. No, there's no liability to promote prejudice, this is just some programmers ML side-project.

How is that not objectifying?

It literally is. The generated faces are mathematical objects. They're not real people.

ianai3• 6 years ago

In the faces I saw there was a clear connection between race and facial expression of happiness or sadness.

CapmCrackaWaka• 6 years ago

Your comment is pretty alarmist, but I don't find the probability of this article (or Chernoff faces in general) having a negative impact on racial relations very high. Maybe you can convince me otherwise, but I think it's just an interesting, if not very useful, way to display data. I'll leave it up to you to come up with a compelling (plausible) scenario in which this negatively impacts anyone.

nxpnsv2• 6 years ago

It is using that we are used to look at faces as a way to display multi variate categorical variables. Not all of such dimensions are bad/good dichotomies. Deeming a visualization technique as evil because it can be used to poor taste may seem clever, but ultimately will leave us with no visualization techniques left.

kleer001• 6 years ago

Especially not right now.

Right now what? Sounds like you're jumping at shadows. In general false positives are good for finding errors in systems. However, they can go too far and lead to pathological patterns like human immune system self-alergies.

asavinov• 6 years ago

There is an implementation of Chernoff faces where a fish is used instead of a human face, so it is called Chernoff fish:

http://tmm-archive.github.io/chernoff-fish/

It is implemented in D3 and React and the source code is here:

https://github.com/tmm-archive/chernoff-fish

I implemented my own version long ago (for MS-DOS) and I am quite surprised that there is still some interest in the topic.

Daub• 6 years ago

One of the weirdest research project I ever got involved in was 'Real-Time Feedback System for Monitoring and Facilitating Discussions'. Using a game engine as the platform, it used dance-off moves to visualize social interaction within a discussion.

One quote from the paper taken from 'The Craft of Information Visualization' (Bederson and Ben Shneiderma): 'Humans can recognise the spatial configuration of elements in a picture and notice relationships among elements quickly.'

mysterEFrank• 6 years ago

Nice!

ninjabiker• 6 years ago

Chernoff faces are an old idea that have become more of a joke (eg https://dl.acm.org/doi/pdf/10.1145/3170427.3188398 ). The problem is that they are weird enough to occasionally lure in well-intentioned people who are new to datavis. Encoding abstract data as faces results in unpredictable, unrelated, gross visualizations that are difficult to read. The only good one I have seen is https://projects.propublica.org/graphics/workers-compensatio... and it’s creepy.

totetsu• 6 years ago

It kind of reminds me of the genre of study material in Japan that personifies everything as a cartoon character. Here is the periodic table as little figures https://resemom.jp/article/img/2017/03/16/37127/162618.html

and this book is it as Manga girls.

https://www.amazon.co.jp/%E5%85%83%E7%B4%A0%E5%91%A8%E6%9C%9...

Deep Chernoff Faces

Related Stories