Programmers and “productivity”

http://clipperhouse.com/blog/post/Programmers-and-productivity.aspx

by mwsherman • 17 years ago

18 13 17 years ago

clipperhouse.com

Deestan• 17 years ago

Article appears to be deleted. Cannot find anything with similar title in recent archives either.

ComputerGuru• 17 years ago

It's working fine for me - maybe my ISP is caching it or something??

I uploaded a copy (temporarily) to my site, feel free to grab it (PDF format): http://mqudsi.com/junk/Programmers_and_Productivity.pdf

TheSOB88• 17 years ago

You are a nice guy.

keefe• 17 years ago

"If our newly-independent programmer does not make 10x the money, we must admit that she is not the 10x programmer we thought she was." Not a good metric. The signal is at least polluted by social skills and geography - in some areas of the midwest, the social construct of the traditional company is much more entrenched than in some places in CA. Also, I'm 29 and I have no family - I could work totally different places and locations than a family man with roots, which opens up my possibilities much more. imho, conflating the concept of profitability and productivity is not a good idea.

joe_the_user2• 17 years ago

Yes,

I'm actually a skeptic on the generic x10 programmer-productive claim but the claim "Markets tend to clear" when applied anything and everything is more of a justifying fiction than a useful measure. Alan Greenspan and friends used it repeated to justify the housing bubble. And yet this kind of reasoning is still here.

Sigh...

gruseom2• 17 years ago

I'm actually a skeptic on the generic x10 programmer-productive claim

Why? There have been many studies of this and their findings are consistent. IIRC the numbers range from 5-to-1 to 100-to-1 with the median in the order-of-magnitude range.

Pages 14-15 of Robert Glass' Facts and Fallacies of Software Engineering cover this topic.

http://books.google.com/books?id=3Ntz-UJzZN0C&printsec=f...

btilly• 17 years ago

The article makes a number of major mistakes that discredit its whole thesis.

1. My source for the productivity figure is Peopleware. They cite a set of "coding war games" that found a repeatedly measured 10x variation between the best and the worst programmers in their work environment. The productivity difference showed up under a variety of different measurements. There is no vagueness about the measurement techniques or doubt about the figure.

2. The 10x figure was from best to worst, from best to median was (IIRC) 2.6 times.

3. A significant portion of the figure they measured was correlated with environment, and the strongest predictor of performance was the performance of your coworkers. That said their study technique couldn't tell the difference between whether environment attracted the best people, or whether environment caused people to become more productive. (From the point of view of a smart employer there isn't too much difference between those hypotheses.)

4. People accept compensation in many ways, and not all of them involve money. I believe that the better a programmer is, the more apt they are to be willing to trade salary for better work environment, more interesting co-workers, more interesting problems, etc. As a concrete example I have heard anecdotes from many people claiming that people are willing to accept sometimes substantial pay cuts for the privilege of working at Google.

5. Whatever the cause, in the Peopleware study the difference in pay between the top and bottom half of programmers was less than 10%. Furthermore productivity was basically uncorrelated with various factors people look at in the hiring process such as years of experience. That is direct evidence that it is a bad idea to measure productivity by salary.

When you put all of these factors together, you simply can't point to market forces then salaries to discount real performance differences between working programmers.

joe_the_user2• 17 years ago

Ah,

2.6 "Best to median" sounds like a much more plausible figure. The x10 figure is usually quoted in such a way that it seems like it is "best to median".

patio112• 17 years ago

Numbers I cannot disclose to you from a major Japanese multinational which actually tracks programmer productivity (grumble grumble why is this rare grumble grumble) cause me to not have major plausibility problems with the x10 best to median.

camccann• 17 years ago

The expectation of market clearing for programmer wages is completely implausible here.

Going independent requires additional skills beyond the programming productivity that we're supposedly trying to measure, is perceived as riskier (and it's generally understood that most people are irrationally risk-averse), and may involve additional practical complications, such as if our hypothetical programmer relies on salaried employment to provide health insurance for a family. So "would this programmer make more independently" is pretty much an irrelevant question.

As for moving between "regular" jobs, there's little evidence that most hiring processes can distinguish programmers by productivity, nor that most organizations measure the productivity of employed programmers in a useful way. Switching jobs also has practical obstacles, such as the disruption of relocating, and avoiding the perception of "job hopping". So as far as we can tell, salaries have little relationship with productivity, which is kind of the whole point.

Fundamentally, the article makes the mistake of taking principles that are simplifying assumptions in economics and then arguing as if they're universally correct. This is roughly akin to an argument like "Things tend to fall down, so it's a fallacy to ask why helium balloons float."

Of course, you can simply define someone's productivity as the market value of their time and thus "prove" that order of magnitude differences in productivity between programmers don't generally exist, but proof-by-redefining-the-terms doesn't really make for a persuasive argument.

gruseom2• 17 years ago

I agree with the other commenters: the author rather trivially assumes his conclusion by taking for granted that the market is rational. It isn't. One can argue about why. I tend to believe it's because we're still early in the history of the software: the closest analogy we have is the Industrial Revolution, and Ford and Taylor don't appear until well over a century into that.

The other side of the coin, of course, is that an irrational market represents major opportunity for anyone who figures out how to exploit it. So we all should stop complaining and start exploiting. Hopefully the hacker renaissance and startup wave of the last few years are the start of such a process, but it's too early to know for sure.

Programmers and “productivity”

Related Stories