Is HN changing ? Part 2

http://jacquesmattheij.com/hn-long-term-change-2

by jacquesm • 17 years ago

30 37 17 years ago

niyazpk• 17 years ago

It is so sad that Startups category is getting less and less prominence over time.

Is HN becoming reddit? Considering the quality of articles, I would not say so. The high quality of discussions may have stayed the same too. At the same time, the graphs suggest that the topics discussed here seem to have changed a bit.

jacquesm14• 17 years ago

As Paul Graham already explained in the first installment of this analysis the biggest part of the change is due to a repositioning of the site early on.

The more recent change can not be attributed to that though.

Another important thing to note is that since these are all relative sizes it does not say that in an absolute sense there is less startup stuff, in an absolute sense it is most likely more due to the increased posting volume.

This just documents the change of the 'mix'.

nailer• 17 years ago

"Is HN becoming reddit? "

A post with a badly rhyming version of 'The Real Slim Shady' about single founders (OK startup related, but not really insightful) was sent to the front page a few days ago.

Right now there's an article from Boingboing about putting a gun in your carry-on luggage so the TSA secure it (which is very much Reddit) and the Haiti earthquake, and genocide of natives in America (general interest yes, 'Hacker News'? No).

I've gotten into the habit of flagging non-tech related posts in the hope that will fix things.

pxlpshr• 17 years ago

I do think there has been a noticeable change but I don't think it's entirely bad. For example, a discussion around Haiti with a bunch of technologists on HN - as oppose to on Reddit - could manifest a new challenge and opportunity for another hacker that impacts the world in a meaningful way as oppose to yet-another-photo-sharing-site.

I think it's pretty inevitable that as a site grows its core focus will become diluted. I'm not entirely happy to see less startup/tech news either, and I believe there are only two solutions for that: 1. growth with it and deal or 2. convert to a private community with limited invite-only (or application based).

yannis• 17 years ago

Just a little less of mainstream would be nice! I don't mean things like what is happening with Google and China right now but in general there is too much mainstream.

jacquesm14• 17 years ago

Right now the original google & China posting is at 1087 points, the runner up is the posting by dfranke about hacking HN:

http://news.ycombinator.com/item?id=639976

If anything that is a really good indication how big the karma inflation really is.

Dfranke spent a lot of time and effort to come up with a brilliant hack, used every trick in the book and was rightfully the top HN posting of all times.

A virtually unknown HN users posts a blog posting from googles official blog and aces the previous #1 (and will probably go up a lot further still).

So much for the theory that submissions get voted up to 'what they're worth'.

ErrantX2• 17 years ago

A virtually unknown HN users posts a blog posting from googles official blog and aces the previous #1 (and will probably go up a lot further still). So much for the theory that submissions get voted up to 'what they're worth'.

I'd say that is proof that who the poster is doesn't factor into how people are voting on a threads worth. I'd call dfranke's thread an exception to that rule.

(it depends on your feeling of worth; the HN hack was extremely impressive and clearly, locally, worth lots of votes and kudos. On the other hand the Google announcement is huge news for lots of the tech world :) )

davidw• 17 years ago

I have started paying attention to this: I tend to vote up people who have done something, whether it's a company, a cool hack, or something along those lines. If a "blah blah" post like the Google one has already got a lot of votes, I'll tend not to vote for it (especially since there's no classification filter or anything like that), even if I like it.

I also tend not to vote for stuff if it's already in the top 5 spots - what's the point? I'd rather let other things bubble up.

swombat• 17 years ago

Why is "blogs" a separate category? Aren't blogs about technology, startups, etc?

jacquesm14• 17 years ago

That's the catchall for blog articles that were not identified as technology, startups etc.

Probably a more in-depth analysis of the content of the pages linked to would give more insight in to that.

gojomo• 17 years ago

Perhaps comparing the relative prevalence of words in headlines (or comments) over time would give more insight.

jacquesm14• 17 years ago

There are two more steps in this series, the first is concentrating on the increase in volume over time, in terms of users, postings and karma inflation, the step after that is vocabulary analysis of the titles.

I'll put in a cut-off on noise words and one on obscure terms, the part in the middle should give some idea about trends.

I'm surprised how much work it is to do all this, I figured I'd just slap it together in a day or two but it has been a full week now.

So much for those 'weekend' projects...

chris123• 17 years ago

If you don't change, you die. But I hear ya. It like when your favorite neighborhood or neighborhood establishment gets "discovered" and it's character changes forever. That's the nature of things, the good, bad, and ugly.

tdoggette2• 17 years ago

In case it wasn't clear yet, the 'units' for the axis are simply the rank number of the postings, 1000 postings vertically, blocks of 1000 postings horizontally. That makes the time-axis non-linear.

No, it wasn't. Why aren't these graphs labeled? They make no sense without knowing what they are already.

jacquesm14• 17 years ago

The text is meant to illustrate what the graphs are all about, how much clearer than that sentence could it be ?

tdoggette2• 17 years ago

It's not that the necessary information isn't communicated-- it is. The problem is that there's a complicated graph that's the main content of the page, and it lacks a title and axis labels.

paraschopra3• 17 years ago

Hi James,

If you would like to automatically classify HN Posts into relevant category, please feel free to use our ContextSense API - http://www.wingify.com/contextsense/

PS: I'm not writing this to promote the product (because it is not actively marketed in the first place)

jacquesm14• 17 years ago

It's Jacques, not James :)

Thanks, that's nice of you!

paraschopra3• 17 years ago

Sorry for mis-spelling your name!

gopher• 17 years ago

I've left HN some time ago, when I came back here today, I've seen three PHP stories on the front page. I'd say: yes, it changes. But I must credit one PHP story was on Pharen, "A lispy language that compiles to PHP".

tokenadult• 17 years ago

The large "unspecified" category leaves me in the dark about whether this is various stuff possibly well related to the HN guidelines

http://ycombinator.com/newsguidelines.html

or various stuff not well related to those guidelines at all. A trend within that category probably does more to change the general flavor of HN than the observed relative size changes of some of the specified categories.

jacquesm14• 17 years ago

The fourth installment will deal with that, the next one will be about the effects of the increase in size over time.

joubert3• 17 years ago

Put legend on the axes. Use a logarithmic scale.

jacquesm14• 17 years ago

Logarithmic ? Why that ?

joubert3• 17 years ago

Because it is useful in comparing rates.

Here's a nice write up: http://www.health.state.pa.us/hpa/stats/techassist/arithlog....

marknutter• 17 years ago

This highlights the fundamental problem of social bookmarking/voting sites: the more people that join the site, the lower the common denominator of the content gets. I've seen it happen to Digg and Reddit, and it is bound to happen to Hacker News at some point. It makes me wish that there could be groups formed within these websites that are kept small, and you would only see stories that are voted on by those members. This would be different than the sub-reddits solution because it would apply to all content, not just a specific category.

elblanco• 17 years ago

I think perhaps a more interesting way of looking at this is to simply take a category, plot all of the posts over the pseudo-time x-axis, then calculate a least squares trend line for that category.

Categories that slope down on shrinking, and categories that slope up are growing.

In the end, a graph isn't even necessary, just a list of categories ordered by slope.

Is HN changing ? Part 2

Related Stories