Show HN: RewindHN - Go back in Hacker News history

by kami8845 • 14 years ago

250 51 14 years ago

Great idea! The left and right arrow key functionality doesn't appear to be working for me though (FF 16, Fedora 17).

kami88458• 14 years ago

Hm. That's weird. I'm using http://github.com/madrobby/keymaster to hook up the keys to the same function also used by the slider itself.

Does the keymaster live demo at http://madrobby.github.com/keymaster/ work for you?

codegeek• 14 years ago

works great. I love it.

vasco• 14 years ago

This is awesome, and really well done. The keyboard bindings are very handy. Would be great if it had older snapshots.

kami88458• 14 years ago

That's a good idea! I'll look at incorporating some "historic" snapshots from archive.org

earlyriser• 14 years ago

I really like the UX. I implemented something like this some years ago for HN and other sites, but not as granular, at http://rrrewind.com

egze• 14 years ago

This is awesome!

Nux3• 14 years ago

Doesn't show ANYTHING without javascript....

kami88458• 14 years ago

Ha, you're right. I just put up a notice for <noscripters>

Nux3• 14 years ago

lol! Don't do that, show some real content instead. :-)

zapt02• 14 years ago

Very cool!

donebizkit• 14 years ago

Good one kami

mannjani• 14 years ago

Awesome. One can also use it to analyse various trends on HN. For ex. look at this story: http://news.ycombinator.com/item?id=4739649 from November 4th 6:40 pm to 11:00 pm. Shows you how HN'ers are eager to help each other.

klous• 14 years ago

There was something very similar to this for reddit that was very handy and useful. It was at redditsnapshot.sweyla.com but it shut down at some point. I still think there is an opportunity for someone to index reddit's front page and have it hour by hour and maybe a premium version of all the subreddits you subscribe to.

kahoon• 14 years ago

When I saw that sweylas's stuff has disappeared, I asked them in an email if it will be back again. I didn't get an answer so I implemented my own version: http://redditsnapshots.com/ (running since March 2012)

dotmanish• 14 years ago

Loved this. I would love the feature where I could "highlight" (add a glow for effect) any particular story and watch it move up and down as I play with the arrows. Right now everything moves, so this would help spot trend for a particular story.

All in all, Awesome.

nikunjk• 14 years ago

Blown away on how fast this website is. I kept the left arrow key pressed and it didn't shutter once.

MehdiEG• 14 years ago

Very nice. I actually thought of implementing this a few months ago but a quick Google search brought up http://hackerslide.com/ (also open source), which works fine as well.

petercooper2• 14 years ago

Yeah, http://hackerslide.com/ is mine. This new one has a more precise interface with the keyboard shortcuts though mine continues to run OK two years on with no changes. Here's the thread from when it launched which also topped HN: http://news.ycombinator.com/item?id=1794614 and I wrote a post about the reason for putting it together and how it works: http://peterc.org/blog/2010/334-hacker-slide-anatomy-of-a-4-...

Perhaps one minor bonus to HackerSlide for now is anyone can take the data collected. The URLs for the JSON archives are formatted like: http://hackerslide.com/data/2012-11-01-23.json (YYYY-MM-DD-HH) although even better long term are the once a day versions, e.g.: http://hackerslide.com/data/2012-11-01.json

I've learnt two things from this project in particular. First, that most similar projects don't seem to stick around very long (the Reddit one it was based on disappeared after a few months as have several others - http://hckrnews.com/ is an exception I can recall). Second, these tools seem to be popular at first but then rarely used over time. Luckily I still find it useful to catch up after vacations, etc ;-)

recuter• 14 years ago

"Perhaps one minor bonus to HackerSlide for now is anyone can take the data collected."

Indeed, may I make a suggestion here:

1) Why not make a datadump so people wouldn't need to scrape ~800*24 json files individually?

2) OP ought to load this data into his version so the timeline goes back further

3) It seems quite a few people get the urge to tinker like this with HN, I'm sure pg doesn't mind the scraping, but it strikes me as vastly more efficient if some sort of shared resource was setup and perhaps added to the footer, in the vain of HNsearch, so people don't waste time get crawling data setup.

I'm sure somebody else has a dataset just like yours that goes back further still. :)

Also, thank you for making this and OP for making his. Fun.

blacksmythe• 14 years ago

  >>  most similar projects don't seem to stick around very long ...

  >> ... http://hckrnews.com/ is an exception I can recall)

Much improved way for me to quickly skim HN.

I would be sad if it disappeared.

highace• 14 years ago

Awesome. How about animating it so you can see the posts actually moving up and down?

celalo• 14 years ago

very well done. ux is great.

sxp• 14 years ago

Nice. I'm also a fan of http://hnrankings.info/ which is useful to see when a story has been flagged and suddenly drops off the front page.

sync• 14 years ago

Interesting. Why do some stories get flagged off the front page?

tucson2• 14 years ago

Interesting one.

I would love to see a list of all the Hacker News "meta tools".

I posted my own last week: http://www.HnEasy.com sorts hn all posts and comments by upvotes from the last day... to last 5 years.

chris_p2• 14 years ago

Here's how I see it if I don't resize my window: http://i.imgur.com/WeV5K.png

Goopplesoft2• 14 years ago

Nice. I made something like this for reddit called redditrewind: http://www.redditrewind.com

chris_p2• 14 years ago

That's awesome, but I don't like the UI. A slider would be nice!

Goopplesoft2• 14 years ago

We had a slider at one point, we thought it wasn't as good as this method. Ill look back into the options soon.

kami88458• 14 years ago

Hey. I built RewindHN.

I created this for the HN community and I'm very happy to see so many people enjoying it :)

If you have any questions about how I built this or if you'd like to suggest something new, let me know!

fudged71• 14 years ago

Your app is astoundingly fast. What's your secret?

switz• 14 years ago

His secret is open source https://github.com/doda/rewindhn

kami88458• 14 years ago

Buffering [0] and Caching [1].

The front-end specifically asks for pages in 200-chunks. So whether you slide to page 299,300 or 385, it will request 200-400 from the API. This means I can then very easily serve these requests out of Redis [1] and during usage spikes, requests never hit the disk :)

[0] https://github.com/doda/rewindhn/blob/master/static/rewind/j...

[1] https://github.com/doda/rewindhn/blob/master/server.py#L25

ludwigvan• 14 years ago

I see that you are using pyquery to scrape the content. I was using BeautifulSoup for my previous projects, but it seems pyquery is a better choice due to its compatibility with jQuery, so I am planning to switch too. Are there any downsides to pyquery, though?

Tyrant505• 14 years ago

Awesome work, thank you

username3• 14 years ago

It's difficult to follow changes. Step up and down the ladder of abstraction.

http://worrydream.com/LadderOfAbstraction/

sidcool• 14 years ago

Congrats, it's a very good app!

d0m2• 14 years ago

I'm ashamed to say I had too much already visited links in the past months..

clockwork_189• 14 years ago

This looks amazing! Good job! If I may ask(yes I have taken a look at your code but unfortunately my python is not too good), whats the "secret" to grabbing HN's historic data? Also, would it be possible to go back beyond one month towards maybe a year or even few years back (idk if it is just me but I can go up until October 9th, 2012)?

Thanks!

kami88458• 14 years ago

https://github.com/doda/rewindhn/blob/master/scrape.py#L26

This is where the scraping happens. The code is a little uglier than I'd like, but that's largely to do with the hard-extract-data from HN markup. I'll look at adding more data soon.

eande• 14 years ago

Great work! Typing date/time directly would be a nice extra feature.

EGreg• 14 years ago

Great work! Please try to change control-arrows to something else, as Macs map it to switching desktops :)

levlandau• 14 years ago

Very nice

Show HN: RewindHN - Go back in Hacker News history

Related Stories