As both a heavy phabricator user AND a graphviz lover, your comment got me quite excited....up until the part where it was removed :(
HN user
neilkod
hadoop, python, data, oracle....
>>never really considered myself good enough to pursue it though
Self-doubt is an evil, evil thing. Don't let it hold you back. I landed an opportunity to interview at $REDACTEDBUTITSATOPINTERNETPROPERTY. I didn't even want to fly out for the interview - I thought it would be a waste of time. It took lots and lots of convincing by my wife and other friends and family just for me to go out and interview. I guess you can see where this is headed - I start there in 2 weeks.
tl;dr self-doubt is evil.
loved tcfast.com - I'd like to see it back online as well
I did a fizzbuzz of my own last night http://neilkod.posterous.com/just-had-to-give-googles-blockl...
CBSSports.com http://developer.cbssports.com/ launched a similar product a few months back - it seems to be going well and offers more data than ESPN does, including fantasy data. My initial reaction is that ESPN hastily cooked this up as a response to what CBS did.
Disclaimer, I work for CBS Interactive, the parent company of CBS Sports.
That looks like TOC for "Machine Learning for Email", which is just a portion of the entire "Machine Learning for Hackers" book. The full "Machine Learning for Hackers" doesn't appear to be on Safari yet.
for whatever reason, there is a HUGE demand for etl and bi developers here in FL. Data Warehousing is evidently strong in these parts. You wouldn't know this from reading blogs/twitter/etc but there is quite a bit going on here.
Thanks, I'm going to update the code and re-run the numbers.
I'm over word clouds by now. If you look at my site, you'll see that I've done my fair share of them, including one generated from the script of the big lebowski.
However, Paul Kedrosky did a pretty nice job with one - check it out at https://twitter.com/pkedrosky/status/127796382684819456
You are all 100% correct about the regex. Before converting the product-identifying matching code to Python, I did it in bash using grep -iw to match whole words.
for i in newton macintosh macbook ibook iie mac iphone ipod imac ipad II+ iigs LaserWriter osx 'apple ?tv' itunes '\]\[' imovie do stevejobs_tribute.txt |wc -l`" echo "$i: `egrep -wi "${i}s?" $INPUTFILE|wc -l`" done
But this was difficult to maintain. I wanted the ability to print a 'friendly' looking product name (the dict's key) and maintain the counts in a variable.
When I made the move from bash to python, I knew that there would be some overlap when I pushed this code (in the name of shipping!). I need to split the sentences into proper tokens and then check each token for a product match. I'm already splitting the sentence into tokens for part-of-speech tagging so it shouldn't be difficult to do.
tl;dr known issue on the Mac regex, I needed to publish it and get back to work!
Tom Kyte fan, by chance?
So true. Delicious would always be my go-to place for anything I ever wanted to know about Oracle. For years I'd search delicious before even searching google or metalink. It's a shame that this is being closed.
How are you managing your twitter API rate limits? Have you been whitelisted?
I find it full of awesome that you're sharing the source. Nice work.
Hey thanks, I'm not at pubcon, i just like doing cool things with data. pubcontweets is a small part of a larger product i'm working on.
As someone who within the last two weeks picked up app engine and created an MVP of my own http://www.pubcontweets.com, I can not only relate to your story but also applaud you for sharing the it as well as your code. Thanks.
I do in fact use the streaming api but that doesn't help with things I need, such as getting screen names based on a twitter id, and getting lists of followers for thousands of people at a time, in order to do some graph processing.
what is the best way to get whitelisted for more than 360/hour API calls? I'm trying to do some network analysis and data mining and am held up by the API limit. I've applied about 4-5 times and have been denied each time.
um how? Dammit Jim I'm a data nerd, not a UI designer! This is why I threw my hat into the competition ;)
thanks! Copy/paste fail! Fixed it.
http://www.mymomjust.com and http://www.mydadjust.com. Using hadoop/pig, I searched through my 620-million strong twitter archive for all tweets containing "My Mom/Dad Just....." The results are hilarious. It's just a single-page site and could be some low-hanging design fruit.
I couldn't agree more. My world has expanded because of twitter and the access it gives you to experts and people who are willing to share what they've learned and experimented with.
Brilliant tutorial - Very in-depth and covers quite a lot of ground.