Reasons Not to Use Hadoop for Analytics

http://www.quantivo.com/blog/top-5-reasons-not-use-hadoop-analytics

by bsg75 • 14 years ago

7 13 14 years ago

Hopefully, anyone pondering a new project would investigate Hadoop (or any other tool) before choosing it. Not built for ad hoc queries? Yeah, that's fairly open. Requires programming ability? Well, yes, that's the intent: it's not a studio-type environment. You need staff to keep it running? If you have thousands of nodes and need them, then you probably should already have the resources for an engineer or two.

Maybe I'm missing something, but it sounds like the author tried to fit a tool to his needs rather than choosing a tool that already does so.

bsg75• 14 years ago

A mistake many groups tend to make.

spidaman• 14 years ago

Hadoop is good at what it's designed for (data processing parallelization built by programmers) and bad at what it's not (ad hoc queries by people who are not programmers).

Move along here folks, nothing to see here.

bunderbunder• 14 years ago

I'd constrain the description of what it's good at even further. The kind of data processing parallelization it's designed to support is map/reduce. That's only one out of a wide array of possible ways to organize a distributed processing job, and not all tasks are well-suited to it.

jshen3• 14 years ago

What does ad-hoc queries on extremely large datasets easily and in a reasonable amount of time?

haberman3• 14 years ago

Google BigQuery (disclaimer: I work on the BigQuery team): https://developers.google.com/bigquery/

jshen3• 14 years ago

how is this different from hive on hadoop?

pete_o2• 14 years ago

Blog post from my brother (we both work at Quantivo) on BigQuery: http://www.quantivo.com/blog/3-big-technical-limitations-goo....

greesil• 14 years ago

Sounds like an ad for Quantivo. You can pry MapReduce out of my cold, dead hands.

pete_o2• 14 years ago

I work at Quantivo and we didn't post this but appreciate the shout out. Joe added a technical whitepaper written by another Quantivo staffer to his blog post, check it out.

Reasons Not to Use Hadoop for Analytics

Related Stories