Its often said when you work closely with something, you sometimes lose track of the big picture (you can’t see the forest for the trees). But I also find that a lot of times, people who aren’t familiar with something focus too much on the details and miss the big picture. In discussing my Hadoop cluster project with people, they don’t understand the point of it. “Why setup four PCs to work on something. Can’t you just get one really powerful PC and do the work with that?” they ask.
DIVIDE THE WORK
The innovation that Hadoop provides is in HOW it does the work. For many years, in IT as well as other areas, the solution when faced with bigger and bigger workloads has been to get a bigger, faster, stronger tool. Here are some examples: (more…)