Thursday, January 27, 2011

The Backstory of Yahoo and Hadoop · Yahoo! Hadoop Blog

The Backstory of Yahoo and Hadoop · Yahoo! Hadoop Blog: "Back in January 2006, when we decided to invest in scaling Hadoop from an interesting prototype to the robust scalable framework it is today, it was obvious that our direct competitors had or were building private implementations of map-reduce and clustered storage. We didn't believe that this type of infrastructure would bring sustainable advantage to any one competitor: the needs of Web Search at the time were driving everyone in in a similar direction. Thus, instead of building yet another private implementation, we believed that investing in an Open Source solution would bring Yahoo! numerous benefits."