Google recently announced its new search feature called “Instant”. From early reports about the new service, there was a lot of back-end work that needed to take place. In fact, it sounded like deficiencies in the speed at which Google was able to update its index was a motivating factor. The Register is points to Google’s “caffene” release earlier this year as departure from its reliance on MapReduce in favor of improvements to BigTable. The real story here is the much needed reimplementation of the Google File System.
Werner Vogels, CTO at Amazon.com, posted a paper on Amazon’s internal called “Dynamo” about two year ago that was selected to be presented at the 21st ACM Symposium on Operating Systems Principles. Dynamo is Amazon’s internal cluster software platform. It is really their operating system since they add “hot swappable” commodity hardware to the system in plug-and-play fashion as needed.
I know I’m late to finding this particular paper since it was first published about two years ago. Better late than never!