You might be thinking, what does “Starting-up within Microsoft” mean?
Though it is not very common, at Microsoft we occasionally incubate products or technologies from a ground-up. Typically at any group at Microsoft we do haveshort-term, mid-term and long-term focus. Incubation of new technologies can happen for different focuses and needs and mostly they are considered as long-term bets.
Maguro ~ The Big Tuna
Maguro means tuna in Japanese language. But, why we incubated Maguro? We were not Google, our index was only a fraction of what Google had in 2010, and we did not have as big of a budget as Google.
We realized that one way to stay alive is to increase our index size, so our goal was to scale our index size from low to high tens of Billion Documents with technology that can support up to 1 Trillion documents.
Using the current architecture, then, was not financially feasible as it will be too expensive, besides it will hit a perf bottleneck at that scale. Hence we incubated Maguro, a system for efficiently searching very large collections of text content of up to 1 trillion documents at low cost.