NoSQL/Big Data in the Cloud

Great post about NoSQL and Big Data in the cloud - an overview that also discusses a portion of the Bing Social Data Platform (I managed this team and the larger platform effort during my time in Bing).

The numbers are quite interesting for scale geeks like me:

It’s also used by the Bing search engine to provide almost-immediate publicly searchable content from Facebook or Twitter posts or status updates. With around 350TB of data, the scope of Facebook and Twitter data is remarkable. When this data is being ingested, transaction throughput reaches peaks of around 40,000 transactions per second and totals between 2 to 3 billion transactions per day.

To summarize:

  • 40k trans/sec at peak
  • 2 to 3b trans/day
  • 350TB of data. The numbers and scale