Klout and Big Data

Klout uses Hadoop to crunch large volumes of data using clusters of commodity servers. Klout captures and processes over 3 billion signals a day and Hadoop is an excellent, horizontally scalable platform for just doing just that.

Klout sought out a solution that leverages Hadoop’s scale and cost effectiveness while delivering “speed of thought” ad hoc queries. The key was to create a multi-dimensional query “index”, or cube, that sits in front of Hive and serves realtime, ad hoc, “anything by anything” queries using the upcoming version of Microsoft SQL Server Analysis Services (code name “Denali”).

Read more about how Klout uses Hadoop and SQL Server Analysis Services.