• Votes for this article no votes for this yet
  • Dashboard Insight Newsletter Sign Up

Facebook goes open source with query engine for big data

by Dashboard Insight, Dashboard InsightThursday, November 7, 2013

Exciting news for the data world as PCWorld reports that Facebook has released an open source SQL query engine.

Potentially raising the bar on SQL scalability, Facebook has released as open source a SQL query engine it developed called Presto that was built to work with petabyte-sized data warehouses.

Currently, more than 1,000 Facebook employees use Presto daily to run 30,000 interactive queries, involving over a petabyte of processing, according to a post authored by Facebook software engineer Martin Traverso. The company has scaled the software to run on a 1000-node cluster.

Now, Facebook wants other data-driven organizations to use, and it hopes, refine Presto. The company has posted the software’s source code and is encouraging contributions from other parties. The software is already being tested by a number of other large Internet services, namely AirBnB and Dropbox.

Continue reading here

Source: PCWorld

Tweet article    Stumble article    Digg article    Buzz article    Delicious bookmark      Dashboard Insight RSS Feed
 
Other articles by this author

Discussion:

No comments have been posted yet.

Site Map | Contribute | Privacy Policy | Contact Us | Dashboard Insight © 2017