Lucene and Scalability

From Foochal

Contents 1 Frameworks 1.1 Hadoop 1.2 Solr 2 External links 3 Success Stories

Frameworks

• Hadoop consists of an open source implementation of Google's published computing infrastructure, specifically MapReduce and the Google File System (GFS)

Hadoop

• Running Hadoop using Amazon EC2 at Apache, or at Amazon
• Running Hadoop using Amazon S3

Solr

• Solr is an open source enterprise search server based on the Lucene Java search library, with XML/HTTP and JSON APIs, hit highlighting, faceted search, caching, replication, and a web administration interface. It runs in a Java servlet container such as Tomcat.
• According to this article, Solr is CNET.com search engine
• A scalability story of how Rackspace solved their scalability problem using Hadoop, MapReduce and Solr.
• Another scalability story with solr and sql combination.

External links

• Discussion: http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg12507.html

Success Stories

• Powerset scalability story using Amazon EC2 and S3, Hadoop