Slides

G. De Francisci Morales SAMOA: A Platform for Mining Big Data Streams Keynote Talk at RAMSS '13: 2nd International Workshop on Real-Time Analysis and Mining of Social Streams WWW, Rio De Janeiro, 2013.

API Javadoc Reference

http://samoa.incubator.apache.org/docs/api

Mailing lists

User support and questions mailing list: users@samoa.incubator.apache.org.
You can subscribe to this list by sending an email to
users-subscribe@samoa.incubator.apache.org.
Likewise, you can cancel a subscription by sending an email to
users-unsubscribe@samoa.incubator.apache.org.
You can view the archives of the mailing list here.

Development related discussions: dev@samoa.incubator.apache.org.
You can subscribe to this list by sending an email to
dev-subscribe@storm.apache.org.
Likewise, you can cancel a subscription by sending an email to
dev-unsubscribe@storm.apache.org.
You can view the archives of the mailing list here.

At the current stage most of the discussion happens on the dev@ mailing list.

Contributors

List of contributors to the SAMOA project.

Build Apache SAMOA

• Apache Storm

  Go to the folder where you want to store your project, and clone the new repository:

  ~$git clone http://git.apache.org/incubator-samoa.git

  ~$cd incubator-samoa

  ~$mvn -Pstorm package

  The deployable jar for Apache SAMOA will be in target/SAMOA-Storm-0.3.0-SNAPSHOT.jar.

• Apache S4

  If you want to compile Apache SAMOA for S4, you will need to install the S4 dependencies manually as explained in Executing Apache SAMOA with Apache S4.

  ~$git clone http://git.apache.org/incubator-samoa.git

  ~$cd incubator-samoa

  ~$mvn -Ps4 package

  The deployable jar for Apache SAMOA will be in target/SAMOA-S4-0.3.0-SNAPSHOT.jar.

• Local Test Mode

  If you want to test Apache SAMOA in a local environment, simply clone the repository and install Apache SAMOA.

  ~$git clone http://git.apache.org/incubator-samoa.git

  ~$cd incubator-samoa

  ~$mvn package

  The deployable jar for Apache SAMOA will be in target/SAMOA-Local-0.3.0-SNAPSHOT.jar.

Getting Started

• Download Apache SAMOA

  ~$git clone http://git.apache.org/incubator-samoa.git

  ~$cd incubator-samoa

  ~$mvn package

• Download the Forest CoverType dataset

  If you want to compile Apache SAMOA for S4, you will need to install the S4 dependencies manually as explained in Executing Apache SAMOA with Apache S4.

  ~$wget "http://downloads.sourceforge.net/project/moa-datastream/Datasets/Classification/covtypeNorm.arff.zip"

  ~$unzip covtypeNorm.arff.zip

  Forest Covertype contains the forest cover type for 30 x 30 meter cells obtained from the US Forest Service (USFS) Region 2 Resource Information System (RIS) data. It contains 581,012 instances and 54 attributes, and it has been used in several articles on data stream classification.

• Run an example

  Classifying the CoverType dataset with the bagging algorithm

  ~$bin/samoa local target/SAMOA-Local-0.3.0-SNAPSHOT.jar "PrequentialEvaluation -l classifiers.ensemble.Bagging -s (ArffFileStream -f covtypeNorm.arff) -f 100000"

  The output will be a list of the evaluation results, plotted each 100,000 instances.