ds.granules.samples.wordcount

Class WordCountDeployer

java.lang.Object

ds.granules.operation.InstanceDeployer

ds.granules.samples.wordcount.WordCountDeployer

All Implemented Interfaces:

JobLifecycleObserver

public class WordCountDeployer
extends InstanceDeployer

The deployer for the WORD Count information retrieval example, which allows one to histogram words from given set of files over a distributed set of resources.

Author:

Shrideep Pallickara

Field Summary

Fields

Modifier and Type	Field and Description
static java.lang.String	MODULE_

Fields inherited from class ds.granules.operation.InstanceDeployer

MODULE

Constructor Summary

Constructors

Constructor and Description
WordCountDeployer() Initializes the deployer.

Method Summary

Modifier and Type	Method and Description
static void	main(java.lang.String[] args)
void	prepareInstancesAndDeploy(int numOfMaps, java.lang.String filenameBase) Prepares a set of Map/Reduce instances for the WordCount example and deploys it on the set of available resources.

Methods inherited from class ds.granules.operation.InstanceDeployer

completedExecution, completedSuccessfully, completedWithErrors, createJobIdentifier, deployOperations, deployOperations, deployOperations, getStatus, initialize, initialize, initialize, killJob, refreshStatus, refreshStatus, resetTrackers, setStartTime, startedExecution

Methods inherited from class java.lang.Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MODULE_

public static final java.lang.String MODULE_

See Also:

Constant Field Values

Constructor Detail

WordCountDeployer

public WordCountDeployer()
                  throws CommunicationsException,
                         java.io.IOException,
                         MarshallingException,
                         DeploymentException

Initializes the deployer.

Parameters:

streamingProperties - The properties for streaming

Throws:

CommunicationsException - If there are network problems during communications

java.io.IOException - If there are IO problems

MarshallingException - If there are marshalling errors

DeploymentException - If there are deployment related problems

Method Detail

main

public static void main(java.lang.String[] args)

prepareInstancesAndDeploy

public void prepareInstancesAndDeploy(int numOfMaps,
                                      java.lang.String filenameBase)
                               throws DatasetException,
                                      MapReduceException,
                                      CommunicationsException,
                                      DeploymentException,
                                      MarshallingException,
                                      java.lang.InterruptedException

Prepares a set of Map/Reduce instances for the WordCount example and deploys it on the set of available resources.

Parameters:

numOfMaps - The total number of maps being deployed

filenameBase - The directory in which the files are stored.

numOfFiles - The total number of files that need to be processed

Throws:

DatasetException - If there are problems initializing the datasets

MapReduceException - If there is a MapReduceExcecution because of problems when setting up the roles.

java.io.IOException - If there are IO problems.

CommunicationsException - If there are network problems during communications

DeploymentException - If there are deployment related problems

MarshallingException - If there are marshalling problems.

java.lang.InterruptedException - If there are problems sleeping