mapreduce:run-job-flow

Full name:

br.com.ingenieux:mapreduce-maven-plugin:1.2.0-SNAPSHOT:run-job-flow

Description:

Launches a new Job Flow

Attributes:

  • Requires a Maven project to be executed.

Required Parameters

Name Type Since Description
args String[] - Jar Arguments
mainClass String - Hadoop Main Class
User property is: mapreduce.mainClass.
path String - Path

Optional Parameters

Name Type Since Description
accessKey String - AWS Access Key
User property is: aws.accessKey.
ec2KeyName String - EC2 Key name
User property is: mapreduce.ec2KeyName.
hadoopVersion String - Hadoop Version
Default value is: 0.20.
User property is: mapreduce.hadoopVersion.
ignoreExceptions boolean - Ignore Exceptions?
Default value is: false.
User property is: beanstalker.ignoreExceptions.
instances Integer - Instance count
Default value is: 2.
User property is: mapreduce.instances.
jobName String - Job Name
Default value is: ${project.artifactId}.
User property is: mapreduce.jobName.
keepJobFlowAlive Boolean - Keep Job Flow Alive?
Default value is: false.
User property is: mapreduce.keepJobFlowAlive.
logUri String - Log URI (S3 Bucket Location. Starts with "s3://bucket/[path]")
User property is: mapreduce.logUri.
masterType String - Master Type
Default value is: m1.small.
User property is: mapreduce.masterType.
region String -

Service region e.g. "us-east-1"

Note: Does not apply to all services.

"-Cloudfront, I'm talking to you! Look at me when I do that!"

See this list for reference.


User property is: beanstalker.region.
secretKey String - AWS Secret Key
User property is: aws.secretKey.
serverId String - The server id in maven settings.xml to use for AWS Services Credentials (accessKey / secretKey)
Default value is: aws.amazon.com.
User property is: beanstalker.serverId.
slaveType String - Slave Type
Default value is: m1.small.
User property is: mapreduce.slaveType.
terminationProtected Boolean - Termination Protected?
Default value is: false.
User property is: mapreduce.terminationProtected.
verbose boolean - Verbose Logging?
Default value is: false.
User property is: beanstalker.verbose.

Parameter Details

accessKey:

AWS Access Key
  • Type: java.lang.String
  • Required: No
  • User Property: aws.accessKey

args:

Jar Arguments
  • Type: java.lang.String[]
  • Required: Yes

ec2KeyName:

EC2 Key name
  • Type: java.lang.String
  • Required: No
  • User Property: mapreduce.ec2KeyName

hadoopVersion:

Hadoop Version
  • Type: java.lang.String
  • Required: No
  • User Property: mapreduce.hadoopVersion
  • Default: 0.20

ignoreExceptions:

Ignore Exceptions?
  • Type: boolean
  • Required: No
  • User Property: beanstalker.ignoreExceptions
  • Default: false

instances:

Instance count
  • Type: java.lang.Integer
  • Required: No
  • User Property: mapreduce.instances
  • Default: 2

jobName:

Job Name
  • Type: java.lang.String
  • Required: No
  • User Property: mapreduce.jobName
  • Default: ${project.artifactId}

keepJobFlowAlive:

Keep Job Flow Alive?
  • Type: java.lang.Boolean
  • Required: No
  • User Property: mapreduce.keepJobFlowAlive
  • Default: false

logUri:

Log URI (S3 Bucket Location. Starts with "s3://bucket/[path]")
  • Type: java.lang.String
  • Required: No
  • User Property: mapreduce.logUri

mainClass:

Hadoop Main Class
  • Type: java.lang.String
  • Required: Yes
  • User Property: mapreduce.mainClass

masterType:

Master Type
  • Type: java.lang.String
  • Required: No
  • User Property: mapreduce.masterType
  • Default: m1.small

path:

Path
  • Type: java.lang.String
  • Required: Yes

region:

Service region e.g. "us-east-1"

Note: Does not apply to all services.

"-Cloudfront, I'm talking to you! Look at me when I do that!"

See this list for reference.

  • Type: java.lang.String
  • Required: No
  • User Property: beanstalker.region

secretKey:

AWS Secret Key
  • Type: java.lang.String
  • Required: No
  • User Property: aws.secretKey

serverId:

The server id in maven settings.xml to use for AWS Services Credentials (accessKey / secretKey)
  • Type: java.lang.String
  • Required: No
  • User Property: beanstalker.serverId
  • Default: aws.amazon.com

slaveType:

Slave Type
  • Type: java.lang.String
  • Required: No
  • User Property: mapreduce.slaveType
  • Default: m1.small

terminationProtected:

Termination Protected?
  • Type: java.lang.Boolean
  • Required: No
  • User Property: mapreduce.terminationProtected
  • Default: false

verbose:

Verbose Logging?
  • Type: boolean
  • Required: No
  • User Property: beanstalker.verbose
  • Default: false