org.apache.oozie.command.coord
Class CoordSubmitCommand

java.lang.Object
  org.apache.oozie.command.Command<T,CoordinatorStore>
      org.apache.oozie.command.coord.CoordinatorCommand<java.lang.String>
          org.apache.oozie.command.coord.CoordSubmitCommand

All Implemented Interfaces:

java.util.concurrent.Callable<java.lang.String>, XCallable<java.lang.String>

public class CoordSubmitCommand
extends CoordinatorCommand<java.lang.String>

This class provides the functionalities to resolve a coordinator job XML and write the job information into a DB table.

Specifically it performs the following functions: 1. Resolve all the variables or properties using job configurations. 2. Insert all datasets definition as part of the and tags. 3. Validate the XML at runtime.

Field Summary

static java.lang.String	CONF_DEFAULT_TIMEOUT_NORMAL Default timeout for normal jobs, in minutes, after which coordinator input check will timeout
static java.lang.String	CONFIG_DEFAULT
static java.lang.String	COORDINATOR_XML_FILE

Fields inherited from class org.apache.oozie.command.Command

instrumentation, LOCK_FAILURE_REQUEUE_INTERVAL, type

Constructor Summary

CoordSubmitCommand(boolean dryrun, org.apache.hadoop.conf.Configuration conf, java.lang.String authToken)

CoordSubmitCommand(org.apache.hadoop.conf.Configuration conf, java.lang.String authToken)
Constructor to create the Coordinator Submit Command.

Method Summary

org.jdom.Element	basicResolveAndIncludeDS(java.lang.String appXml, org.apache.hadoop.conf.Configuration conf, CoordinatorJobBean coordJob) The method resolve all the variables that are defined in configuration.
protected java.lang.String	call(CoordinatorStore store) DagCallable subclasses must implement this method to perform their task.
protected void	includeDataSets(org.jdom.Element resolvedXml, org.apache.hadoop.conf.Configuration conf) Include referred Datasets into XML.
protected void	initEvaluators() Initialize all the required EL Evaluators.
static void	main(java.lang.String[] args) For unit-testing only.
protected void	mergeDefaultConfig() Merge default configuration with user-defined configuration.
protected java.lang.String	readDefinition(java.lang.String appPath, java.lang.String fileName) Read workflow definition.
protected org.jdom.Element	resolveInitial(org.apache.hadoop.conf.Configuration conf, java.lang.String appXml, CoordinatorJobBean coordJob) Resolve basic entities using job Configuration.

Methods inherited from class org.apache.oozie.command.coord.CoordinatorCommand

getStoreClass

Methods inherited from class org.apache.oozie.command.Command

call, execute, getCreatedTime, getInstrumentation, getName, getPriority, getType, incrCommandCounter, incrJobCounter, incrJobCounter, lock, logQueueCallableFalse, queueCallable, queueCallable, queueCallable, queueCallableForException, resetLogInfoAction, resetLogInfoWorkflow, setLogInfo, setLogInfo, setLogInfo, setLogInfo, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Field Detail

CONFIG_DEFAULT

public static final java.lang.String CONFIG_DEFAULT

See Also:

Constant Field Values

COORDINATOR_XML_FILE

public static final java.lang.String COORDINATOR_XML_FILE

See Also:

Constant Field Values

CONF_DEFAULT_TIMEOUT_NORMAL

public static final java.lang.String CONF_DEFAULT_TIMEOUT_NORMAL

Default timeout for normal jobs, in minutes, after which coordinator input check will timeout

See Also:

Constant Field Values

Constructor Detail

CoordSubmitCommand

public CoordSubmitCommand(org.apache.hadoop.conf.Configuration conf,
                          java.lang.String authToken)

Constructor to create the Coordinator Submit Command.

Parameters:

conf - : Configuration for Coordinator job

authToken - : To be used for authentication

CoordSubmitCommand

public CoordSubmitCommand(boolean dryrun,
                          org.apache.hadoop.conf.Configuration conf,
                          java.lang.String authToken)

Method Detail

call

protected java.lang.String call(CoordinatorStore store)
                         throws StoreException,
                                CommandException

Description copied from class: Command

DagCallable subclasses must implement this method to perform their task.

The workflow store works in transactional mode. The transaction is committed only if this method ends successfully. Otherwise the transaction is rolledback.

Specified by:

call in class Command<java.lang.String,CoordinatorStore>

Parameters:

store - the workflow store instance for the callable, null if the callable does not use a store.

Returns:

the return value of the callable.

Throws:

StoreException - thrown if the workflow store could not perform an operation.

CommandException - thrown if the command could not perform its operation.

mergeDefaultConfig

protected void mergeDefaultConfig()
                           throws CommandException

Merge default configuration with user-defined configuration.

Throws:

CommandException

basicResolveAndIncludeDS

public org.jdom.Element basicResolveAndIncludeDS(java.lang.String appXml,
                                                 org.apache.hadoop.conf.Configuration conf,
                                                 CoordinatorJobBean coordJob)
                                          throws CoordinatorJobException,
                                                 java.lang.Exception

The method resolve all the variables that are defined in configuration. It also include the data set definition from dataset file into XML.

Parameters:

appXml - : Original job XML

conf - : Configuration of the job

coordJob - : Coordinator job bean to be populated.

Returns:

: Resolved and modified job XML element.

Throws:

java.lang.Exception

CoordinatorJobException

initEvaluators

protected void initEvaluators()

Initialize all the required EL Evaluators.

resolveInitial

protected org.jdom.Element resolveInitial(org.apache.hadoop.conf.Configuration conf,
                                          java.lang.String appXml,
                                          CoordinatorJobBean coordJob)
                                   throws CoordinatorJobException,
                                          java.lang.Exception

Resolve basic entities using job Configuration.

Parameters:

conf - :Job configuration

appXml - : Original job XML

coordJob - : Coordinator job bean to be populated.

Returns:

Resolved job XML element.

Throws:

java.lang.Exception

CoordinatorJobException

includeDataSets

protected void includeDataSets(org.jdom.Element resolvedXml,
                               org.apache.hadoop.conf.Configuration conf)
                        throws CoordinatorJobException

Include referred Datasets into XML.

Parameters:

resolvedXml - : Job XML element.

conf - : Job configuration

Throws:

CoordinatorJobException

readDefinition

protected java.lang.String readDefinition(java.lang.String appPath,
                                          java.lang.String fileName)
                                   throws CoordinatorJobException

Read workflow definition.

Parameters:

appPath - application path.

user - user name.

group - group name.

autToken - authentication token.

Returns:

workflow definition.

Throws:

WorkflowException - thrown if the definition could not be read.

CoordinatorJobException

main

public static void main(java.lang.String[] args)
                 throws java.lang.Exception

For unit-testing only. Will ultimately go away

Parameters:

args -

Throws:

java.lang.Exception

org.jdom.JDOMException