org.apache.hadoop.hive.ql.io.rcfile.merge
Class BlockMergeTask
java.lang.Object
org.apache.hadoop.hive.ql.exec.Task<MergeWork>
org.apache.hadoop.hive.ql.io.rcfile.merge.BlockMergeTask
- All Implemented Interfaces:
- Serializable, HadoopJobExecHook, Node
public class BlockMergeTask
- extends Task<MergeWork>
- implements Serializable, HadoopJobExecHook
- See Also:
- Serialized Form
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task |
Task.FeedType |
Fields inherited from class org.apache.hadoop.hive.ql.exec.Task |
BACKUP_COMMON_JOIN, backupChildrenTasks, backupTask, childTasks, clonedConf, COMMON_JOIN, conf, console, CONVERTED_LOCAL_MAPJOIN, CONVERTED_MAPJOIN, db, driverContext, feedSubscribers, id, initialized, isdone, jobID, LOCAL_MAPJOIN, LOG, NO_TAG, parentTasks, queryPlan, queued, started, taskCounters, taskHandle, taskTag, work |
Methods inherited from class org.apache.hadoop.hive.ql.exec.Task |
addDependentTask, cloneConf, done, executeTask, fetch, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getFeedSubscribers, getId, getInitialized, getJobID, getParentTasks, getQueryPlan, getQueued, getReducer, getTaskTag, getTopOperators, getWork, hasReduce, ifRetryCmdWhenFail, isLocalMode, isMapRedLocalTask, isMapRedTask, isRunnable, localizeMRTmpFiles, pushFeed, receiveFeed, removeDependentTask, removeFromChildrenTasks, setBackupChildrenTasks, setBackupTask, setChildTasks, setDone, setFeedSubscribers, setId, setInitialized, setLocalMode, setParentTasks, setQueryPlan, setQueued, setRetryCmdWhenFail, setStarted, setTaskTag, setWork, started, subscribeFeed |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
job
protected transient org.apache.hadoop.mapred.JobConf job
jobExecHelper
protected HadoopJobExecHelper jobExecHelper
INPUT_SEPERATOR
public static String INPUT_SEPERATOR
BlockMergeTask
public BlockMergeTask()
initialize
public void initialize(HiveConf conf,
QueryPlan queryPlan,
DriverContext driverContext)
- Overrides:
initialize
in class Task<MergeWork>
requireLock
public boolean requireLock()
- Overrides:
requireLock
in class Task<MergeWork>
execute
public int execute(DriverContext driverContext)
- Description copied from class:
Task
- This method is overridden in each Task. TODO execute should return a TaskHandle.
- Specified by:
execute
in class Task<MergeWork>
- Returns:
- status of executing the task
getName
public String getName()
- Description copied from interface:
Node
- Gets the name of the node. This is used in the rule dispatchers.
- Specified by:
getName
in interface Node
- Returns:
- String
main
public static void main(String[] args)
getType
public StageType getType()
- Description copied from class:
Task
- Should be overridden to return the type of the specific task among the types in StageType.
- Specified by:
getType
in class Task<MergeWork>
- Returns:
- StageType.* or null if not overridden
checkFatalErrors
public boolean checkFatalErrors(org.apache.hadoop.mapred.Counters ctrs,
StringBuilder errMsg)
- Specified by:
checkFatalErrors
in interface HadoopJobExecHook
logPlanProgress
public void logPlanProgress(SessionState ss)
throws IOException
- Specified by:
logPlanProgress
in interface HadoopJobExecHook
- Throws:
IOException
updateCounters
public void updateCounters(org.apache.hadoop.mapred.Counters ctrs,
org.apache.hadoop.mapred.RunningJob rj)
throws IOException
- Specified by:
updateCounters
in interface HadoopJobExecHook
- Throws:
IOException
localizeMRTmpFilesImpl
protected void localizeMRTmpFilesImpl(Context ctx)
- Description copied from class:
Task
- If this task uses any map-reduce intermediate data (either for reading or for writing),
localize them (using the supplied Context). Map-Reduce intermediate directories are allocated
using Context.getMRTmpFileURI() and can be localized using localizeMRTmpFileURI().
This method is declared abstract to force any task code to explicitly deal with this aspect of
execution.
- Specified by:
localizeMRTmpFilesImpl
in class Task<MergeWork>
- Parameters:
ctx
- context object with which to localize
Copyright © 2011 The Apache Software Foundation