org.apache.hadoop.hive.ql.io.rcfile.stats
Class PartialScanTask
java.lang.Object
org.apache.hadoop.hive.ql.exec.Task<PartialScanWork>
org.apache.hadoop.hive.ql.io.rcfile.stats.PartialScanTask
- All Implemented Interfaces:
- Serializable, HadoopJobExecHook, Node
public class PartialScanTask
- extends Task<PartialScanWork>
- implements Serializable, HadoopJobExecHook
PartialScanTask.
This task handles RCFile statics calculation via partial scan.
Instead of reading all bytes, it reads block header and aggregates result.
https://issues.apache.org/jira/browse/HIVE-3958
- See Also:
- Serialized Form
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Task |
Task.FeedType |
Fields inherited from class org.apache.hadoop.hive.ql.exec.Task |
BACKUP_COMMON_JOIN, backupChildrenTasks, backupTask, childTasks, clonedConf, COMMON_JOIN, conf, console, CONVERTED_LOCAL_MAPJOIN, CONVERTED_MAPJOIN, CONVERTED_SORTMERGEJOIN, db, driverContext, feedSubscribers, id, initialized, isdone, jobID, LOCAL_MAPJOIN, LOG, MAPJOIN_ONLY_NOBACKUP, NO_TAG, parentTasks, queryPlan, queued, started, taskCounters, taskHandle, taskTag, work |
Methods inherited from class org.apache.hadoop.hive.ql.exec.Task |
addDependentTask, cloneConf, done, executeTask, fetch, getAndInitBackupTask, getBackupChildrenTasks, getBackupTask, getChildren, getChildTasks, getCounters, getDependentTasks, getFeedSubscribers, getId, getInitialized, getJobID, getParentTasks, getQueryPlan, getQueued, getReducer, getResultSchema, getTaskHandle, getTaskTag, getTopOperators, getWork, hasReduce, ifRetryCmdWhenFail, isLocalMode, isMapRedLocalTask, isMapRedTask, isRunnable, pushFeed, receiveFeed, removeDependentTask, removeFromChildrenTasks, setBackupChildrenTasks, setBackupTask, setChildTasks, setDone, setFeedSubscribers, setId, setInitialized, setLocalMode, setParentTasks, setQueryPlan, setQueued, setRetryCmdWhenFail, setStarted, setTaskTag, setWork, shutdown, started, subscribeFeed |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
job
protected transient JobConf job
jobExecHelper
protected HadoopJobExecHelper jobExecHelper
INPUT_SEPERATOR
public static String INPUT_SEPERATOR
PartialScanTask
public PartialScanTask()
initialize
public void initialize(HiveConf conf,
QueryPlan queryPlan,
DriverContext driverContext)
- Overrides:
initialize
in class Task<PartialScanWork>
requireLock
public boolean requireLock()
- Overrides:
requireLock
in class Task<PartialScanWork>
execute
public int execute(DriverContext driverContext)
- Description copied from class:
Task
- This method is overridden in each Task. TODO execute should return a TaskHandle.
- Specified by:
execute
in class Task<PartialScanWork>
- Returns:
- status of executing the task
getName
public String getName()
- Description copied from interface:
Node
- Gets the name of the node. This is used in the rule dispatchers.
- Specified by:
getName
in interface Node
- Returns:
- String
main
public static void main(String[] args)
getType
public StageType getType()
- Description copied from class:
Task
- Should be overridden to return the type of the specific task among the types in StageType.
- Specified by:
getType
in class Task<PartialScanWork>
- Returns:
- StageType.* or null if not overridden
checkFatalErrors
public boolean checkFatalErrors(Counters ctrs,
StringBuilder errMsg)
- Specified by:
checkFatalErrors
in interface HadoopJobExecHook
logPlanProgress
public void logPlanProgress(SessionState ss)
throws IOException
- Specified by:
logPlanProgress
in interface HadoopJobExecHook
- Throws:
IOException
updateCounters
public void updateCounters(Counters ctrs,
RunningJob rj)
throws IOException
- Specified by:
updateCounters
in interface HadoopJobExecHook
- Throws:
IOException
Copyright © 2012 The Apache Software Foundation