|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.hive.ql.exec.Operator<T>
org.apache.hadoop.hive.ql.exec.TerminalOperator<ReduceSinkDesc>
org.apache.hadoop.hive.ql.exec.ReduceSinkOperator
public class ReduceSinkOperator
Reduce Sink Operator sends output to the reduce stage.
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator |
---|
Operator.OperatorFunc, Operator.ProgressCounter, Operator.State |
Field Summary | |
---|---|
protected ExprNodeEvaluator[] |
keyEval
The evaluators for the key columns. |
protected int |
numDistinctExprs
|
protected int |
numDistributionKeys
|
protected ExprNodeEvaluator[] |
partitionEval
The evaluators for the partition columns (CLUSTER BY or DISTRIBUTE BY in Hive language). |
protected ExprNodeEvaluator[] |
valueEval
The evaluators for the value columns. |
Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator |
---|
alias, beginTime, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, counterNames, counterNameToEnum, counters, done, fatalErrorCntr, groupKeyObject, id, inputObjInspectors, inputRows, isLogInfoEnabled, LOG, numInputRowsCntr, numOutputRowsCntr, operatorId, out, outputObjInspector, outputRows, parentOperators, reporter, state, statsMap, timeTakenCntr, totalTime |
Constructor Summary | |
---|---|
ReduceSinkOperator()
|
Method Summary | |
---|---|
protected void |
closeOp(boolean abort)
Operator specific close routine. |
void |
collect(BytesWritable key,
BytesWritable value)
|
String |
getInputAlias()
|
String |
getName()
Implements the getName function for the Node Interface. |
static String |
getOperatorName()
|
OperatorType |
getType()
Return the type of the specific operator among the types in OperatorType. |
protected static StructObjectInspector |
initEvaluatorsAndReturnStruct(ExprNodeEvaluator[] evals,
List<List<Integer>> distinctColIndices,
List<String> outputColNames,
int length,
ObjectInspector rowInspector)
Initializes array of ExprNodeEvaluator. |
protected void |
initializeOp(Configuration hconf)
Operator specific initialization. |
boolean |
opAllowedBeforeMapJoin()
|
void |
processOp(Object row,
int tag)
Process the row. |
void |
setInputAlias(String inputAlias)
|
Methods inherited from class java.lang.Object |
---|
equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Field Detail |
---|
protected transient ExprNodeEvaluator[] keyEval
protected transient ExprNodeEvaluator[] valueEval
protected transient ExprNodeEvaluator[] partitionEval
protected transient int numDistributionKeys
protected transient int numDistinctExprs
Constructor Detail |
---|
public ReduceSinkOperator()
Method Detail |
---|
public void setInputAlias(String inputAlias)
public String getInputAlias()
protected void initializeOp(Configuration hconf) throws HiveException
Operator
initializeOp
in class Operator<ReduceSinkDesc>
HiveException
protected static StructObjectInspector initEvaluatorsAndReturnStruct(ExprNodeEvaluator[] evals, List<List<Integer>> distinctColIndices, List<String> outputColNames, int length, ObjectInspector rowInspector) throws HiveException
Operator.initEvaluatorsAndReturnStruct(ExprNodeEvaluator[], List, ObjectInspector)
HiveException
public void processOp(Object row, int tag) throws HiveException
Operator
processOp
in class Operator<ReduceSinkDesc>
row
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.
HiveException
public void collect(BytesWritable key, BytesWritable value) throws IOException
IOException
protected void closeOp(boolean abort) throws HiveException
Operator
closeOp
in class Operator<ReduceSinkDesc>
HiveException
public String getName()
Operator
getName
in interface Node
getName
in class Operator<ReduceSinkDesc>
public static String getOperatorName()
public OperatorType getType()
Operator
getType
in class Operator<ReduceSinkDesc>
public boolean opAllowedBeforeMapJoin()
opAllowedBeforeMapJoin
in class Operator<ReduceSinkDesc>
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |