|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.hive.ql.exec.Operator<PTFDesc>
org.apache.hadoop.hive.ql.exec.PTFOperator
public class PTFOperator
Nested Class Summary |
---|
Nested classes/interfaces inherited from class org.apache.hadoop.hive.ql.exec.Operator |
---|
Operator.OperatorFunc, Operator.ProgressCounter, Operator.State |
Field Summary | |
---|---|
protected KeyWrapper |
currentKeys
|
protected KeyWrapper |
newKeys
|
Fields inherited from class org.apache.hadoop.hive.ql.exec.Operator |
---|
alias, beginTime, childOperators, childOperatorsArray, childOperatorsTag, colExprMap, conf, counterNames, counterNameToEnum, counters, done, fatalErrorCntr, groupKeyObject, id, inputObjInspectors, inputRows, isLogInfoEnabled, LOG, numInputRowsCntr, numOutputRowsCntr, operatorId, out, outputObjInspector, outputRows, parentOperators, reporter, state, statsMap, timeTakenCntr, totalTime |
Constructor Summary | |
---|---|
PTFOperator()
|
Method Summary | |
---|---|
protected void |
closeOp(boolean abort)
Operator specific close routine. |
static void |
connectLeadLagFunctionsToPartition(PTFDesc ptfDesc,
PTFPartition.PTFPartitionIterator<Object> pItr)
|
PTFPartition |
createFirstPartitionForChain(ObjectInspector oi,
HiveConf hiveConf,
boolean isMapSide)
Create a new Partition. |
String |
getName()
Implements the getName function for the Node Interface. |
static String |
getOperatorName()
|
OperatorType |
getType()
Return the type of the specific operator among the types in OperatorType. |
protected void |
initializeOp(Configuration jobConf)
Operator specific initialization. |
protected void |
processInputPartition()
|
protected void |
processMapFunction()
|
void |
processOp(Object row,
int tag)
Process the row. |
protected void |
reconstructQueryDef(HiveConf hiveConf)
Initialize the visitor to use the QueryDefDeserializer Use the order defined in QueryDefWalker to visit the QueryDef |
protected void |
setupKeysWrapper(ObjectInspector inputOI)
|
Methods inherited from class java.lang.Object |
---|
equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Field Detail |
---|
protected transient KeyWrapper currentKeys
protected transient KeyWrapper newKeys
Constructor Detail |
---|
public PTFOperator()
Method Detail |
---|
protected void initializeOp(Configuration jobConf) throws HiveException
Operator
initializeOp
in class Operator<PTFDesc>
HiveException
protected void closeOp(boolean abort) throws HiveException
Operator
closeOp
in class Operator<PTFDesc>
HiveException
public void processOp(Object row, int tag) throws HiveException
Operator
processOp
in class Operator<PTFDesc>
row
- The object representing the row.tag
- The tag of the row usually means which parent this row comes from.
Rows with the same tag should have exactly the same rowInspector
all the time.
HiveException
protected void reconstructQueryDef(HiveConf hiveConf) throws HiveException
hiveConf
-
HiveException
protected void setupKeysWrapper(ObjectInspector inputOI) throws HiveException
HiveException
protected void processInputPartition() throws HiveException
HiveException
protected void processMapFunction() throws HiveException
HiveException
public String getName()
Operator
getName
in interface Node
getName
in class Operator<PTFDesc>
public static String getOperatorName()
public OperatorType getType()
Operator
getType
in class Operator<PTFDesc>
public PTFPartition createFirstPartitionForChain(ObjectInspector oi, HiveConf hiveConf, boolean isMapSide) throws HiveException
The Partition we want to create here is for feeding the First table function in the chain. So for map-side processing use the Serde from the output Shape its InputDef. For reduce-side processing use the Serde from its RawInputShape(the shape after map-side processing).
oi
- hiveConf
- isMapSide
-
HiveException
public static void connectLeadLagFunctionsToPartition(PTFDesc ptfDesc, PTFPartition.PTFPartitionIterator<Object> pItr) throws HiveException
HiveException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |