|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use Operator | |
---|---|
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer | Implementation of physical operators that use hadoop as the execution engine and data storage. |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans | |
org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
org.apache.pig.impl.logicalLayer | The logical operators that represent a pig script and tools for manipulating those operators. |
org.apache.pig.impl.plan | |
org.apache.pig.impl.plan.optimizer | |
org.apache.pig.pen.physicalOperators | |
org.apache.pig.pen.util |
Uses of Operator in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer |
---|
Subclasses of Operator in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer | |
---|---|
class |
MapReduceOper
An operator model for a Map Reduce job. |
class |
NativeMapReduceOper
|
Uses of Operator in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans |
---|
Subclasses of Operator in org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.plans | |
---|---|
static class |
DotMRPrinter.InnerOperator
Helper class to represent the relationship of map, reduce and combine phases in an MR operator. |
Uses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer |
---|
Subclasses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer | |
---|---|
class |
PhysicalOperator
This is the base class for all operators. |
Uses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators |
---|
Subclasses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer.expressionOperators | |
---|---|
class |
Add
|
class |
BinaryComparisonOperator
This is a base class for all binary comparison operators. |
class |
ConstantExpression
This class implements a Constant of any type. |
class |
Divide
|
class |
EqualToExpr
|
class |
GreaterThanExpr
|
class |
GTOrEqualToExpr
|
class |
LessThanExpr
|
class |
LTOrEqualToExpr
|
class |
Mod
|
class |
Multiply
|
class |
NotEqualToExpr
|
class |
POAnd
Boolean and operator. |
class |
POBinCond
|
class |
POCast
This is just a cast that converts DataByteArray into either String or Integer. |
class |
POIsNull
|
class |
POMapLookUp
|
class |
PONegative
|
class |
PONot
Boolean not operator. |
class |
POOr
Boolean or operator. |
class |
POProject
Implements the overloaded form of the project operator. |
class |
PORegexp
|
class |
PORelationToExprProject
Implements a specialized form of POProject which is used *ONLY* in the following case: This project is Project(*) introduced after a relational operator to supply a bag as output (as an expression). |
class |
POUserComparisonFunc
|
class |
POUserFunc
|
class |
Subtract
|
class |
UnaryComparisonOperator
This is a base class for all unary comparison operators. |
Uses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans |
---|
Classes in org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans with type parameters of type Operator | |
---|---|
class |
PlanPrinter<O extends Operator,P extends OperatorPlan<O>>
|
Constructor parameters in org.apache.pig.backend.hadoop.executionengine.physicalLayer.plans with type arguments of type Operator | |
---|---|
DotPOPrinter(PhysicalPlan plan,
PrintStream ps,
boolean isSubGraph,
Set<Operator> subgraphs,
Set<Operator> multiInputSubgraphs,
Set<Operator> multiOutputSubgraphs)
|
|
DotPOPrinter(PhysicalPlan plan,
PrintStream ps,
boolean isSubGraph,
Set<Operator> subgraphs,
Set<Operator> multiInputSubgraphs,
Set<Operator> multiOutputSubgraphs)
|
|
DotPOPrinter(PhysicalPlan plan,
PrintStream ps,
boolean isSubGraph,
Set<Operator> subgraphs,
Set<Operator> multiInputSubgraphs,
Set<Operator> multiOutputSubgraphs)
|
Uses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators |
---|
Subclasses of Operator in org.apache.pig.backend.hadoop.executionengine.physicalLayer.relationalOperators | |
---|---|
class |
POCollectedGroup
The collected group operator is a special operator used when users give the hint 'using "collected"' in a group by clause. |
class |
POCombinerPackage
The package operator that packages the globally rearranged tuples into output format after the combiner stage. |
class |
PODemux
The MapReduce Demultiplexer operator. |
class |
PODistinct
Find the distinct set of tuples in a bag. |
class |
POFilter
This is an implementation of the Filter operator. |
class |
POForEach
|
class |
POFRJoin
The operator models the join keys using the Local Rearrange operators which are configured with the plan specified by the user. |
class |
POGlobalRearrange
Dummy operator to test MRCompiler. |
class |
POJoinPackage
|
class |
POLimit
|
class |
POLoad
The load operator which is used in two ways: 1) As a local operator it can be used to load files 2) In the Map Reduce setting, it is used to create jobs from MapReduce operators which keep the loads and stores in the Map and Reduce Plans till the job is created |
class |
POLocalRearrange
The local rearrange operator is a part of the co-group implementation. |
class |
POLocalRearrangeForIllustrate
The local rearrange operator is a part of the co-group implementation. |
class |
POMergeCogroup
|
class |
POMergeJoin
This operator implements merge join algorithm to do map side joins. |
class |
POMultiQueryPackage
The package operator that packages the globally rearranged tuples into output format as required by multi-query de-multiplexer. |
class |
PONative
|
class |
POOptimizedForEach
A specialized version of POForeach with the difference that in getNext(), it knows that "input" has already been attached by its input operator which SHOULD be POJoinPackage |
class |
POPackage
The package operator that packages the globally rearranged tuples into output format as required by co-group. |
class |
POPackageLite
This package operator is a specialization of POPackage operator used for the specific case of the order by query. |
class |
POPartitionRearrange
The partition rearrange operator is a part of the skewed join implementation. |
class |
POPreCombinerLocalRearrange
A specialized local rearrange operator which behaves like the regular local rearrange in the getNext() as far as getting its input and constructing the "key" out of the input. |
class |
PORead
This operator is used to read tuples from a databag in memory. |
class |
POSkewedJoin
The PhysicalOperator that represents a skewed join. |
class |
POSort
This implementation is applicable for both the physical plan and for the local backend, as the conversion of physical to mapreduce would see the SORT operator and take necessary steps to convert it to a quantile and a sort job. |
class |
POSortedDistinct
This operator is a variation of PODistinct, the input to this operator must be sorted already. |
class |
POSplit
The MapReduce Split operator. |
class |
POStore
The store operator which is used in two ways: 1) As a local operator it can be used to store files 2) In the Map Reduce setting, it is used to create jobs from MapReduce operators which keep the loads and stores in the Map and Reduce Plans till the job is created |
class |
POStream
|
class |
POUnion
The union operator that combines the two inputs into a single stream. |
Uses of Operator in org.apache.pig.impl.logicalLayer |
---|
Subclasses of Operator in org.apache.pig.impl.logicalLayer | |
---|---|
class |
BinaryExpressionOperator
This abstract class represents the logical Binary Expression Operator The binary operator has two operands and an operator. |
class |
ExpressionOperator
|
class |
LOAdd
|
class |
LOAnd
|
class |
LOBinCond
|
class |
LOCast
|
class |
LOCogroup
|
class |
LOConst
|
class |
LOCross
|
class |
LODefine
|
class |
LODistinct
|
class |
LODivide
|
class |
LOEqual
|
class |
LOFilter
|
class |
LOForEach
|
class |
LOGenerate
|
class |
LogicalOperator
Parent for all Logical operators. |
class |
LOGreaterThan
|
class |
LOGreaterThanEqual
|
class |
LOIsNull
|
class |
LOJoin
|
class |
LOLesserThan
|
class |
LOLesserThanEqual
|
class |
LOLimit
|
class |
LOLoad
|
class |
LOMapLookup
|
class |
LOMod
|
class |
LOMultiply
|
class |
LONative
|
class |
LONegative
|
class |
LONot
|
class |
LONotEqual
|
class |
LOOr
|
class |
LOProject
LOProject is designed like a singly linked list; A few examples will illustrate the point about the linked list nature of the design; a = load 'input1' as (name, age); b = group a by name; foreach b generate a, a.name; The project operator occurs in two places in the above script: generate a(here) and a.name(here) In the first occurrence, we are trying to project the elements of the bag a; In order to retrieve the bag, we need to project the the second column ($1) or column number 1 (using the zero based index) from the input (the relation or bag b) In the second occurence, we are trying to project the first column ($0) or column number 0 from the bag a which in turn is the column number 1 in the relation b; As you can see, the nested structure or the singly linked list nature is clearly visible; Given that it's a singly linked list, the null pointer or the sentinel is marked explictly using the boolean variable mSentinel; The sentinel is marked true only when the input is a relational operator; This occurs when we create the innermost operator |
class |
LORegexp
|
class |
LOSort
|
class |
LOSplit
|
class |
LOSplitOutput
|
class |
LOStore
|
class |
LOStream
LOStream represents the specification of an external
command to be executed in a Pig Query. |
class |
LOSubtract
|
class |
LOUnion
|
class |
LOUserFunc
|
class |
RelationalOperator
|
class |
UnaryExpressionOperator
This abstract class represents the logical Unary Expression Operator The unary operator has an operand and an operator. |
Methods in org.apache.pig.impl.logicalLayer with parameters of type Operator | |
---|---|
void |
LOSplitOutput.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOSplitOutput.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOSplit.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOSplit.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOSort.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOSort.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOForEach.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOForEach.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOFilter.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOFilter.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOCogroup.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOCogroup.rewire(Operator<LOVisitor> oldPred,
int oldPredIndex,
Operator<LOVisitor> newPred,
boolean useOldPred)
|
void |
LOJoin.rewire(Operator oldPred,
int oldPredIndex,
Operator newPred,
boolean useOldPred)
|
void |
LOJoin.rewire(Operator oldPred,
int oldPredIndex,
Operator newPred,
boolean useOldPred)
|
Uses of Operator in org.apache.pig.impl.plan |
---|
Classes in org.apache.pig.impl.plan with type parameters of type Operator | |
---|---|
class |
DependencyOrderWalker<O extends Operator,P extends OperatorPlan<O>>
DependencyOrderWalker traverses the graph in such a way that no node is visited before all the nodes it depends on have been visited. |
class |
DependencyOrderWalkerWOSeenChk<O extends Operator,P extends OperatorPlan<O>>
DependencyOrderWalker traverses the graph in such a way that no node is visited before all the nodes it depends on have been visited. |
class |
DepthFirstWalker<O extends Operator,P extends OperatorPlan<O>>
DepthFirstWalker traverses a plan in a depth first manner. |
class |
DotPlanDumper<E extends Operator,P extends OperatorPlan<E>,N extends Operator,S extends OperatorPlan<N>>
This class puts everything that is needed to dump a plan in a format readable by graphviz's dot algorithm. |
class |
DotPlanDumper<E extends Operator,P extends OperatorPlan<E>,N extends Operator,S extends OperatorPlan<N>>
This class puts everything that is needed to dump a plan in a format readable by graphviz's dot algorithm. |
class |
OperatorPlan<E extends Operator>
A generic graphing class for use by LogicalPlan, PhysicalPlan, etc. |
class |
PlanDumper<E extends Operator,P extends OperatorPlan<E>,S extends OperatorPlan<? extends Operator>>
This class dumps a nested plan to a print stream. |
class |
PlanDumper<E extends Operator,P extends OperatorPlan<E>,S extends OperatorPlan<? extends Operator>>
This class dumps a nested plan to a print stream. |
class |
PlanPrinter<O extends Operator,P extends OperatorPlan<O>>
A visitor mechanism printing out the logical plan. |
class |
PlanValidator<O extends Operator,P extends OperatorPlan<O>>
Master of all plan validation classes. |
class |
PlanVisitor<O extends Operator,P extends OperatorPlan<O>>
A visitor mechanism for navigating and operating on a plan of Operators. |
class |
PlanWalker<O extends Operator,P extends OperatorPlan<O>>
PlanWalker encapsulates the logic to traverse a plan. |
class |
ReverseDependencyOrderWalker<O extends Operator,P extends OperatorPlan<O>>
ReverseDependencyOrderWalker traverses the graph in such a way that no node is visited before all the nodes that are its successors on have been visited. |
Fields in org.apache.pig.impl.plan with type parameters of type Operator | |
---|---|
protected Set<Operator> |
DotPlanDumper.mMultiInputSubgraphs
|
protected Set<Operator> |
DotPlanDumper.mMultiOutputSubgraphs
|
protected Set<Operator> |
DotPlanDumper.mSubgraphs
|
Methods in org.apache.pig.impl.plan with parameters of type Operator | |
---|---|
int |
Operator.compareTo(Operator o)
|
protected void |
PlanDumper.dumpEdge(Operator op,
Operator suc)
Will be called to dump the edges of the plan. |
protected void |
PlanDumper.dumpEdge(Operator op,
Operator suc)
Will be called to dump the edges of the plan. |
protected void |
DotPlanDumper.dumpEdge(Operator op,
Operator suc)
|
protected void |
DotPlanDumper.dumpEdge(Operator op,
Operator suc)
|
void |
Operator.rewire(Operator<V> oldPred,
int oldPredIndex,
Operator<V> newPred,
boolean useOldPred)
Make any necessary changes to a node based on a change of position in the plan. |
void |
Operator.rewire(Operator<V> oldPred,
int oldPredIndex,
Operator<V> newPred,
boolean useOldPred)
Make any necessary changes to a node based on a change of position in the plan. |
Constructor parameters in org.apache.pig.impl.plan with type arguments of type Operator | |
---|---|
DotPlanDumper(P plan,
PrintStream ps,
boolean isSubGraph,
Set<Operator> mSubgraphs,
Set<Operator> mMultiInputSubgraphs,
Set<Operator> mMultiOutputSubgraphs)
|
|
DotPlanDumper(P plan,
PrintStream ps,
boolean isSubGraph,
Set<Operator> mSubgraphs,
Set<Operator> mMultiInputSubgraphs,
Set<Operator> mMultiOutputSubgraphs)
|
|
DotPlanDumper(P plan,
PrintStream ps,
boolean isSubGraph,
Set<Operator> mSubgraphs,
Set<Operator> mMultiInputSubgraphs,
Set<Operator> mMultiOutputSubgraphs)
|
Uses of Operator in org.apache.pig.impl.plan.optimizer |
---|
Classes in org.apache.pig.impl.plan.optimizer with type parameters of type Operator | |
---|---|
class |
PlanOptimizer<O extends Operator,P extends OperatorPlan<O>>
A class to optimize plans. |
class |
Rule<O extends Operator,P extends OperatorPlan<O>>
A rule for optimizing a plan. |
class |
RuleMatcher<O extends Operator,P extends OperatorPlan<O>>
RuleMatcher contains the logic to determine whether a given rule matches. |
class |
Transformer<O extends Operator,P extends OperatorPlan<O>>
Transformer represents one tranform that the optimizer can apply to a graph. |
Subclasses of Operator in org.apache.pig.impl.plan.optimizer | |
---|---|
class |
RuleOperator
Parent for all Logical operators. |
Uses of Operator in org.apache.pig.pen.physicalOperators |
---|
Subclasses of Operator in org.apache.pig.pen.physicalOperators | |
---|---|
class |
POCogroup
This is a local implementation of Cogroup. |
class |
POCounter
|
class |
POCross
This is a local implementation of the cross. |
class |
POSplitOutput
|
class |
POStreamLocal
|
Uses of Operator in org.apache.pig.pen.util |
---|
Classes in org.apache.pig.pen.util with type parameters of type Operator | |
---|---|
class |
DependencyOrderLimitedWalker<O extends Operator,P extends OperatorPlan<O>>
|
class |
PreOrderDepthFirstWalker<O extends Operator,P extends OperatorPlan<O>>
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |