|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Math.abs(double)
for computing the
absolute value of the argument.Math.acos(double)
for computing the
arc cosine of value of the argument.StreamingCommand.HandleSpec
to a given StreamingCommand.Handle
SIZE
instead.Math.asin(double)
for computing the
arc sine of value of the argument.Math.atan(double)
for computing the
arc tangent of value of the argument.SIZE
.Pig.bind()
InputHandler
to the OutputStream
from which it reads input and sends it to the managed process.
OutputHandler
to the InputStream
from which to read the output data of the managed process.
Math.cbrt(double)
for computing the
cube root of the argument.Math.ceil(double)
.Object.equals(java.lang.Object)
The method checks whether the two arguments are both null or both not null and
whether they are of the same class
Object.equals(java.lang.Object)
checks if two objects are equals - two levels of checks are
made - first if both are null or not null.
StoreFunc.cleanupOnFailure(String, Job)
.
ExecutableManager
.
InputHandler
since there is no more input
to be sent to the managed process.
OutputHandler
.
LoadFunc
implementations indicates to
Pig that it has the capability to load data such that all instances of a key
will occur in same split.DataType.compare(Object, Object)
, but does not use reflection to determine the type
of passed in objects, relying instead on the caller to provide the appropriate values, as
determined by DataType.findType(Object)
.
ExecutableManager
.
SIZE
.Math.cos(double)
.Math.cosh(double)
.ExecutableManager
depending on the ExecType.
InputHandler
for the given input specification
of the StreamingCommand
.
OutputHandler
for the given output specification
of the StreamingCommand
.
stdin
.stdout
.TupleFactory
Pig
AVG
.MAX
.MIN
.SUM
.o
is a DoubleWritable with the same value.
ExecutableManager
manages an external executable which processes data
in a Pig query.ExecutableManager
.
FileLocalizer.fileExists(String, PigContext)
instead
AVG
.MAX
.MIN
.Math.round(float)
.SUM
.Math.floor(double)
.Pig
FileLocalizer.fullPath(String, PigContext)
instead
StreamingCommand
for this StreamSpec
.
StreamingCommand
for the given alias.
PigContext.getProperties()
instead
PigException
FuncSpec
that performs the casting functionality
Handle
.
StreamingCommand
.
InputType
POStore
HandleSpec
.
Tuple
of the managed process.
StreamingCommand
.
OutputType
.
PigStats
after the script is run.
PigRunner.ReturnCode
SpillableMemoryManager
.
HandleSpec
.
FileLocalizer.getTemporaryPath(PigContext)
instead
InputFormat
) which this class is wrapping.
HadoopExecutableManager
is a specialization of
ExecutableManager
and provides HDFS-specific support for secondary
outputs, task-logs etc.InputHandler
or OutputHandler
depending on the specification of the StreamingCommand
.InputHandler
is responsible for handling the input to the
Pig-Streaming external command.Math.abs(int)
for computing the
absolute value of the argument.AVG
.ScriptEngine
implementation for JavaScript
A = load 'mydata' as (name);
B = foreach A generate LASTINDEXOF(name, ",");
Math.log(double)
.Math.log10(double)
.AVG
.MAX
.MIN
.SUM
.SIZE
.FileLocalizer.open(String, PigContext)
instead
OutputHandler
is responsible for handling the output of the
Pig-Streaming external command.String
into a byte representing the
field delimiter.
PigException
class.PigRunner
.OperatorPlan
whose members are JobStats
PigToStream
and StreamToPig
interfaces.Tuple
to a byte
array.OutputStream
in the
field-delimited form.
Tuple
to the managed executable.
String RegexExtract(String expression, String regex, int match_index)
.
Input:
expression
-source string
.
regex
-regular expression
.
match_index
-index of the group to extract
.
Output:
extracted group, if fail, return null
.
String RegexExtractAll(String expression, String regex)
.
Input:
expression
-source string
.
regex
-regular expression
.
Output:
A tuple of matched strings
.
SpillableMemoryManager
.
Pig
Pig
Schema
LogicalSchema
Schema.FieldSchema
as the template.
LogicalSchema.LogicalFieldSchema
as the template.
Math.round(double)
.ExecutableManager
.
Pig
StreamingCommand
.
StreamingCommand
.
FuncSpec
that performs the casting functionality
StreamingCommand
.
HandleSpec
.
StreamingCommand
.
HandleSpec
.
StoreFunc
which it can use to store
information in the UDFContext
which it needs to store between
various method invocations in the front end and back end.
StoreFuncInterface
which it can use to store
information in the UDFContext
which it needs to store between
various method invocations in the front end and back end.
LoadFunc
.
Math.sin(double)
.Math.sinh(double)
.UDFContext
instead in the following way to get
the job's Configuration
:
UdfContext.getUdfContext().getJobConf()
UDFContext
instead in the following way to get
the job's Configuration
:
UdfContext.getUdfContext().getJobConf()
SortInfo
Math.sqrt(double)
.PigStorage
and streaming class PigStreaming
StreamingCommand
represents the specification of an external
command to be executed in a Pig Query.StreamingCommand
with the given command.
StreamingCommand.Handle
to communicate
with the external process.StreamingCommand.HandleSpec
with a given name using the default
PigStorage
serializer/deserializer.
StreamingCommand.HandleSpec
with a given name using the default
PigStorage
serializer/deserializer.
Tuple
.CONCAT
.MAX
.MIN
.SIZE
.Math.tan(double)
.Math.tanh(double)
.Text
to a Tuple
InterRecordWriter
It
uses the default InterSedes object for deserialization.InterRecordWriter
It uses the default InterSedes object for serialization.SIZE
.DataType
.
PigStats.JobGraph
of the PigStats
.
RegexExpression
expects CharArray as input
Itself always returns Boolean
IOException
did not have a constructor which took a
Throwable
argument. Since Pig code is now compiled with Java 1.6 and
EvalFunc
and LoadFunc
user implementations should also use
Java 1.6, they can use IOException
instead. From Java 1.6,
IOException
has constructors which take a Throwable
argument.
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |