|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.pig.EvalFunc<T>
datafu.pig.util.SimpleEvalFunc<org.apache.pig.data.Tuple>
datafu.pig.stats.StreamingQuantile
datafu.pig.stats.StreamingMedian
public class StreamingMedian
Computes the approximate median for a (not necessarily sorted) input bag, using the Munro-Paterson algorithm. This is a convenience wrapper around StreamingQuantile.
N.B., all the data is pushed to a single reducer per key, so make sure some partitioning is done (e.g., group by 'day') if the data is too large. That is, this isn't distributed median.
StreamingQuantile
Field Summary |
---|
Fields inherited from class org.apache.pig.EvalFunc |
---|
log, pigLogger, reporter, returnType |
Constructor Summary | |
---|---|
StreamingMedian()
|
Method Summary |
---|
Methods inherited from class datafu.pig.stats.StreamingQuantile |
---|
accumulate, call, cleanup, getValue, outputSchema |
Methods inherited from class datafu.pig.util.SimpleEvalFunc |
---|
exec, getReturnType |
Methods inherited from class org.apache.pig.EvalFunc |
---|
finish, getArgToFuncMapping, getCacheFiles, getLogger, getPigLogger, getReporter, getSchemaName, isAsynchronous, progress, setPigLogger, setReporter, warn |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Constructor Detail |
---|
public StreamingMedian()
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |