|
||||||||||
PREV NEXT | FRAMES NO FRAMES |
Packages that use MapWork | |
---|---|
org.apache.hadoop.hive.ql.exec | Hive QL execution tasks, operators, functions and other handlers. |
org.apache.hadoop.hive.ql.io.rcfile.merge | |
org.apache.hadoop.hive.ql.io.rcfile.stats | |
org.apache.hadoop.hive.ql.io.rcfile.truncate | |
org.apache.hadoop.hive.ql.optimizer | |
org.apache.hadoop.hive.ql.optimizer.physical | |
org.apache.hadoop.hive.ql.plan |
Uses of MapWork in org.apache.hadoop.hive.ql.exec |
---|
Methods in org.apache.hadoop.hive.ql.exec that return MapWork | |
---|---|
static MapWork |
Utilities.getMapWork(Configuration conf)
|
Methods in org.apache.hadoop.hive.ql.exec with parameters of type MapWork | |
---|---|
static void |
Utilities.createTmpDirs(Configuration conf,
MapWork mWork)
Hive uses tmp directories to capture the output of each FileSinkOperator. |
static int |
Utilities.estimateNumberOfReducers(HiveConf conf,
ContentSummary inputSummary,
MapWork work,
boolean finalMapRed)
Estimate the number of reducers needed for this job, based on job input, and configuration parameters. |
static double |
Utilities.getHighestSamplePercentage(MapWork work)
Returns the highest sample percentage of any alias in the given MapWork |
static List<Path> |
Utilities.getInputPaths(JobConf job,
MapWork work,
String hiveScratchDir,
Context ctx)
Computes a list of all input paths needed to compute the given MapWork. |
static ContentSummary |
Utilities.getInputSummary(Context ctx,
MapWork work,
PathFilter filter)
Calculate the total size of input files. |
static long |
Utilities.getTotalInputFileSize(ContentSummary inputSummary,
MapWork work,
double highestSamplePercentage)
Computes the total input file size. |
static long |
Utilities.getTotalInputNumFiles(ContentSummary inputSummary,
MapWork work,
double highestSamplePercentage)
Computes the total number of input files. |
void |
MapOperator.initializeAsRoot(Configuration hconf,
MapWork mapWork)
Initializes this map op as the root of the tree. |
static void |
Utilities.setInputAttributes(Configuration conf,
MapWork mWork)
Set hive input format, and input format file if necessary. |
static Path |
Utilities.setMapWork(Configuration conf,
MapWork w,
String hiveScratchDir,
boolean useCache)
|
Uses of MapWork in org.apache.hadoop.hive.ql.io.rcfile.merge |
---|
Subclasses of MapWork in org.apache.hadoop.hive.ql.io.rcfile.merge | |
---|---|
class |
MergeWork
|
Uses of MapWork in org.apache.hadoop.hive.ql.io.rcfile.stats |
---|
Subclasses of MapWork in org.apache.hadoop.hive.ql.io.rcfile.stats | |
---|---|
class |
PartialScanWork
Partial Scan Work. |
Uses of MapWork in org.apache.hadoop.hive.ql.io.rcfile.truncate |
---|
Subclasses of MapWork in org.apache.hadoop.hive.ql.io.rcfile.truncate | |
---|---|
class |
ColumnTruncateWork
|
Uses of MapWork in org.apache.hadoop.hive.ql.optimizer |
---|
Methods in org.apache.hadoop.hive.ql.optimizer with parameters of type MapWork | |
---|---|
static void |
GenMapRedUtils.replaceMapWork(String sourceAlias,
String targetAlias,
MapWork source,
MapWork target)
Replace the Map-side operator tree associated with targetAlias in target with the Map-side operator tree associated with sourceAlias in source. |
static void |
GenMapRedUtils.setTaskPlan(String path,
String alias,
Operator<? extends OperatorDesc> topOp,
MapWork plan,
boolean local,
TableDesc tt_desc)
set the current task in the mapredWork. |
Uses of MapWork in org.apache.hadoop.hive.ql.optimizer.physical |
---|
Methods in org.apache.hadoop.hive.ql.optimizer.physical with parameters of type MapWork | |
---|---|
long |
AbstractJoinTaskDispatcher.getTotalKnownInputSize(Context context,
MapWork currWork,
Map<String,ArrayList<String>> pathToAliases,
HashMap<String,Long> aliasToSize)
|
Uses of MapWork in org.apache.hadoop.hive.ql.plan |
---|
Methods in org.apache.hadoop.hive.ql.plan that return MapWork | |
---|---|
MapWork |
MapredWork.getMapWork()
|
Methods in org.apache.hadoop.hive.ql.plan with parameters of type MapWork | |
---|---|
void |
MapWork.mergingInto(MapWork mapWork)
|
void |
MapredWork.setMapWork(MapWork mapWork)
|
|
||||||||||
PREV NEXT | FRAMES NO FRAMES |