org.apache.hadoop.hive.ql.io
Class CombineHiveInputFormat<K extends WritableComparable,V extends Writable>
java.lang.Object
org.apache.hadoop.hive.ql.io.HiveInputFormat<K,V>
org.apache.hadoop.hive.ql.io.CombineHiveInputFormat<K,V>
public class CombineHiveInputFormat<K extends WritableComparable,V extends Writable>
- extends HiveInputFormat<K,V>
CombineHiveInputFormat is a parameterized InputFormat which looks at the path
name and determine the correct InputFormat for that path name from
mapredPlan.pathToPartitionInfo(). It can be used to read files with different
input format in the same map-reduce job.
Field Summary |
static org.apache.commons.logging.Log |
LOG
|
Method Summary |
RecordReader |
getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
Create a generic Hive RecordReader than can iterate over all chunks in a
CombinedFileSplit. |
InputSplit[] |
getSplits(JobConf job,
int numSplits)
Create Hive splits based on CombineFileSplit. |
Methods inherited from class java.lang.Object |
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
LOG
public static final org.apache.commons.logging.Log LOG
CombineHiveInputFormat
public CombineHiveInputFormat()
getSplits
public InputSplit[] getSplits(JobConf job,
int numSplits)
throws IOException
- Create Hive splits based on CombineFileSplit.
- Overrides:
getSplits
in class HiveInputFormat<K extends WritableComparable,V extends Writable>
- Throws:
IOException
getRecordReader
public RecordReader getRecordReader(InputSplit split,
JobConf job,
Reporter reporter)
throws IOException
- Create a generic Hive RecordReader than can iterate over all chunks in a
CombinedFileSplit.
- Overrides:
getRecordReader
in class HiveInputFormat<K extends WritableComparable,V extends Writable>
- Throws:
IOException
Copyright © 2012 The Apache Software Foundation