org.apache.hadoop.hive.ql.io
Class CombineHiveInputFormat.CombineHiveInputSplit

java.lang.Object
  extended by org.apache.hadoop.hive.ql.io.CombineHiveInputFormat.CombineHiveInputSplit
All Implemented Interfaces:
HadoopShims.InputSplitShim
Enclosing class:
CombineHiveInputFormat<K extends WritableComparable,V extends Writable>

public static class CombineHiveInputFormat.CombineHiveInputSplit
extends Object
implements HadoopShims.InputSplitShim

CombineHiveInputSplit encapsulates an InputSplit with its corresponding inputFormatClassName. A CombineHiveInputSplit comprises of multiple chunks from different files. Since, they belong to a single directory, there is a single inputformat for all the chunks.


Constructor Summary
CombineHiveInputFormat.CombineHiveInputSplit()
           
CombineHiveInputFormat.CombineHiveInputSplit(HadoopShims.InputSplitShim inputSplitShim)
           
CombineHiveInputFormat.CombineHiveInputSplit(JobConf job, HadoopShims.InputSplitShim inputSplitShim)
           
 
Method Summary
 HadoopShims.InputSplitShim getInputSplitShim()
           
 JobConf getJob()
           
 long getLength()
           
 long getLength(int i)
          Returns the length of the ith Path.
 long[] getLengths()
          Returns an array containing the lengths of the files in the split.
 String[] getLocations()
          Returns all the Paths where this input-split resides.
 int getNumPaths()
          Returns the number of Paths in the split.
 long getOffset(int i)
          Returns the start offset of the ith Path.
 Path getPath(int i)
          Returns the ith Path.
 Path[] getPaths()
          Returns all the Paths in the split.
 long[] getStartOffsets()
          Returns an array containing the startoffsets of the files in the split.
 String inputFormatClassName()
          Returns the inputFormat class name for the i-th chunk.
 void readFields(DataInput in)
          Writable interface.
 void setInputFormatClassName(String inputFormatClassName)
           
 void shrinkSplit(long length)
           
 String toString()
          Prints this obejct as a string.
 void write(DataOutput out)
          Writable interface.
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait
 

Constructor Detail

CombineHiveInputFormat.CombineHiveInputSplit

public CombineHiveInputFormat.CombineHiveInputSplit()
                                             throws IOException
Throws:
IOException

CombineHiveInputFormat.CombineHiveInputSplit

public CombineHiveInputFormat.CombineHiveInputSplit(HadoopShims.InputSplitShim inputSplitShim)
                                             throws IOException
Throws:
IOException

CombineHiveInputFormat.CombineHiveInputSplit

public CombineHiveInputFormat.CombineHiveInputSplit(JobConf job,
                                                    HadoopShims.InputSplitShim inputSplitShim)
                                             throws IOException
Throws:
IOException
Method Detail

getInputSplitShim

public HadoopShims.InputSplitShim getInputSplitShim()

inputFormatClassName

public String inputFormatClassName()
Returns the inputFormat class name for the i-th chunk.


setInputFormatClassName

public void setInputFormatClassName(String inputFormatClassName)

getJob

public JobConf getJob()
Specified by:
getJob in interface HadoopShims.InputSplitShim

getLength

public long getLength()
Specified by:
getLength in interface HadoopShims.InputSplitShim

getStartOffsets

public long[] getStartOffsets()
Returns an array containing the startoffsets of the files in the split.

Specified by:
getStartOffsets in interface HadoopShims.InputSplitShim

getLengths

public long[] getLengths()
Returns an array containing the lengths of the files in the split.

Specified by:
getLengths in interface HadoopShims.InputSplitShim

getOffset

public long getOffset(int i)
Returns the start offset of the ith Path.

Specified by:
getOffset in interface HadoopShims.InputSplitShim

getLength

public long getLength(int i)
Returns the length of the ith Path.

Specified by:
getLength in interface HadoopShims.InputSplitShim

getNumPaths

public int getNumPaths()
Returns the number of Paths in the split.

Specified by:
getNumPaths in interface HadoopShims.InputSplitShim

getPath

public Path getPath(int i)
Returns the ith Path.

Specified by:
getPath in interface HadoopShims.InputSplitShim

getPaths

public Path[] getPaths()
Returns all the Paths in the split.

Specified by:
getPaths in interface HadoopShims.InputSplitShim

getLocations

public String[] getLocations()
                      throws IOException
Returns all the Paths where this input-split resides.

Specified by:
getLocations in interface HadoopShims.InputSplitShim
Throws:
IOException

toString

public String toString()
Prints this obejct as a string.

Specified by:
toString in interface HadoopShims.InputSplitShim
Overrides:
toString in class Object

readFields

public void readFields(DataInput in)
                throws IOException
Writable interface.

Specified by:
readFields in interface HadoopShims.InputSplitShim
Throws:
IOException

write

public void write(DataOutput out)
           throws IOException
Writable interface.

Specified by:
write in interface HadoopShims.InputSplitShim
Throws:
IOException

shrinkSplit

public void shrinkSplit(long length)
Specified by:
shrinkSplit in interface HadoopShims.InputSplitShim


Copyright © 2012 The Apache Software Foundation