org.apache.hadoop.hive.ql.io
Class FlatFileInputFormat<T>

java.lang.Object
  extended by org.apache.hadoop.mapred.FileInputFormat<Void,FlatFileInputFormat.RowContainer<T>>
      extended by org.apache.hadoop.hive.ql.io.FlatFileInputFormat<T>
All Implemented Interfaces:
org.apache.hadoop.mapred.InputFormat<Void,FlatFileInputFormat.RowContainer<T>>

public class FlatFileInputFormat<T>
extends org.apache.hadoop.mapred.FileInputFormat<Void,FlatFileInputFormat.RowContainer<T>>

An InputFormat for Plain files with Deserializer records


Nested Class Summary
 class FlatFileInputFormat.FlatFileRecordReader<R>
          An RecordReader for plain files with Deserializer records Reads one row at a time of type R.
static class FlatFileInputFormat.RowContainer<T>
          A work-around until HADOOP-1230 is fixed.
static interface FlatFileInputFormat.SerializationContext<S>
          An implementation of SerializationContext is responsible for looking up the Serialization implementation for the given RecordReader.
static class FlatFileInputFormat.SerializationContextFromConf<S>
          An implementation of FlatFileInputFormat.SerializationContext that reads the Serialization class and specific subclass to be deserialized from the JobConf.
 
Field Summary
static String SerializationImplKey
          The JobConf keys for the Serialization implementation
 
Fields inherited from class org.apache.hadoop.mapred.FileInputFormat
LOG
 
Constructor Summary
FlatFileInputFormat()
           
 
Method Summary
 org.apache.hadoop.mapred.RecordReader<Void,FlatFileInputFormat.RowContainer<T>> getRecordReader(org.apache.hadoop.mapred.InputSplit split, org.apache.hadoop.mapred.JobConf job, org.apache.hadoop.mapred.Reporter reporter)
           
protected  boolean isSplittable(org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.fs.Path filename)
           
 
Methods inherited from class org.apache.hadoop.mapred.FileInputFormat
addInputPath, addInputPaths, computeSplitSize, getBlockIndex, getInputPathFilter, getInputPaths, getSplits, isSplitable, listPaths, listStatus, setInputPathFilter, setInputPaths, setInputPaths, setMinSplitSize, validateInput
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

SerializationImplKey

public static final String SerializationImplKey
The JobConf keys for the Serialization implementation

See Also:
Constant Field Values
Constructor Detail

FlatFileInputFormat

public FlatFileInputFormat()
Method Detail

isSplittable

protected boolean isSplittable(org.apache.hadoop.fs.FileSystem fs,
                               org.apache.hadoop.fs.Path filename)

getRecordReader

public org.apache.hadoop.mapred.RecordReader<Void,FlatFileInputFormat.RowContainer<T>> getRecordReader(org.apache.hadoop.mapred.InputSplit split,
                                                                                                       org.apache.hadoop.mapred.JobConf job,
                                                                                                       org.apache.hadoop.mapred.Reporter reporter)
                                                                                                throws IOException
Specified by:
getRecordReader in interface org.apache.hadoop.mapred.InputFormat<Void,FlatFileInputFormat.RowContainer<T>>
Specified by:
getRecordReader in class org.apache.hadoop.mapred.FileInputFormat<Void,FlatFileInputFormat.RowContainer<T>>
Throws:
IOException


Copyright © 2009 The Apache Software Foundation