|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.hive.ql.io.RCFileOutputFormat
public class RCFileOutputFormat
RCFileOutputFormat.
Constructor Summary | |
---|---|
RCFileOutputFormat()
|
Method Summary | |
---|---|
static int |
getColumnNumber(Configuration conf)
Returns the number of columns set in the conf for writers. |
FileSinkOperator.RecordWriter |
getHiveRecordWriter(JobConf jc,
Path finalOutPath,
Class<? extends Writable> valueClass,
boolean isCompressed,
Properties tableProperties,
Progressable progress)
create the final out file. |
|
getRecordWriter(FileSystem ignored,
JobConf job,
String name,
Progressable progress)
|
static void |
setColumnNumber(Configuration conf,
int columnNum)
set number of columns into the given configuration. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface org.apache.hadoop.hive.ql.io.HiveOutputFormat |
---|
getHiveRecordWriter |
Constructor Detail |
---|
public RCFileOutputFormat()
Method Detail |
---|
public static void setColumnNumber(Configuration conf, int columnNum)
conf
- configuration instance which need to set the column numbercolumnNum
- column number for RCFile's Writerpublic static int getColumnNumber(Configuration conf)
conf
-
publicgetRecordWriter(FileSystem ignored, JobConf job, String name, Progressable progress) throws IOException
IOException
public FileSinkOperator.RecordWriter getHiveRecordWriter(JobConf jc, Path finalOutPath, Class<? extends Writable> valueClass, boolean isCompressed, Properties tableProperties, Progressable progress) throws IOException
jc
- the job configuration filefinalOutPath
- the final output file to be createdvalueClass
- the value class used for createisCompressed
- whether the content is compressed or nottableProperties
- the tableInfo of this file's corresponding tableprogress
- progress used for status report
IOException
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |