com.cloudera.sqoop.mapreduce
Class DataDrivenImportJob

java.lang.Object
  extended by com.cloudera.sqoop.mapreduce.JobBase
      extended by com.cloudera.sqoop.mapreduce.ImportJobBase
          extended by com.cloudera.sqoop.mapreduce.DataDrivenImportJob

public class DataDrivenImportJob
extends ImportJobBase

Actually runs a jdbc import job using the ORM files generated by the sqoop.orm package. Uses DataDrivenDBInputFormat.


Field Summary
static org.apache.commons.logging.Log LOG
           
 
Fields inherited from class com.cloudera.sqoop.mapreduce.JobBase
inputFormatClass, mapperClass, options, outputFormatClass
 
Constructor Summary
DataDrivenImportJob(SqoopOptions opts)
           
DataDrivenImportJob(SqoopOptions opts, java.lang.Class<? extends org.apache.hadoop.mapreduce.InputFormat> inputFormatClass, ImportJobContext context)
           
 
Method Summary
protected  void configureInputFormat(org.apache.hadoop.mapreduce.Job job, java.lang.String tableName, java.lang.String tableClassName, java.lang.String splitByCol)
          Configure the inputformat to use for the job.
protected  void configureMapper(org.apache.hadoop.mapreduce.Job job, java.lang.String tableName, java.lang.String tableClassName)
          Set the mapper class implementation to use in the job, as well as any related configuration (e.g., map output types).
protected  java.lang.Class<? extends org.apache.hadoop.mapreduce.Mapper> getMapperClass()
           
protected  java.lang.Class<? extends org.apache.hadoop.mapreduce.OutputFormat> getOutputFormatClass()
           
 
Methods inherited from class com.cloudera.sqoop.mapreduce.ImportJobBase
configureOutputFormat, runImport, runJob
 
Methods inherited from class com.cloudera.sqoop.mapreduce.JobBase
configureNumTasks, getInputFormatClass, loadJars, setInputFormatClass, setMapperClass, setOptions, setOutputFormatClass, unloadJars
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Field Detail

LOG

public static final org.apache.commons.logging.Log LOG
Constructor Detail

DataDrivenImportJob

public DataDrivenImportJob(SqoopOptions opts)

DataDrivenImportJob

public DataDrivenImportJob(SqoopOptions opts,
                           java.lang.Class<? extends org.apache.hadoop.mapreduce.InputFormat> inputFormatClass,
                           ImportJobContext context)
Method Detail

configureMapper

protected void configureMapper(org.apache.hadoop.mapreduce.Job job,
                               java.lang.String tableName,
                               java.lang.String tableClassName)
                        throws java.io.IOException
Description copied from class: JobBase
Set the mapper class implementation to use in the job, as well as any related configuration (e.g., map output types).

Overrides:
configureMapper in class JobBase
Throws:
java.io.IOException

getMapperClass

protected java.lang.Class<? extends org.apache.hadoop.mapreduce.Mapper> getMapperClass()
Overrides:
getMapperClass in class JobBase
Returns:
the mapper class to use for the job.

getOutputFormatClass

protected java.lang.Class<? extends org.apache.hadoop.mapreduce.OutputFormat> getOutputFormatClass()
                                                                                            throws java.lang.ClassNotFoundException
Overrides:
getOutputFormatClass in class JobBase
Returns:
the outputformat class to use for the job.
Throws:
java.lang.ClassNotFoundException

configureInputFormat

protected void configureInputFormat(org.apache.hadoop.mapreduce.Job job,
                                    java.lang.String tableName,
                                    java.lang.String tableClassName,
                                    java.lang.String splitByCol)
                             throws java.io.IOException
Description copied from class: JobBase
Configure the inputformat to use for the job.

Overrides:
configureInputFormat in class JobBase
Throws:
java.io.IOException


Copyright © 2010 Cloudera, Inc.