|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.conf.Configured
org.apache.hadoop.hbase.mapreduce.hadoopbackport.InputSampler<K,V>
public class InputSampler<K,V>
Utility for collecting samples and writing a partition file for
TotalOrderPartitioner
.
This is an identical copy of o.a.h.mapreduce.lib.partition.TotalOrderPartitioner
from Hadoop trunk at r961542, with the exception of replacing
TaskAttemptContextImpl with TaskAttemptContext.
Nested Class Summary | |
---|---|
static class |
InputSampler.IntervalSampler<K,V>
Sample from s splits at regular intervals. |
static class |
InputSampler.RandomSampler<K,V>
Sample from random points in the input. |
static interface |
InputSampler.Sampler<K,V>
Interface to sample using an InputFormat . |
static class |
InputSampler.SplitSampler<K,V>
Samples the first n records from s splits. |
Constructor Summary | |
---|---|
InputSampler(org.apache.hadoop.conf.Configuration conf)
|
Method Summary | ||
---|---|---|
static org.apache.hadoop.mapreduce.TaskAttemptContext |
getTaskAttemptContext(org.apache.hadoop.mapreduce.Job job)
This method is about making hbase portable, making it so it can run on more than just hadoop 0.20. |
|
static void |
main(String[] args)
|
|
int |
run(String[] args)
Driver for InputSampler from the command line. |
|
static
|
writePartitionFile(org.apache.hadoop.mapreduce.Job job,
InputSampler.Sampler<K,V> sampler)
Write a partition file for the given job, using the Sampler provided. |
Methods inherited from class org.apache.hadoop.conf.Configured |
---|
getConf, setConf |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait |
Methods inherited from interface org.apache.hadoop.conf.Configurable |
---|
getConf, setConf |
Constructor Detail |
---|
public InputSampler(org.apache.hadoop.conf.Configuration conf)
Method Detail |
---|
public static org.apache.hadoop.mapreduce.TaskAttemptContext getTaskAttemptContext(org.apache.hadoop.mapreduce.Job job) throws IOException
job
-
IOException
public static <K,V> void writePartitionFile(org.apache.hadoop.mapreduce.Job job, InputSampler.Sampler<K,V> sampler) throws IOException, ClassNotFoundException, InterruptedException
TotalOrderPartitioner.getPartitionFile(org.apache.hadoop.conf.Configuration)
.
IOException
ClassNotFoundException
InterruptedException
public int run(String[] args) throws Exception
writePartitionFile(org.apache.hadoop.mapreduce.Job, org.apache.hadoop.hbase.mapreduce.hadoopbackport.InputSampler.Sampler)
.
run
in interface org.apache.hadoop.util.Tool
Exception
public static void main(String[] args) throws Exception
Exception
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |