|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |
java.lang.Objectorg.apache.hadoop.hbase.regionserver.Store
public class Store
A Store holds a column family in a Region. Its a memstore and a set of zero or more StoreFiles, which stretch backwards over time.
There's no reason to consider append-logging at this level; all logging and locking is handled at the HRegion level. Store just provides services to manage sets of StoreFiles. One of the most important of those services is compaction services where files are aggregated once they pass a configurable threshold.
The only thing having to do with logs that Store needs to deal with is the reconstructionLog. This is a segment of an HRegion's log that might NOT be present upon startup. If the param is NULL, there's nothing to do. If the param is non-NULL, we need to process the log to reconstruct a TreeMap that might not have been written to disk before the process died.
It's assumed that after this constructor returns, the reconstructionLog file will be deleted (by whoever has instantiated the Store).
Locking and transactions are handled at a higher level. This API should not be called directly but by an HRegion manager.
Field Summary | |
---|---|
static long |
DEEP_OVERHEAD
|
static long |
FIXED_OVERHEAD
|
protected int |
maxVersions
|
protected MemStore |
memstore
|
protected int |
minVersions
|
protected long |
ttl
|
Constructor Summary | |
---|---|
protected |
Store(org.apache.hadoop.fs.Path basedir,
HRegion region,
HColumnDescriptor family,
org.apache.hadoop.fs.FileSystem fs,
org.apache.hadoop.conf.Configuration conf)
Constructor |
Method Summary | |
---|---|
protected long |
add(KeyValue kv)
Adds a value to the memstore |
boolean |
canSplit()
|
protected void |
compactRecent(int N)
|
protected long |
delete(KeyValue kv)
Adds a value to the memstore |
void |
finishRequest(CompactionRequest cr)
|
CacheConfig |
getCacheConfig()
Used for tests. |
CompactionProgress |
getCompactionProgress()
getter for CompactionProgress object |
int |
getCompactPriority()
|
KeyValue.KVComparator |
getComparator()
|
HColumnDescriptor |
getFamily()
|
org.apache.hadoop.fs.Path |
getHomedir()
Return the directory in which this store stores its StoreFiles |
long |
getLastCompactSize()
|
static long |
getLowestTimestamp(List<StoreFile> candidates)
|
long |
getMaxMemstoreTS()
|
int |
getNumberOfstorefiles()
|
org.apache.hadoop.hbase.regionserver.StoreScanner |
getScanner(Scan scan,
NavigableSet<byte[]> targetCols)
Return a scanner for both the memstore and the HStore files |
protected List<KeyValueScanner> |
getScanners(boolean cacheBlocks,
boolean isGet,
boolean isCompaction)
|
long |
getSize()
|
byte[] |
getSplitPoint()
Determines if Store should be split |
org.apache.hadoop.hbase.regionserver.StoreFlusher |
getStoreFlusher(long cacheFlushId)
|
static org.apache.hadoop.fs.Path |
getStoreHomedir(org.apache.hadoop.fs.Path tabledir,
String encodedName,
byte[] family)
|
long |
heapSize()
|
boolean |
needsCompaction()
See if there's too much store files in this store |
CompactionRequest |
requestCompaction()
|
com.google.common.collect.ImmutableList<StoreFile> |
sortAndClone(List<StoreFile> storeFiles)
|
String |
toString()
|
void |
triggerMajorCompaction()
|
long |
updateColumnValue(byte[] row,
byte[] f,
byte[] qualifier,
long newValue)
Increments the value for the given row/family/qualifier. |
long |
upsert(List<KeyValue> kvs)
Adds or replaces the specified KeyValues. |
Methods inherited from class java.lang.Object |
---|
clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait |
Field Detail |
---|
protected final MemStore memstore
protected long ttl
protected int minVersions
protected int maxVersions
public static final long FIXED_OVERHEAD
public static final long DEEP_OVERHEAD
Constructor Detail |
---|
protected Store(org.apache.hadoop.fs.Path basedir, HRegion region, HColumnDescriptor family, org.apache.hadoop.fs.FileSystem fs, org.apache.hadoop.conf.Configuration conf) throws IOException
basedir
- qualified path under which the region directory lives;
generally the table subdirectoryregion
- family
- HColumnDescriptor for this columnfs
- file system objectconf
- configuration object
failed. Can be null.
IOException
Method Detail |
---|
public HColumnDescriptor getFamily()
public long getMaxMemstoreTS()
public static org.apache.hadoop.fs.Path getStoreHomedir(org.apache.hadoop.fs.Path tabledir, String encodedName, byte[] family)
tabledir
- encodedName
- Encoded region name.family
-
public org.apache.hadoop.fs.Path getHomedir()
protected long add(KeyValue kv)
kv
-
protected long delete(KeyValue kv)
kv
-
protected List<KeyValueScanner> getScanners(boolean cacheBlocks, boolean isGet, boolean isCompaction) throws IOException
IOException
protected void compactRecent(int N) throws IOException
IOException
public static long getLowestTimestamp(List<StoreFile> candidates) throws IOException
IOException
public CompactionProgress getCompactionProgress()
public CompactionRequest requestCompaction()
public void finishRequest(CompactionRequest cr)
public com.google.common.collect.ImmutableList<StoreFile> sortAndClone(List<StoreFile> storeFiles)
public int getNumberOfstorefiles()
public boolean canSplit()
public byte[] getSplitPoint()
public long getLastCompactSize()
public long getSize()
public void triggerMajorCompaction()
public org.apache.hadoop.hbase.regionserver.StoreScanner getScanner(Scan scan, NavigableSet<byte[]> targetCols) throws IOException
IOException
public String toString()
toString
in class Object
public int getCompactPriority()
public long updateColumnValue(byte[] row, byte[] f, byte[] qualifier, long newValue) throws IOException
row
- f
- qualifier
- newValue
- the new value to set into memstore
IOException
public long upsert(List<KeyValue> kvs) throws IOException
For each KeyValue specified, if a cell with the same row, family, and qualifier exists in MemStore, it will be replaced. Otherwise, it will just be inserted to MemStore.
This operation is atomic on each KeyValue (row/family/qualifier) but not necessarily atomic across all of them.
kvs
-
IOException
public org.apache.hadoop.hbase.regionserver.StoreFlusher getStoreFlusher(long cacheFlushId)
public boolean needsCompaction()
public CacheConfig getCacheConfig()
public long heapSize()
heapSize
in interface HeapSize
public KeyValue.KVComparator getComparator()
|
||||||||||
PREV CLASS NEXT CLASS | FRAMES NO FRAMES | |||||||||
SUMMARY: NESTED | FIELD | CONSTR | METHOD | DETAIL: FIELD | CONSTR | METHOD |