CDH 3 Release Notes

The following lists all Apache HBase Jiras included in CDH 3 that are not included in the Apache HBase base version 0.90.6. The hbase-0.90.6+84.73.CHANGES.txt file lists all changes included in CDH 3. The patch for each change can be found in the cloudera/patches directory in the release tarball.

Changes Not In Apache HBase 0.90.6

HBase

Bug

[HBASE-6440] - SplitLogManager - log the exception when failed to finish split log file
[HBASE-6200] - KeyComparator.compareWithoutRow can be wrong when families have the same prefix
[HBASE-5757] - TableInputFormat should handle as many errors as possible
[HBASE-5922] - HalfStoreFileReader seekBefore causes StackOverflowError
[HBASE-5833] - 0.92 build has been failing pretty consistently on TestMasterFailover....
[HBASE-5773] - HtablePool constructor not reading config files in certain cases
[HBASE-5724] - Row cache of KeyValue should be cleared in readFields().
[HBASE-6392] - UnknownRegionException blocks hbck from sideline big overlap regions
[HBASE-6397] - [hbck] print out bulk load commands for sidelined regions if necessary
[HBASE-4379] - [hbck] Does not complain about tables with no end region [Z,]
[HBASE-5874] - When 'fs.default.name' not configured, the hbck tool and Merge tool throw IllegalArgumentException.
[HBASE-4470] - ServerNotRunningException coming out of assignRootAndMeta kills the Master
[HBASE-6420] - Gracefully shutdown logsyncer
[HBASE-5466] - Opening a table also opens the metatable and never closes it.
[HBASE-4195] - Possible inconsistency in a memstore read after a reseek, possible performance improvement
[HBASE-6041] - NullPointerException prevents the master from starting up
[HBASE-4309] - slow query log metrics spewing warnings
[HBASE-5141] - Memory leak in MonitoredRPCHandlerImpl
[HBASE-5908] - TestHLogSplit.testTralingGarbageCorruptionFileSkipErrorsPasses should not use append to corrupt the HLog
[HBASE-5351] - hbase completebulkload to a new table fails in a race
[HBASE-5488] - OfflineMetaRepair doesn't support hadoop 0.20's fs.default.name property
[HBASE-5904] - is_enabled from shell returns differently from pre- and post- HBASE-5155
[HBASE-5740] - Compaction interruption may be due to balacing
[HBASE-5781] - Zookeeper session got closed while trying to assign the region to RS using hbck -fix
[HBASE-3923] - HBASE-1502 Broke Shell's status 'simple' and 'detailed'
[HBASE-5637] - Fix failing 0.90 TestHMsg testcase introduced by HBASE-5563.
[HBASE-5563] - HRegionInfo#compareTo should compare regionId as well
[HBASE-5593] - Reverse DNS resolution in regionServerStartup() does not strip trailing dot
[HBASE-5213] - "hbase master stop" does not bring down backup masters
[HBASE-5486] - Warn message in HTable: Stringify the byte[]
[HBASE-5484] - Spelling mistake in error message in HMasterCommandLine
[HBASE-5081] - Distributed log splitting deleteNode races against splitLog retry
[HBASE-2312] - Possible data loss when RS goes into GC pause while rolling HLog
[HBASE-5077] - SplitLogWorker fails to let go of a task, kills the RS
[HBASE-5078] - DistributedLogSplitter failing to split file because it has edits for lots of regions
[HBASE-4997] - SplitLogManager can have a race on batch.installed
[HBASE-4987] - wrong use of incarnation var in SplitLogManager
[HBASE-5049] - TestHLogSplit.testLogRollAfterSplitStart not working due to HBASE-5006
[HBASE-4945] - NPE in HRegion.bulkLoadHFiles(...)
[HBASE-4790] - Occasional TestDistributedLogSplitting failure
[HBASE-4855] - SplitLogManager hangs on cluster restart due to batch.installed doubly counted
[HBASE-4685] - TestDistributedLogSplitting.testOrphanLogCreation failing because of ArithmeticException: / by zero.
[HBASE-4007] - distributed log splitting can get indefinitely stuck
[HBASE-3889] - NPE in Distributed Log Splitting
[HBASE-3843] - splitLogWorker starts too early
[HBASE-3819] - TestSplitLogWorker has too many SLWs running -- makes for contention and occasional failures
[HBASE-3806] - distributed log splitting double escapes task names
[HBASE-4854] - it seems that CLASSPATH elements coming from Hadoop change HBase behaviour
[HBASE-4386] - NPE in TaskMonitor
[HBASE-4209] - The HBase hbase-daemon.sh SIGKILLs master when stopping it
[HBASE-4406] - TestOpenRegionHandler failing after HBASE-4287
[HBASE-4290] - HLogSplitter doesn't mark its MonitoredTask as complete in non-distributed case
[HBASE-3560] - the hbase-default entry of "hbase.defaults.for.version" causes tests not to run via not-maven
[HBASE-4156] - ZKConfig defaults clientPort improperly
[HBASE-3465] - Hbase should use a HADOOP_HOME environment variable if available.
[HBASE-3853] - TestInfoServers failing after HBASE-3835
[HBASE-3864] - Rename of hfile.min.blocksize.size in HBASE-2899 reverted in HBASE-1861

Improvement

[HBASE-5618] - SplitLogManager - prevent unnecessary attempts to resubmits
[HBASE-6013] - Polish sharp edges from CopyTable
[HBASE-6384] - hbck should group together those sidelined regions need to be bulk loaded later
[HBASE-5360] - [uberhbck] Add options for how to handle offline split parents.
[HBASE-6173] - hbck check specified tables only
[HBASE-5892] - [hbck] Refactor parallel WorkItem* to Futures.
[HBASE-5911] - hbck need an option -help to printout usage
[HBASE-5189] - Add metrics to keep track of region-splits in RS
[HBASE-6382] - Upgrade Jersey to 1.8 to match Hadoop 1 and 2
[HBASE-6379] - [0.90 branch] Backport HBASE-6334 to 0.90
[HBASE-6283] - [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
[HBASE-4554] - Allow set/unset coprocessor table attributes from shell.
[HBASE-6124] - Backport HBASE-6033 to 0.90, 0.92 and 0.94
[HBASE-4720] - Implement atomic update operations (checkAndPut, checkAndDelete) for REST client/server
[HBASE-5973] - Add ability for potentially long-running IPC calls to abort if client disconnects
[HBASE-5712] - Parallelize load of .regioninfo files in diagnostic/repair portion of hbck.
[HBASE-5801] - [hbck] Hbck should handle case where some regions have different HTD settings in .regioninfo files (0.90 specific)
[HBASE-5734] - Change hbck sideline root
[HBASE-3704] - Show per region request count in table.jsp
[HBASE-5589] - Add of the offline call to the Master Interface
[HBASE-5588] - Deprecate/remove AssignmentManager#clearRegionFromTransition
[HBASE-3676] - Update region server load for AssignmentManager through regionServerReport()
[HBASE-3507] - requests count per HRegion
[HBASE-4359] - Show dead RegionServer names in the HMaster info page
[HBASE-1364] - [performance] Distributed splitting of regionserver commit logs
[HBASE-4820] - Distributed log splitting coding enhancement to make it easier to understand, no semantics change
[HBASE-4869] - Backport to 0.92: HBASE-4797 [availability] Skip recovered.edits files with edits older than what region currently has
[HBASE-4194] - RegionSplitter: Split on under-loaded region servers first
[HBASE-3963] - Schedule all log-spliiting at startup all at once
[HBASE-4257] - Limit the number of regions in transitions displayed on master webpage.
[HBASE-4275] - RS should communicate fatal "aborts" back to the master
[HBASE-4291] - Improve display of regions in transition in UI to be more readable
[HBASE-4299] - Upgrade to Avro 1.5.3 & use Avro Maven plugin to generate Avro classes
[HBASE-4010] - HMaster.createTable could be heavily optimized
[HBASE-3835] - Switch web pages to Jamon template engine instead of JSP
[HBASE-3240] - Improve documentation of importtsv and bulk loads
[HBASE-3871] - Speedup LoadIncrementalHFiles by parallelizing HFile splitting
[HBASE-3474] - HFileOutputFormat to use column family's compression algorithm
[HBASE-3873] - Mavenize Hadoop Snappy JAR/SOs project dependencies
[HBASE-1861] - Multi-Family support for bulk upload tools (HFileOutputFormat / loadtable.rb)
[HBASE-3533] - Allow HBASE_LIBRARY_PATH env var to specify extra locations of native libs

New Feature

[HBASE-5886] - Add new metric for possible data loss due to puts without WAL
[HBASE-4057] - Implement HBase version of "show processlist"
[HBASE-4117] - Slow Query Log
[HBASE-5719] - Enhance hbck to sideline overlapped mega regions
[HBASE-5599] - [hbck] handle NO_VERSION_FILE and SHOULD_NOT_BE_DEPLOYED inconsistencies
[HBASE-5128] - [uber hbck] Online automated repair of table integrity and region consistency problems
[HBASE-2233] - Support both Hadoop 0.20, 0.21, and 0.22
[HBASE-4292] - Add a debugging dump servlet to the master and regionserver
[HBASE-4281] - Add facility to dump current state of all executors
[HBASE-3837] - Expose regionsInTransition on master UI
[HBASE-4000] - You can't specify split points when you create a table in the shell
[HBASE-3839] - Expose in-progress tasks on web UIs
[HBASE-3836] - Add facility to track currently progressing actions/workflows

Task

[HBASE-6034] - Upgrade Hadoop dependencies
[HBASE-5793] - TestHBaseFsck#TestNoHdfsTable test hangs after client retries increased
[HBASE-5006] - Move hbase 0.92RC1 on to hadoop 1.0.0RC2
[HBASE-3393] - Update Avro gateway to use Avro 1.4.1 and the new server.join() method
[HBASE-3691] - Add compressor support for 'snappy', google's compressor

Test

[HBASE-6507] - [hbck] TestHBaseFsck ran into TableNotEnabledException
[HBASE-6190] - TestPriorityCompactionQueue throws NPE
[HBASE-5112] - TestReplication#queueFailover flaky due to potentially uninitialized Scan
[HBASE-4302] - Only run Snappy compression tests if Snappy is available