CDH 4 Release Notes

Changes Not In Flume 0.9.4

Flume

Bug

• [FLUME-721] - Webapps 'autofindport' feature does not work
• [FLUME-770] - setting FLUME_IDENT_STRING based on $USER is not robust
• [FLUME-734] - escapedFormatDfs goes into a file creation frenzy
• [FLUME-745] - Fix Race condition in NaiveFileWALDeco and retransmit logic
• [FLUME-746] - Correct the behavior and logging messages about states transition of wal chunks on retry
• [FLUME-766] - the location and name of the flume's PID file needs to be tweakable
• [FLUME-580] - Flume needs to be consistent with autodiscovery of Hadoop compression codecs
• [FLUME-706] - Flume nodes launch duplicate logical nodes
• [FLUME-720] - CollectorSink doesn't pass the new format parameter
• [FLUME-759] - Regression due to avro 1.5.2 upgrade
• [FLUME-758] - Test Excludes on maven build doesn't always work.
• [FLUME-742] - TestAvroSinks fails
• [FLUME-718] - FlumeConfiguration should have default webapp paths.
• [FLUME-719] - Flume attribute field map from Avro|ThriftEventConvertUtil.toFlumeEvent() should be mutable
• [FLUME-697] - ExecNioSource has an unbounded queue that can cause OOME.
• [FLUME-681] - High message rate with SyslogTcpSourceThreads can lead to OOM
• [FLUME-512] - Flume swallowing ClassNotFoundException
• [FLUME-666] - TailSource.close should block until subthread is closed.
• [FLUME-658] - Handle Unexpected RuntimeExceptions differently than IOExceptions in sinks and decorators.
• [FLUME-656] - Flume node deadlocks on roll sink rotate with failing subsink.
• [FLUME-682] - Improve SeqfileEventSink performance
• [FLUME-620] - Collector fails due to an infinite loop during file-rolling if the body size is greater than 30kb

Improvement

• [FLUME-755] - Upgrade dependency to Avro 1.5.3
• [FLUME-741] - Update Avro version to 1.5.2
• [FLUME-603] - Revisit Performance tests
• [FLUME-691] - Have project build that contains binaries and sources.
• [FLUME-683] - Add input/output buffering to ThriftEventSource/Sink
• [FLUME-676] - Allow EL values in value() decorator

New Feature

• [FLUME-499] - names of incomplete files being written to hdfs should indicate they are incomplete.
• [FLUME-273] - RollSink should expose ability to configure SizeTrigger

Task

• [FLUME-716] - Add ability to exclude or include arbitrary tests to maven build.
• [FLUME-703] - Make default thrift compiler location based off of THRIFT_HOME env variable
• [FLUME-702] - Make git hash an argument to the build
• [FLUME-701] - Make flume distribution tar generated contents live inside ./flume-<version>/
• [FLUME-700] - Make build explicitly depend on antlr-runtime
• [FLUME-677] - update build instructions in devnotes or readme file.