commit 771282577aadcf61073e7cb77a31ef5cd6140fc4 Author: Jenkins Date: Thu Aug 24 08:23:30 2017 -0700 Branching for 5.13.0 on Thu Aug 24 08:22:31 PDT 2017 JOB_NAME : 'Cut-Release-Branches' BUILD_NUMBER : '498' CODE_BRANCH : '' OLD_CDH_BRANCH : 'cdh5_5.13.x' Pushed to remote origin git@github.sf.cloudera.com:CDH/flume-ng.git (push) commit 0c19e5d955fb16b88cfa5aa56e2790d8c03dc630 Author: Jenkins Date: Thu Aug 24 05:11:44 2017 -0700 Branching for 5.13.1-SNAPSHOT on Thu Aug 24 05:10:35 PDT 2017 JOB_NAME : 'Cut-Release-Branches' BUILD_NUMBER : '492' CODE_BRANCH : '' OLD_CDH_BRANCH : 'cdh5' Pushed to remote origin git@github.sf.cloudera.com:CDH/flume-ng.git (push) commit 245958b85e1b58dc8935455227dc30d8b93db1c4 Author: Ferenc Szabo Date: Mon Aug 21 14:29:38 2017 +0200 FLUME-3152 Add Flume Metric for Backup Checkpoint Errors This change adds a new metric (channel.file.checkpoint.backup.write.error) to the File Channel. It gets incremented if an exception happens during backup checkpoints writes. This closes #156 Reviewers: Denes Arvay (Ferenc Szabo via Denes Arvay) Change-Id: Iba6f142e8cbd8f4ec6a357efaf7a7b0aa6867e1d commit feb02a4e85596c53d34c3d564caf8239b26004df Author: Miklos Csanady Date: Mon Aug 7 16:18:16 2017 +0200 FLUME-3093: Groundwork for version changes in root pom This commit extracts the version numbers from the subprojects' pom.xml to the root pom.xml without introducing any other change (i.e. the dependency tree didn't change) This closes #132 Reviewers: Ferenc Szabo, Attila Simon (Miklos Csanady via Denes Arvay) Change-Id: Ib3aaf685c2b6bc72242415d9204d1c282d4be372 commit 46c3c9d2157aa6859c14018c9218e36ebaf2a209 Author: Denes Arvay Date: Fri Aug 11 16:22:04 2017 +0200 FLUME-3144. Improve Log4jAppender's performance by allowing logging collection of messages Log4jAppender treats Collection messages as a special case making it possible to log Collection of events in one Log4j log call. The appender sends these events to the receiving Flume instance as one batch with the rpcClient.appendBatch() method. This closes #151 Reviewers: Ferenc Szabo, Miklos Csanady (Denes Arvay via Denes Arvay) Change-Id: I5261c28f02fe3d138a7fc335e568f34c16c0d52c commit 488322e5240a8f330659ddf9257a8c22fe958eb5 Author: Attila Simon Date: Thu Jun 29 08:21:44 2017 +0200 CDH-56332 FLUME-2752. Fix AvroSource startup resource leaks Cleanup after Netty initialisation fails (call this.stop()) - Make sure this.stop() releases the resources and end up the component in a LifecycleAware.STOPPED state - Added junit test to cover the invalid host scenario - Added junit test to cover the used port scenario This closes #141. Reviewers: Denes Arvay (Attila Simon via Denes Arvay) (cherry picked from commit b5e5ba50f4333272b9e2f2be2b32027e667f32e2) Change-Id: I7ba3a55e0a00a8a99cda8d2c1e65e4f651b0c68a commit 7a65fdb64b4fdcd57181944b478706edb5e6ec97 Author: Siddharth Ahuja Date: Fri Jun 30 14:01:15 2017 +0200 CDH-56331 FLUME-2905. Fix NetcatSource file descriptor leak if startup fails This patch fixes the issue in NetcatSource which occurs if there is a problem while binding the channel's socket to a local address and leads to a file descriptor (socket) leak. Reviewers: Attila Simon, Denes Arvay (Siddharth Ahuja via Denes Arvay) (cherry picked from commit 5e9cfef2b26f1960601d08d571e4c85c269503af) Change-Id: If114d6085bf1a0bd933b4e474a06c556be17bda5 commit a943dd53b561a4f390d470b91eb23f5891f6a880 Author: Jenkins Date: Thu May 25 11:04:01 2017 -0700 Updating Maven version to 5.13.0-SNAPSHOT commit a2562239476620bc6a79d42e9e61bc24653f6faa Author: Denes Arvay Date: Thu Apr 20 15:58:47 2017 +0200 FLUME-3085. HDFS Sink can skip flushing some BucketWriters, might lead to data loss This commit fixes the issue when in HDFSEventSink.process() a BucketWriter.append() call threw a BucketClosedException then the newly created BucketWriter wasn't flushed after the processing loop. This closes #129 Reviewers: Attila Simon, Mike Percy (Denes Arvay via Mike Percy) Change-Id: I53e8cca143715b80d08b7b86017fa2d790c2dc22 commit a42081a89437fbe069a64e593a4dc375fdbe32f7 Author: Denes Arvay Date: Tue May 9 16:23:31 2017 +0200 CDH-54160 FLUME-3092. Extend the FileChannel's monitoring metrics This patch adds the following new metrics to the FileChannel's counters: - eventPutErrorCount: incremented if an IOException occurs during put operation. - eventTakeErrorCount: incremented if an IOException or CorruptEventException occurs during take operation. - checkpointWriteErrorCount: incremented if an exception occurs during checkpoint write. - unhealthy: this flag represents whether the channel has started successfully (i.e. the replay ran without any problem), so the channel is capable for normal operation - closed flag: the numeric representation (1: closed, 0: open) of the negated open flag. Closes #131. Reviewers: Attila Simon, Mike Percy (Denes Arvay via Mike Percy) (cherry picked from commit fdc53f338931b96addf06f3f2be59da128656ec0) Change-Id: Ie60248f3268908133925f7af9891821d8168ca19 commit e98166836ada8c914657041ec8d180f0306c8373 Author: Attila Simon Date: Wed May 17 16:46:42 2017 +0200 CDH-50717 Use batch mode mvn execution for pre commit This makes jenkins output console log less chatty Change-Id: I71b74aee145539a2e4e5dd4c043caf2cc2208ed6 commit ad00f8c3d10159360760d179f44571961377633c Author: Attila Simon Date: Tue May 16 13:20:03 2017 +0200 CDH-51264 Exclude flaky test in org.apache.flume.channel.file.TestFileChannelRestart Once flakiness is fixed then remove this exclusion as well as part of CDH-51264 Change-Id: I11505a0443132cc6ddb23321e6f18e5edcad5c47 commit 86974ab9d19fbf36b13db92a853ba2a83963b958 Author: Attila Simon Date: Tue May 16 13:14:47 2017 +0200 CDH-45148 Exclude flaky tests in org.apache.flume.source.thriftLegacy.TestThriftLegacySource Once flakiness is fixed then remove this exclusion as well as part of CDH-45148 Change-Id: I13c3bbe95477fd6365ca254835c0516e22ca3ca7 commit f4edadfbf76e2fd7bdc03625671b2cde5d9269e7 Author: Denes Arvay Date: Tue May 2 15:05:23 2017 +0200 Fix broken build due to backward incompatible changes in hadoop-hdfs lib Change-Id: Ibe7b5c04915ba254b47a433442751898019ef87a commit f376d589bd03be00b47fa6bffdbe533f83b32086 Author: Denes Arvay Date: Mon Apr 3 17:27:19 2017 +0200 FLUME-3080. Close failure in HDFS Sink might cause data loss If the HDFS Sink tries to close a file but it fails (e.g. due to timeout) the last block might not end up in COMPLETE state. In this case block recovery should happen but as the lease is still held by Flume the NameNode will start the recovery process only after the hard limit of 1 hour expires. This change adds an explicit recoverLease() call in case of close failure. This closes #127 Reviewers: Hari Shreedharan (Denes Arvay via Bessenyei Balázs Donát) Change-Id: I07f4b440538b9827c6a7b259a5b23d6f460bda87 commit e3195c9c4e2f13bfc7b217ed6d688f6f1e79a902 Author: Attila Simon Date: Wed Mar 8 03:22:43 2017 -0800 Revert "CDH-50847 - Junit: create an empty exclude file to store the flaky tests till those are fixed" This reverts commit 8b7f1f35e4de7a24700b77d730619e1d023f63cb. Change-Id: Ice3d8f7fe048d3cd54874a02ea7e95eb6853e4dc commit 722c0bb8c1f9ceadf7a47185a916148eae4d8e1e Author: Attila Simon Date: Fri Feb 24 18:37:19 2017 +0100 CDH-50847 - Junit: create an empty exclude file to store the flaky tests till those are fixed Change-Id: I3cb321c36de5b0e9d80cc11dd1eedb11ebfedd2f commit af00ad375b504b94a53291fcf3010ba501a4e38f Author: Jenkins Date: Mon Feb 27 16:10:27 2017 -0800 Updating Maven version to 5.12.0-SNAPSHOT commit 5b627ee0280c34a7ad2801e273d78fced74f4112 Author: mthakkar Date: Thu Feb 23 20:53:47 2017 -0800 [CDH-50743] Enable deployment of the artifact (flume-checkstyle) Add parent section in the pom so that we can deploy the artifacts produced by this pom. commit e2b29b5849cf46429629e43f53fd43b9a3dff970 Author: Denes Arvay Date: Fri Jan 27 11:43:27 2017 +0100 FLUME-3049. Make HDFS sink rotate more reliably in secure mode It was reported that the HDFS sink had a bug where file rotation was not reliable in secure mode. After investigating, it turns out that this was caused by a bug in the FlumeAuthenticator code: A "try" block in UGIExecutor.execute() was wrapping exceptions (such as IOException) with a SecurityException. That exception wrapping was breaking the contract of BucketWriter because the caller (HDFSEventSink) did not understand how to react to the SecurityException. This also likely had other negative effects in exceptional cases. The following changes are included in this patch: * Remove the exception wrapping in UGIExecutor.execute(). * Add tests for exception propagation in FlumeAuthenticator implementations. * Add testRotateBucketOnIOException() to TestBucketWriter as a regression test for the HDFS sink issue. Closes #106. Reviewers: Attila Simon, Mike Percy (Denes Arvay via Mike Percy) Change-Id: I0059aa1218c155112f61bcff0d45c79416bd3a19 commit a839c068f00445708f050e883d38ba8fae5a3381 Author: Attila Simon Date: Fri Jan 13 17:40:48 2017 +0100 CDH-48236 Ignore flaky JDBC Channel junittests Change-Id: I6260d57d252a5c9181dd40a2d7f93dc159df565f commit 97f7e88932d6fb510e40e7c604b0b40fbf00f515 Author: Attila Simon Date: Thu Feb 16 13:47:56 2017 +0100 CDH-50127. Backport missing items from 1.7.0 Reapply these patches to fix mistakes in previous conflict resolutions FLUME-3025. Expose FileChannel.open on JMX FLUME-2972. Handle offset migration in the new Kafka Channel FLUME-2812. Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel FLUME-3031. Change sequence source to reset its counter for event body on channel exception FLUME-2918. Speed up TaildirSource on directories with many files Manually fix checkstyle differences for flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestBucketWriter.java flume-ng-sinks/flume-ng-kafka-sink/src/main/java/org/apache/flume/sink/kafka/KafkaSink.java flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/util/KafkaLocal.java pom.xml README Change-Id: I707b2eff45d90024c4e7b0d8ecbd3d7e73d4ae04 commit 7283c4984f6281bc42db47e09f1fbce787007c22 Author: Hari Shreedharan Date: Mon Apr 20 23:59:18 2015 -0700 FLUME-2649. Elasticsearch sink doesn't handle JSON fields correctly (Benjamin Fiorini via Hari) Change-Id: I6db673bed0e17f36142f713c99b61ae929d2484c commit 93b1f2383c46adab48f94fd1dc7ea0347e15d215 Author: Attila Simon Date: Wed Nov 30 14:37:36 2016 +0100 Fix Remove Header Interceptor properties table in FlumeUserGuide.rst This closes #91 Reviewers: Denes Arvay, Bessenyei Balázs Donát (Attila Simon via Bessenyei Balázs Donát) Change-Id: I9ba16e4cab32727754e1348715e74d8190552a06 commit 26c63ea28cc85a102e0f21e7fe7c27c146c68e99 Author: Peter Ableda Date: Fri Nov 18 16:41:54 2016 +0100 Clean up references to the Flume 0.9 TailSource and recommendations to use Exec source to tail files Flume has Spooling Directory Source and Taildir Source now, so there's no need to use workarounds such as the Exec source to tail files. This closes #88 Reviewers: Denes Arvay, Jeff Holoman (Peter Ableda via Bessenyei Balázs Donát) Change-Id: Ie4f9b0cebd1b6ba6f75fc4a89431280bb9d40eb6 commit 843a66703794caec0e9b69295f3d433660409b27 Author: Attila Simon Date: Wed Nov 23 18:39:04 2016 +0100 Fix KafkaSource and KafkaSink example configurations in the user guide This closes #86 Reviewers: Jeff Holoman, Denes Arvay (Attila Simon via Bessenyei Balázs Donát) Change-Id: Ibe38a28b1fcf29cb8e78138542a0656574aa298a commit d2f008bd24375726be261d5925f864b162dae231 Author: Peter Ableda Date: Fri Nov 18 16:02:02 2016 +0100 Remove hostHeader = hostname property from Host interceptor example We are overriding the host header name from `host` to `hostname` in the example usage section. Due to this example users are overriding the header name too but still use the `%{host}` substitution as shown in the HDFS Sink section. This leads to errors. This change removes the mentioned example config line, thus the default header will be used. This closes #87 Reviewers: Bessenyei Balázs Donát (Peter Ableda via Bessenyei Balázs Donát) Change-Id: I1b1b67f21876ac39dd3fdc9b7ea7cb2e9357aaa0 commit 1367f74ce86c302b81129046c65d9b64474f87e5 Author: Bessenyei Balázs Donát Date: Tue Oct 25 11:11:02 2016 +0200 Add e-mail templates to HowToRelease.md Reviewers: Attila Simon This closes #78 Change-Id: I4ff4fc05df88da8f6c21ead0a3263d519982ff81 commit b65f103c3ae5383b253399e8ac4d6857e59f05ac Author: Tristan Stevens Date: Fri Oct 28 14:24:02 2016 +0200 FLUME-2857. Make Kafka Source/Channel/Sink restore default values when live updating config This commit changes Kafka Channel, Sink and Source to fix an error where sub-configurations aren't tolerant of the configure() method being called more than once (as happens when a Live Config Update happens). Reviewers: Denes Arvay, Attila Simon, Bessenyei Balázs Donát (Tristan Stevens via Bessenyei Balázs Donát) Change-Id: I44fd08312d5bba8bb87e220e483dc0daadb2a2bf commit 8d561b7b9afe49d686f1bf4285cd595766ff0986 Author: Bessenyei Balázs Donát Date: Tue Oct 25 15:13:28 2016 +0200 Add Developer Section / Developers Quick Hack Sheet from cwiki.apache.org Reviewers: Attila Simon This closes #81 Change-Id: I8c113076f87c9befa2d536a27eb8018c5c6993da commit 475c11ecedb2888e655b3719909abd5dc6bb48a5 Author: Bessenyei Balázs Donát Date: Fri Oct 28 12:36:08 2016 +0200 Add Developer Section / How to Commit from cwiki.apache.org Reviewers: Attila Simon This closes #80 Change-Id: Ife26c86a14143994469799eb2e967560fe0daaca commit b6aa956ade7aa5aa04ec4bd67ff33afacb49224b Author: Bessenyei Balázs Donát Date: Tue Oct 25 13:36:33 2016 +0200 Add Developer Section / How to Contribute from cwiki.apache.org Reviewers: Attila Simon This closes #79 Change-Id: Ic3345061c9c47bc23a7ae1fd06eeb780484eafb7 commit dd32c1b52cd7133c3bcb80ed1fadaf488e24de68 Author: Bessenyei Balázs Donát Date: Mon Oct 24 16:53:29 2016 +0200 Add Developer Section / How to Release from cwiki.apache.org Reviewers: Mike Percy This closes #77 Change-Id: I5d6ffc5b654fd11e5e759f7b0fa956f0bb79a569 commit 301376aa28239340a64783771bca180e2a68641f Author: Bessenyei Balázs Donát Date: Mon Oct 24 08:44:38 2016 +0200 Set MAVEN_OPTS for Travis-CI Travis builds occasionally fail with Java heap space error. This commit sets higher limits to fix the issue mentioned above. Reviewers: Lior Zeno, Mike Percy This closes #75 Change-Id: I4f4a275833ef513eb7aa56ec9660cf29e9212086 commit 49fd2a37ac089e497aacfbf76d1270a1cf1161f0 Author: Bessenyei Balázs Donát Date: Sat Oct 22 22:16:22 2016 +0200 Fix .travis.yml License was missing from .travis.yml, so RAT checks failed. This commit adds the license header to .travis.yml. After this change RAT passes again. This closes #74 Change-Id: I291709784921d835fc7deefe2f74051fd2d357f1 commit dbe0a6ae5ab47bdf784ba2c4c242e0eded279a62 Author: Bessenyei Balázs Donát Date: Sat Oct 22 21:39:54 2016 +0200 Add .travis.yml ASF infra has enabled Travis for Apache Flume. This change adds .travis.yml, because the option "Build only if .travis.yml is present" is turned on. With this commit, builds will run with -DskipTests. Change-Id: I374f43cf6e46b8d97e44192249961eb33738d7ca commit b9a0cd1e3e3390e3d6681261694a087449da6fbc Author: Mike Percy Date: Wed Oct 12 19:32:13 2016 +0200 Remove test dependencies from binary release artifact This patch removes some test-specific dependencies from the binary release artifact. These were introduced by the new flume-shared-kafka-test module that is intended for sharing test code. Please see the new comment in bin.xml for more information. Reviewers: Bessenyei Balázs Donát Closes #70 Change-Id: I158eb254ad97fb5b3bd5066cc4e1664d68fb98cf commit 1f6b929e2a7d96318959fa8b5906cc7e36c1e812 Author: Attila Simon Date: Wed Oct 12 19:21:28 2016 +0200 Update LICENSE The LICENSE file was outdated and missing some license texts This closes #68 Reviewers: Mike Percy, Bessenyei Balázs Donát (Attila Simon via Bessenyei Balázs Donát) Change-Id: Iffa2bf21043e680c36321b8b25cbcc3c4ce125f4 commit 5226e795bc4c5d62a4bea51891be50c260b74a80 Author: Denes Arvay Date: Tue Oct 11 16:23:51 2016 +0200 Add flume-shared module to assembly xmls Fixes the issue that the assembly plugin created the source package without the flume-shared project in it so maven compile failed on that. This closes #67 Reviewers: Mike Percy (Denes Arvay via Bessenyei Balázs Donát) Change-Id: I8c1bdb108b02665383289121a4641cfe009701b5 commit 2ae95234edf84fd78fb2ae8d6fb385a1ceb7a0e5 Author: Bessenyei Balázs Donát Date: Mon Oct 10 21:41:19 2016 +0200 Update CHANGELOG for 1.7 Change-Id: I066a995f9c3c75eaa4ec66f2eab3a27fc1d9fb5c commit 65f261fd0966ee5fb67cc931a7f0d056d3c20e6f Author: Bessenyei Balázs Donát Date: Mon Oct 10 21:17:53 2016 +0200 Update RELEASE-NOTES for 1.7.0 Change-Id: I81d8e90fc8ed8abd72e8be90f04532f267befb34 commit 4ba11278d376f1aeb4f55a5c98123a2709973191 Author: Attila Simon Date: Mon Oct 10 20:48:06 2016 +0200 FLUME-2971. Add secure Kafka Sink/Source/Channel setup to the User Guide The User Guide already has details about configuring Kafka channel to work with a kerberized Kafka cluster. This patch adds similar description for Kafka Sink and Kafka Source. Reviewers: Tristan Stevens, Mike Percy, Bessenyei Balázs Donát (Attila Simon via Bessenyei Balázs Donát) Change-Id: I41da8e5447bfd888c2c806cbf05e0b28908f7f0c commit 89c24433dd222cd837b9f54df213e996647d9bc1 Author: Andrea Rota Date: Thu Aug 4 10:09:16 2016 +0200 FLUME-2911. Add include pattern option in SpoolDir source * Documented what happens when ignorePattern and includePattern both match for a given file. * Added two tests to simulate what happens when both ignorePattern and includePattern options are specified * Refactored of ReliableSpoolingFileEventReader test and fix of code style violations Closes #60 Reviewers: Bessenyei Balázs Donát, Denes Arvay, Attila Simon (Andrea Rota via Mike Percy) Change-Id: I814296d6061ee53e66376a0cc8eabc536cfc1ebd commit 036eb400b69f2787babccac144770de908e28dd5 Author: Attila Simon Date: Fri Sep 30 12:01:12 2016 +0200 FLUME-2998. Add a missing configuration parameter to SequenceSource docs SequenceSource's totalEvents is configurable, but it is not in the documentation. This patch fixes that problem by adding the missing configuration parameter to the docs. Reviewers: Denes Arvay, Bessenyei Balázs Donát (Attila Simon via Bessenyei Balázs Donát) Conflicts: flume-ng-doc/sphinx/FlumeUserGuide.rst You are currently cherry-picking commit fca8c5b. Change-Id: I97a2f9152a63f6ac069c0ef8cbba38aea51c088a commit 0a3dfb58cee71e1d75945c49fd7ddeae0dd08642 Author: Siddharth Ahuja Date: Mon Sep 26 15:50:51 2016 +0200 FLUME-2966. Fix NPE in JMS Source JMS Source does not check for null text in a TextMessage. This can lead to NullPointerException. This commit fixes that problem by checking for nullity of textMessage.getText(). Reviewers: Denes Arvay, Attila Simon, Mike Percy, Bessenyei Balázs Donát (Siddharth Ahuja via Bessenyei Balázs Donát) Change-Id: If1f7a93ee17d0270d9c90c5315afb140c9d46b10 commit 0e9ba05c42b85a311ef3d22182e99c9852d6ef12 Author: Bessenyei Balázs Donát Date: Mon Aug 22 13:29:17 2016 -0700 FLUME-2974. Fix some broken SpoolDirSource unit tests TestReliableSpoolingFileEventReader and TestSpoolingFileLineReader were broken as part of commit b6dede8c108e0d8e3516767de31e3a847c69cfe0. This patch fixes them again. (Bessenyei Balázs Donát via Mike Percy) Change-Id: I57b66e7f53efeeceee90255c320d1b30688d0959 commit ab2bb11ddd5dfe9ec02fcf378be93646263bebf0 Author: Bessenyei Balázs Donát Date: Wed Aug 17 09:52:21 2016 -0700 FLUME-2318: Make SpoolingDirectorySource able to handle empty files (Muhammad Ehsan ul Haque and Bessenyei Balázs Donát via Mike Percy) Change-Id: I9ea07d80d882e8a2f7e2095b5e78aa7475f8b23b commit 75cb1237f1a45d820f9ee4276518f8242e6953fd Author: Bessenyei Balázs Donát Date: Mon Aug 8 18:09:44 2016 -0700 FLUME-2619. Spooldir source should log channel exceptions Reviewed by Denes Arvay and Mike Percy. (Bessenyei Balázs Donát via Mike Percy) Change-Id: I016e855d2ed5231c00c0a922f33ae257803b6a0e commit 228dffbfb3a0f0d742e5785ee2c837063d1842ef Author: lfzCarlosC Date: Thu Jul 28 22:04:19 2016 -0700 Fix various typos This closes #49 (Fonso Li via Mike Percy) Change-Id: I3ebcc81150282dfc02c6c3ef512035cca36124e7 commit 48c98dce86e74243360eae9da98c06fd4bafbbb3 Author: Lior Zeno Date: Wed Jul 27 11:49:43 2016 -0700 FLUME-2959. Fix issues with flume-checkstyle module * The lack of a parent POM caused warnings related to UTF-8 encoding * The XML files should have an ASL 2.0 license header (Lior Zeno via Mike Percy) Conflicts: flume-checkstyle/pom.xml You are currently cherry-picking commit 988ede9. Change-Id: I3003528f6e9bfb0477a04c1b61b914be295e5734 commit d6062533d27ea8752dded0371dd62bf475ed70b7 Author: Daniel Templeton Date: Tue Jul 26 01:09:31 2016 -0700 FLUME-2890. Typo in Twitter source warning Reviewed by Lior Zeno. (Daniel Templeton via Mike Percy) Change-Id: Ie80f2a33d030eaa4549a0b9264d23d8fffbc2d87 commit 18baf043ee6c0554cf6b7fdca54f8af47121ea3c Author: Roshan Naik Date: Wed Jul 20 16:36:14 2016 -0700 FLUME-2761. Move Hive sink out of preview mode Reviewed by Bessenyei Balázs Donát (Roshan Naik via Mike Percy) Change-Id: I88c3a140fcdaa20ee3ba7fbb3cbd8d13b6c4b1a5 commit 731d2a389c8bb5ef045f56283a1bbfcf9bd98c44 Author: Santiago M. Mola Date: Wed Jul 20 11:36:57 2016 -0700 FLUME-2514. Speed up TestFileChannelRestart tests TestFileChannelRestart tests are really slow. For example, testToggleCheckpointCompressionFromFalseToTrue and testToggleCheckpointCompressionFromTrueToFalse take ~4 minutes each. Some of them could be made faster by using channels with lower capacity. Reviewed by Bessenyei Balázs Donát (Santiago M. Mola via Mike Percy) Change-Id: I2b181ffc6381bc3d0e897dc3486e06569277b1b8 commit d40d6c726cb8e0db51de366df2a9a3920172d325 Author: wenqiao <315524513@qq.com> Date: Wed Jul 20 11:12:40 2016 -0700 FLUME-2955. Add file path to the header in TaildirSource Allow for adding a file path to the header dynamically. This is particularly useful when the filegroup path contains a regex expression. (tinawenqiao via Mike Percy) Change-Id: I22e0bae67d7de67a42fb02c0da8a7d4856298c43 commit bf9cd4b35dcbd96b8cca0b0fcc9b2c8a581b0e60 Author: Mike Percy Date: Tue Jul 19 12:42:10 2016 -0700 Fix broken link in README Change-Id: Iaaabcc5d8e3ae2d7ff7385c018e0cc102d05bfcb commit bde71ddf30a51bf8d8c5d168da08035d5d925702 Author: Jeff Holoman Date: Tue Jul 19 12:29:08 2016 -0700 FLUME-2810. Add static Schema URL to AvroEventSerializer configuration Currently the only way to pass a schema to the avro event serializer is via header. This introduces an option to specify the location directly in the Flume configuration. (Jeff Holoman via Mike Percy) Change-Id: I0b982ef051da1b6f7c084805b45d4973a341f282 commit a22bbd38f7cda10c11180a6b673acb5457a74e70 Author: Mike Percy Date: Mon Jul 11 19:53:50 2016 -0700 FLUME-2952. SyslogAgent: Avoid NPE on stop() Minor test bug fix Reviewed by Hari. Change-Id: I2132af61209aa91cbb747affa884c1b16c2968d3 commit 864b55a7e2ce80b33b6cdd0b79c8ca011f17877c Author: Denes Arvay Date: Wed Jul 13 12:07:24 2016 -0700 FLUME-2725. HDFS Sink does not use configured timezone for rounding (Denes Arvay via Mike Percy) Conflicts: flume-ng-core/src/test/java/org/apache/flume/formatter/output/TestBucketPath.java You are currently cherry-picking commit ec28b66. Change-Id: I4cc0c424ed20f971bbddd7c1ec5ad60072715a1d commit 1082798327c758dadad6a9d7571ec7d80260c3f6 Author: Lior Zeno Date: Sun Jul 10 15:03:08 2016 -0700 FLUME-2950. ReliableSpoolingFileEventReader.rollCurrentFile is broken FLUME-2939 introduced a Java 7 API (nio.file) to ReliableSpoolingFileEventReader. However, the committed patch breaks rollCurrentFile() on Windows machines. File rename might be not atomic, in such cases, and under the assumption that the rolled file and the current file store the same data, Flume only logs a warning and does not assume that the user broke the contract that the spooling directory source demands. In order to determine whether the files store the same data, we used the com.google.common.io.Files.equal() method. However, FLUME-2939 uses java.nio.file.Files.isSameFile() which has different semantics. Consequently, this relaxation does not hold anymore. In addition, TestSpoolingFileLineReader.testDestinationExistsAndSameFileWindows fails. This patch brings back the old check using Files.equal(). (Lior Zeno via Mike Percy) Change-Id: I58dc3e2ded7cd3e1ba88c020922e92bb32ae71be commit 0b340b14e3b4741d6222b404b074ce30162b2637 Author: Mike Percy Date: Sat Jul 9 15:05:33 2016 -0700 FLUME-2936. KafkaSource tests: Use loopback instead of host address TestKafkaSource is flaky because it tries to run Kafka on the host address instead of the loopback address. This patch fixes that problem. It also introduces a bug fix related to passing properties to KafkaSourceEmbeddedKafka. (Lior Zeno via Mike Percy) Conflicts: flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/KafkaSourceEmbeddedKafka.java You are currently cherry-picking commit 209c1e2. Change-Id: I6403184266569eac6e29d24e799162e46e576fa3 commit 3780bde74a9d31e0b1cb1867709b844dc78fcc92 Author: Mike Percy Date: Sat Jul 9 14:54:07 2016 -0700 FLUME-2949. checkstyle: Make suppressions compatible with Windows File paths in checkstyle-suppressions.xml are written with non-portable separators. Switching to "[/\\]" as a path separator should fix this issue. (Lior Zeno via Mike Percy) Change-Id: I43807b6fbca5a94e8265362c9165b2ae38d6a41e commit 0c0910feacff9ae3c31c6cf4ece79e60fce02a9e Author: Mike Percy Date: Fri Jul 8 17:32:09 2016 -0700 FLUME-2939. Update recursive SpoolDir source to use Java 7 APIs (Bessenyei Balázs Donát via Mike Percy) Change-Id: Ic7d65d456c180ac8059b2286466a89d96e31cd68 commit 44f3aab31d67154ead20750e08590cf86b20bc70 Author: Mike Percy Date: Wed Jun 29 21:18:20 2016 -0700 FLUME-2941. Integrate checkstyle for test classes Also make test code conform to style guidelines. Additionally, this patch makes style violations fatal to the build. This patch is whitespace-only from a code perspective. After stripping line numbers, the generated test bytecode before and after these changes is identical. Code review: https://reviews.apache.org/r/49830/ Reviewed by Hari. Conflicts: flume-checkstyle/pom.xml flume-ng-channels/flume-file-channel/src/test/java/org/apache/flume/channel/file/TestFileChannel.java flume-ng-channels/flume-spillable-memory-channel/src/test/java/org/apache/flume/channel/TestSpillableMemoryChannel.java flume-ng-core/src/test/java/org/apache/flume/channel/TestMemoryChannel.java flume-ng-core/src/test/java/org/apache/flume/source/TestSequenceGeneratorSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUdpSource.java flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestBucketWriter.java flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/TestKafkaSink.java flume-ng-sinks/flume-ng-kafka-sink/src/test/java/org/apache/flume/sink/kafka/util/KafkaLocal.java flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/KafkaSourceEmbeddedKafka.java flume-ng-sources/flume-kafka-source/src/test/java/org/apache/flume/source/kafka/TestKafkaSource.java You are currently cherry-picking commit cfbf115. Change-Id: I3023361f9e13dcc8901a35592da43358b266e7dd commit a12ac573d419dcd6023ff53ce25e766d0783f5ad Author: Mike Percy Date: Thu Jun 30 10:27:54 2016 -0700 Minor README tweaks Change-Id: I3f26dd9a030db4c64d533e574fba8e70689f95b7 commit c48e035301b7c04435f8d974dcaef5cea50ff3d2 Author: Attila Simon Date: Mon Jan 16 19:18:19 2017 +0100 Make sure build passes after backporting checkstyle change Change-Id: I6564c416065b5ad15b9c1c1b2b16dc16a3c1079d commit 385e40fa36e7baa6dc21b0d8ff7817bbe0cd8481 Author: Mike Percy Date: Sun Jun 26 02:57:37 2016 -0700 FLUME-2937. Integrate checkstyle for non-test classes Based on the Google checkstyle file with modifications. The changes here do not change the generated Java bytecode (after stripping line numbers). They are syntax / whitespace ONLY. Code review: https://reviews.apache.org/r/49403/ Reviewed by Hari. Conflicts: flume-ng-channels/flume-file-channel/src/main/java/org/apache/flume/channel/file/FileChannel.java flume-ng-channels/flume-kafka-channel/src/main/java/org/apache/flume/channel/kafka/KafkaChannel.java flume-ng-channels/flume-spillable-memory-channel/src/main/java/org/apache/flume/channel/SpillableMemoryChannel.java flume-ng-core/src/main/java/org/apache/flume/channel/MemoryChannel.java flume-ng-core/src/main/java/org/apache/flume/formatter/output/BucketPath.java flume-ng-core/src/main/java/org/apache/flume/source/ExecSource.java flume-ng-core/src/main/java/org/apache/flume/source/SequenceGeneratorSource.java flume-ng-embedded-agent/src/main/java/org/apache/flume/agent/embedded/EmbeddedAgent.java flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/BucketWriter.java flume-ng-sinks/flume-ng-kafka-sink/src/main/java/org/apache/flume/sink/kafka/KafkaSink.java flume-ng-sinks/flume-ng-kafka-sink/src/main/java/org/apache/flume/sink/kafka/KafkaSinkConstants.java flume-ng-sinks/flume-ng-morphline-solr-sink/src/main/java/org/apache/flume/sink/solr/morphline/BlobHandler.java flume-ng-sources/flume-kafka-source/src/main/java/org/apache/flume/source/kafka/KafkaSource.java pom.xml You are currently cherry-picking commit 2252fb1. Change-Id: I320895be26ea73f1d518339c3cc92d541036c314 commit e216a72cdf18e3d0b426fbbdbcf578b658b713cb Author: Santiago M. Mola Date: Wed Dec 3 18:30:56 2014 +0100 FLUME-2567. Remove external Maven repositories (Santiago M. Mola via Mike Percy) Conflicts: pom.xml You are currently cherry-picking commit 4eacba1. Change-Id: I92772545cefdff08b343947af54fe69b25b0a821 commit dc6832dd8c51c01544f3bd9f839d03b6e2c7b8cf Author: Dylan Jones Date: Tue Jun 14 21:35:47 2016 +0100 User guide: fix mistake and formatting change source to sink and fix formatting in Kafka Channel documentation (Dylan Jones via Mike Percy) Change-Id: Ib26acb08aefac2d65a8c70f84596cec037e0a23c commit d0097d966f7050f777d97d215a269998927b4795 Author: Roshan Naik Date: Wed Feb 17 14:11:44 2016 -0800 FLUME-2881. Windows Launch Script fails in plugins dir code (Jonathan Smith via Roshan Naik) Change-Id: I5c7abd43dfd41371b4398e75d4564036ef1c14a8 commit 0c35a2f7302378fb23e23ba0a401da668d8d4479 Author: Hari Shreedharan Date: Mon Feb 8 17:40:35 2016 -0800 FLUME-2875. Allow RollingFileSink to specify a file prefix and a file extension. (Ralph Goers via Hari) Change-Id: I6e84046be35242df6dc1123882953232570715bd commit dd4432accb826f7ebb6410a03ebb7370c48a33e9 Author: Johny Rufus Date: Sun Jan 17 10:25:41 2016 -0800 FLUME-2704. Configurable poll delay for spooling directory source (Somin Mithraa via Johny Rufus) Conflicts: flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySource.java flume-ng-core/src/main/java/org/apache/flume/source/SpoolDirectorySourceConfigurationConstants.java flume-ng-doc/sphinx/FlumeUserGuide.rst You are currently cherry-picking commit af63d38. Change-Id: Iedb415fe5164112560d8797086997f4b6a0bb6a4 commit 49337a14cfcace4fe31f74bace34741e37bf2310 Author: Jarek Jarcec Cecho Date: Fri Jan 15 08:23:14 2016 -0800 FLUME-2718: HTTP Source to support generic Stream Handler (Hari via Jarek Jarcec Cecho) Conflicts: flume-ng-core/src/main/java/org/apache/flume/source/http/BLOBHandler.java Change-Id: I6737c1f5555f2f63526495f7133de3ca029fa7a1 commit 92f86994fc571b487aab63e2b77a550bcaaf4ae3 Author: Roshan Naik Date: Tue Dec 29 13:02:13 2015 -0800 FLUME-2806. flume-ng.ps1 Error running script to start an agent on Windows (Liam Mousseau via Roshan Naik) Change-Id: Ie7a28061a65b8f63aefe6291f672a7a1e9fbcd4d commit b684e68f11c4fcbbd83b2314036fbc18bf8b3418 Author: Roshan Naik Date: Thu Dec 17 10:35:56 2015 -0800 FLUME-2801. Performance improvement on TailDir source (Jun Seok Hong via Satoshi Iijima and Roshan Naik) Conflicts: flume-ng-sources/flume-taildir-source/src/main/java/org/apache/flume/source/taildir/TailFile.java Change-Id: I4deeab0f36dade92ce5adf3944469dba924858b4 commit fb2cda3b2114e1ec02246fc4434dd9776fbd04e8 Author: Roshan Naik Date: Tue Nov 3 13:00:12 2015 -0800 FLUME-2835. Hive Sink tests need to create table with transactional property set (Sriharsha Chintalapani via Roshan Naik) Change-Id: I707b2eff45d90024c4e7b0d8ecbd3d7e73d4ae05 commit bd1443246179713a1e1dad7ea2ea3676965eb59f Author: Johny Rufus Date: Thu Oct 22 18:35:38 2015 -0700 FLUME-2593. ResettableFileInputStream returns negate values from read() method (Miroslav Holubec via Johny Rufus) Change-Id: Iad94ff2fca24ef8de3a6e29ff947d4616862f350 commit 0b273445b355c7b775d30971ca734ba66b83013e Author: Denes Arvay Date: Fri Oct 7 11:49:27 2016 +0200 FLUME-3003. Fix flaky testSourceCounter in TestSyslogUdpSource The event processing in SyslogUDPSource is handled on a separate thread by Netty so message delivery, thus the sourceCounter's increment can be delayed resulting in a flaky test. This patch fixes that issue by adding more delay when necessary. Reviewers: Lior Zeno, Bessenyei Balázs Donát (Denes Arvay via Bessenyei Balázs Donát) Change-Id: I01f6cc57c2f911d7ad9e8b8d5e2d320cbf48d69d commit 14cfe336126c05261e688d779336eb54b06523b7 Author: Denes Arvay Date: Thu Sep 8 10:00:55 2016 -0700 FLUME-2797. Use SourceCounter for SyslogTcpSource This patch uses the newer SourceCounter class for the SyslogTcpSource. It also marks the SyslogTcpSource as deprecated and improves how the unit tests are written so they don't require DNS. Reviewers: Attila Simon, Lior Zeno, Balázs Donát Bessenyei, Mike Percy (Denes Arvay via Mike Percy) Conflicts: flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogTcpSource.java flume-ng-core/src/test/java/org/apache/flume/source/TestSyslogUdpSource.java Change-Id: Iae631b68df390b0f03dba9399cba52cd8dae9eff commit 7139680858978c003e05cc5b60c2c94f4857fa07 Author: Roshan Naik Date: Fri Oct 2 16:07:12 2015 -0700 FLUME-2798. Malformed Syslog messages can lead to OutOfMemoryException (Phil D'Amore via Roshan Naik) Change-Id: Id77486753718298dc339e214e73cde773daaf337 commit 28d73a4aacf01e2cf9ade2f96aa3bd4cadf4b62a Author: Denes Arvay Date: Fri Oct 28 17:38:33 2016 +0200 FLUME-2812. Fix semaphore leak causing java.lang.Error: Maximum permit count exceeded in MemoryChannel bytesRemaining.release(putByteCounter) gets called in MemoryTransaction.doRollback while acquire is called only in doCommit. This results in semaphore leak and the number of permits in the semaphore eventually exceeds Integer.MAX_VALUE and Semaphore.release() throws java.lang.Error: Maximum permit count exceeded. This closes #83 Reviewers: Attila Simon, Bessenyei Balázs Donát (Denes Arvay via Bessenyei Balázs Donát) Change-Id: I0f4a34f751d1172ffc8aaf15cb8fcc18b0f57a76 Resolves: CDH-46928 backport commit a7c7536cc6199380182d81dda5453c14ac54ff9f Author: Roshan Naik Date: Mon Apr 25 12:43:31 2016 -0700 FLUME-2889: Fixes to DateTime computations (Tristan Stevens via Roshan Naik) Change-Id: I39ce6891477071523d1252b52a074da878c3735f Resolves: CDH-45134 backport commit 6a6e6cf68efa2fed1f5bb15db61db8e0610d2d84 Author: Roshan Naik Date: Thu Feb 25 17:31:24 2016 -0800 FLUME-2889. Fixes to DateTime computations (Roshan Naik via Hari Shreedharan) Change-Id: I864a5359527413d8ec1fc72a185e751526ae6f85 Resolves: CDH-45134 backport commit dc6cccde907e1b7a589251dbed1f1740f065c391 Author: Attila Simon Date: Tue Nov 22 18:49:07 2016 +0100 FLUME-3031. Change sequence source to reset its counter for event body on channel exception This patch improves rollbacks for the sequence source. Also, it updates tests and user documentation accordingly. This closes #90 Reviewers: Denes Arvay, Jeff Holoman, Bessenyei Balázs Donát (Attila Simon via Bessenyei Balázs Donát) Change-Id: I3546be18be604a4b626174f3b678230c20a29fdb Resolves: CDH-47625 backport commit 411e52cf7977f7f08cd4f96e054ccf309ce6e0fe Author: Jeff Holoman Date: Wed Nov 23 10:52:06 2016 -0500 FLUME-3027. Change Kafka Channel to clear offsets map after commit This change adds a call to clear the offsets map after a commit so as to avoid repeatedly committing already-committed offsets. Also updates various debug and trace log messages/calls to help with troubleshooting. This closes #92 Reviewers: Attila Simon, Bessenyei Balázs Donát (Jeff Holoman via Bessenyei Balázs Donát) Change-Id: I5a83f193284277d23ad6bb78644bfe4b2f27a52d commit 48499fd59f56db3840aa3a9b9e8ab6b9b2132777 Author: Tristan Stevens Date: Mon Oct 10 19:32:24 2016 +0200 FLUME-2999. Kafka channel and sink should enable statically assigned partition per event via header This feature is useful for anyone who needs greater control of which partitions are being written to - normally in a situation where multiple Flume agents are being deployed in order to horizontally scale, or alternatively if there is a scenario where there is a skew in data that might lead to one or more partitions hotspotting. We also have the ability to specify custom partitions on to the Kafka Producer itself using the kafka.* configuration properties. The Kafka Producer provides the ability to set the partition ID using a particular ProducerRecord constructor, this is just a matter of providing the option to use this constructor. Reviewers: Attila Simon, Mike Percy (Tristan Stevens via Mike Percy) Change-Id: I70310eb207be0136f7a56e4aeb4f7b3e7fbc3bd7 commit f31d3d8b17d20ded784d1208aa8d2e18f4832922 Author: Jenkins Date: Mon Nov 28 16:22:50 2016 -0800 Updating Maven version to 5.11.0-SNAPSHOT commit dabff98f32b1fa8bb07b998443506c7dee7f04df Author: Attila Simon Date: Thu Oct 27 13:31:40 2016 +0200 FLUME-2997. Fix flaky test in SpillableMemoryChannel When the mock sinks are slower than sources, testParallelSingleSourceAndSink sometimes fails. In such situations the channel can get full, thus uncaught ChannelFullException breaks the test. Since testCapacityWithOverflow was designed to cover such a scenario, we can safely fix the test by increasing the channel capacity to make sure it won't get full. This commit does the previously mentioned change. Reviewers: Bessenyei Balázs Donát (Attila Simon via Bessenyei Balázs Donát) Change-Id: Iee7280b861b490085fbf506d37113ae0a330fb5b commit bbfc6b80abbcd747033565f8448f35a48727f6dc Author: Bessenyei Balázs Donát Date: Mon Oct 24 14:27:08 2016 +0200 FLUME-3002. Fix tests in TestBucketWriter Some tests are flaky in TestBucketWriter. This commit fixes the flakiness mentioned before by adding a new constructor with an extra Clock parameter. Reviewers: Attila Simon, Denes Arvay Change-Id: Iee7280b861b490085fbf506d37113ae0a330fb4b commit 9c61531a132332c61134726436e2c8a4907cdbf0 Author: Mike Percy Date: Fri Oct 14 01:24:37 2016 +0200 Fix startup order for ExecSource This patch starts the SourceCounter in the ExecSource before starting the runner thread that processes input from the forked command. Starting the SourceCounter before calling its methods is required to get correct metric counts because the metrics are all reset to 0 when SourceCounter.start() is called. A follow-up patch will attempt to enforce that a SourceCounter or any other MonitoredCounterGroup is running at the time that calls to modify the metrics occur. After applying this patch, TestExecSource.testMonitoredCounterGroup no longer fails. This closes #72 Reviewers: Attila Simon, Bessenyei Balázs Donát (Mike Percy via Bessenyei Balázs Donát) Change-Id: Iee7280b861b490085fbf506d37113ae0a330fb3b commit 2aa1a8dafa3ac6efe6b1e3a5f0b905ac193ca598 Author: Denes Arvay Date: Fri Oct 7 11:49:27 2016 +0200 FLUME-3003. Fix flaky testSourceCounter in TestSyslogUdpSource The event processing in SyslogUDPSource is handled on a separate thread by Netty so message delivery, thus the sourceCounter's increment can be delayed resulting in a flaky test. This patch fixes that issue by adding more delay when necessary. Reviewers: Lior Zeno, Bessenyei Balázs Donát (Denes Arvay via Bessenyei Balázs Donát) Change-Id: Iee7280b861b490085fbf506d37113ae0a330fb2b commit 046968e3af7d0c71b553070cad431140697ba1e3 Author: Gabriel Commeau Date: Sun Nov 20 17:34:48 2016 -0500 FLUME-2171. Add Interceptor to remove headers from event Similar to Flume OG decorators, this introduces an Interceptor to remove headers from an event. Reviewers: Bessenyei Balázs Donát, Jeff Holoman, Denes Arvay, Attila Simon (Gabriel Commeau and Bessenyei Balázs Donát via Jeff Holoman) Also fixed the Remove Header Interceptor table in the Flume User Guide. Change-Id: I0222275b05b89069e7680334f6094e2793607438 commit b2080d0993b8a39592cc1d631217b4c535f02134 Author: Denes Arvay Date: Mon Nov 21 21:28:22 2016 +0000 FLUME-3025. Expose FileChannel.open on JMX This patch exposes the FileChannel's open flag on JMX to make it possible to detect when it wasn't able to start up. In those cases the open flag is false. This closes #85 Reviewers: Attila Simon, Bessenyei Balázs Donát (Denes Arvay via Bessenyei Balázs Donát) Change-Id: I3f3977bf284409942016ab134baca860575db84a commit 68a71538f46cf4991a904b706f613c41b3e6ca78 Author: Theodore michael Malaska Date: Wed Nov 9 23:37:23 2016 +0000 FLUME-3020. Improve HDFS Sink escape sequence substitution When using escape sequences, the current code will call InetAddress for every event which results in a huge impact to performance. This patch fixes that issue by caching the local host in a static variable. We can do this because there is zero chance the local host will change for a life of a JVM. Reviewers: Hari Shreedharan, Jeff Holoman, Bessenyei Balázs Donát (Theodore michael Malaska via Bessenyei Balázs Donát) Change-Id: Id9e46034bf980a379e6c942be6d751a2301b3868 commit ccd717139e522021ab9c76f6cb5bc75e7f259271 Author: Denes Arvay Date: Wed Aug 17 11:00:16 2016 -0700 FLUME-2844. SpillableMemoryChannel must start ChannelCounter Reviewed by Bessenyei Balázs Donát (Denes Arvay via Mike Percy) Change-Id: I8c6ca9662124f2431d930bb8bf6e6cecf3aac286 commit 978543343225addb62639011f5d353fdb496c2ad Author: Denes Arvay Date: Thu Sep 8 10:00:55 2016 -0700 FLUME-2797. Use SourceCounter for SyslogTcpSource This patch uses the newer SourceCounter class for the SyslogTcpSource. It also marks the SyslogTcpSource as deprecated and improves how the unit tests are written so they don't require DNS. Reviewers: Attila Simon, Lior Zeno, Balázs Donát Bessenyei, Mike Percy (Denes Arvay via Mike Percy) Change-Id: I4e7f4772f5873c561c5ed24774e7d8f1a93001e2 commit c0964fd3f177b2a24bd1fea3bd588e391e034121 Author: Bessenyei Balazs Donat Date: Wed Aug 31 20:12:23 2016 -0700 FLUME-2982. Add localhost escape sequence to HDFS sink It would be useful to be able to just use %[localhost] escape sequence instead of having to pass in a header or use the host interceptor. Part of the problem of using an interceptor is the case where Flume only consists of a channel and a sink (think KafkaChannel). There is support in Flume for a sink-side interceptor at the time of this writing. Reviewers: Grant Henke, Mike Percy (Jeff Holoman via Mike Percy) Change-Id: I65bab4d975901d4a1bc18a61b5665c0998872bdd commit 257680d209bd0656350cbde27e846932c1658369 Author: Attila Simon Date: Fri Sep 2 21:29:42 2016 +0200 CDH-43892: fix packaging for deb which requires the README file Change-Id: I062623b5c7c427a41565992705e85cdda3f66411 commit 5242272ecab1ebf51aa5c93e40348da76dab7c18 Author: Mike Percy Date: Mon Jun 27 02:14:40 2016 -0700 Move README.textile to README.md and add license header The version of textile implemented by GitHub doesn't appear to support a comment syntax. Change-Id: I5d4df30e1a63a03888ae20f7391dde1cac9402d9 commit 9b416180a3ab2b4842549de3d2c1473069d57bd1 Author: Grant Henke Date: Wed Aug 31 18:44:00 2016 -0700 FLUME-2983. Handle offset migration in the new Kafka Source Similar to FLUME-2972, offsets tracking the position in Kafka consumers change from using zookeeper for offset storage to Kafka when moving from 0.8.x to 0.9.x. FLUME-2821 makes the client change in the Kafka Source but does not ensure existing offsets get migrated in order to continue consuming where it left off. Flume should have some automated logic on startup to check if Kafka offsets exist, if not and migration is enabled (by default) then copy the offsets from Zookeeper and commit them to Kafka. This change should also fix the backwards incompatibility caused by removing the zookeeperConnect property. The bootstrap can be looked up if zookeeperConnect is used. Reviewers: Denes Arvay, Mike Percy (Grant Henke via Mike Percy) Change-Id: I809c055a62b2f98e348fcc8b2d8f055038e756ac commit 7dc6e23a0c841c412b18dc9506c4b7b18c399376 Author: Mike Percy Date: Sun Jun 26 14:17:37 2016 -0700 FLUME-2935. Bump java target version to 1.7 * Renamed README to README.textile in order to allow GitHub to properly render the headings. Also changed the min. requirement to JDK 1.7 * pom.xml: * Changed the sourceJavaVersion and targetJavaVersion to 1.7 * Removed the test dependency hadoop-minicluster since it is already required as a "normal" dependency. This was causing Maven warnings * flume-ng-elasticsearch-sink/pom.xml: pom file had two identical dependencies, causing Maven warnings * FlumeUserGuide.rst: changed the system requirements to Java 1.7 * KafkaLocal.java: The tests threw a MethodNotFoundException, since there isn't a constructor for KafkaConfig with a java.util.properties parameter. Instead, I used the static method KafkaConfig.fromProps. (Lior Zeno via Mike Percy) Change-Id: I520566ffc3f7a5b37be584ae8cbf58969a27ae61 commit 1df49b3342c96b49d987af55fc399a1422fe335d Author: Roshan Naik Date: Tue Aug 9 15:56:39 2016 -0700 FLUME-2901. Document Kerberos setup for Kafka channel Add details about configuring Kafka channel to work with a Kerberized Kafka cluster. (Roshan Naik via Mike Percy) Change-Id: If807fb8904dc1f1c136c48033f861911bc3687d0 commit ef0915db9053174d05316b4c1f05eb6c06622a0d Author: Bessenyei Balázs Donát Date: Sun Aug 21 12:34:52 2016 -0700 FLUME-2975. docs: Fix NetcatSource example (Bessenyei Balázs Donát via Mike Percy) Change-Id: I2cbaf553b07a1bf5ef3aa9a5f9d47b2f70466d3a commit c17558e04c2eb47075578d7053dd6239687f1c18 Author: Denes Arvay Date: Fri Jul 29 15:16:54 2016 -0700 FLUME-2963. FlumeUserGuide: Fix error in Kafka Source properties table (Denes Arvay via Mike Percy) Change-Id: I11ac87a1b8c42ced889655cc635b2a9ee7882af2 commit 587d5eb5816ae59384ba000d89e6a1a16de812c2 Author: Mike Percy Date: Tue Jul 19 13:33:58 2016 -0700 Fix sphinx layout errors Minor syntax error fixes Change-Id: I7c73a0128ff11e4b33882fab398335f27f967b54 commit 027754b9afb586bb962d09d29a579218b144b909 Author: Niccolo Becchi Date: Fri Jul 8 11:18:47 2016 +0100 FLUME-2948. docs: Fix parameters on Replicating Channel Selector example This closes #55 (Niccolo Becchi via Mike Percy) Change-Id: I8a462b9e5e7968f4edd4e318e7f07c6801a43406 commit 0cc6bd2c437b5dcf0cc4c1c21ab1a0b66492c8cc Author: Mike Percy Date: Fri Jun 24 16:39:35 2016 -0700 FLUME-2934. Document new cachePatternMatching option for TaildirSource (Attila Simon via Mike Percy) Change-Id: I517487450325ab492d67a78f4e5cf19c30d6e684 commit 178cdbb302effce6b3a09396a3ff267121a50f29 Author: Hari Shreedharan Date: Wed Apr 15 22:54:05 2015 -0700 FLUME-2652. Documented transaction handling semantics incorrect in developer guide. (Graham Gear via Hari) Change-Id: I2cfdea6c2a75c27683c1060022484fdb97547d20 commit d462fc1bd945f035fd8b37fa478f2662440f8467 Author: Attila Simon Date: Mon Aug 29 12:15:56 2016 -0700 FLUME-2954. Make raw data appearing in log messages explicit Flume has built-in functionality to log data flowing through, mainly for debugging purposes. This functionality appears in several places in the code base. Such functionality can raise security concerns in production environments where sensitive information might be ingested so it is crucial that enabling such functionality be as explicit as possible. This patch adds two system properties, one to enable logging of Flume configuration properties and one to enable logging of raw data. If they are not set, these items are never logged at any log4j logging level. Reviewers: Balázs Donát Bessenyei, Denes Arvay, Mike Percy (Attila Simon via Mike Percy) Change-Id: I3f21c7963631f0ac2fb2b4953180a442a558bdca commit acdc8781520e00eb54145bb88d8ba124ce7df161 Author: Grant Henke Date: Thu Aug 25 16:48:25 2016 -0700 FLUME-2972. Handle offset migration in the new Kafka Channel Offsets tracking the position in Kafka consumers change from using Zookeeper for offset storage to Kafka when moving from Kafka 0.8.x to 0.9.x. FLUME-2823 makes the client change in the Kafka Channel but does not ensure existing offsets get migrated in order to continue consuming where it left off. Flume should have some automated logic on startup to check if Kafka offsets exist, if not and migration is enabled (by default) then copy the offsets from Zookeeper and commit them to Kafka. Reviewers: Balázs Donát Bessenyei, Denes Arvay, Mike Percy (Grant Henke via Mike Percy) Change-Id: Ie4f58d72344abdcaf3e269c22015167281c74d83 commit bb3bb5fae079b36d9223f2c97fc9fc9e27b250fb Author: Jenkins Date: Thu Aug 18 13:43:26 2016 -0700 Updating Maven version to 5.10.0-SNAPSHOT commit 427c173895fa26fa85b411af0eb6c837d23cf4af Author: Kevin Conaway Date: Thu Jun 9 15:50:13 2016 -0400 FLUME-2922. Sync SequenceFile.Writer before calling hflush This closes #52 (Kevin Conaway via Mike Percy) Change-Id: I7a6eaaf379e671aa80cea1a842b4b0859856047e commit e57c7f5ac7bfe081a0ec676be88d4cab7ec02320 Author: Mike Percy Date: Fri Jun 17 15:32:09 2016 -0700 FLUME-2923. Bump asynchbase version to 1.7.0 Newer versions of HBase and the asynchbase library support error types such as RegionMovedException. Also, asynchbase has incorporated several fixes since version 1.5.0. See https://github.com/OpenTSDB/asynchbase/blob/v1.7.0/NEWS (Bessenyei Balázs Donát via Mike Percy) Change-Id: Ic79f4a4b3773307be90129359b6fa68b3cc02ef3 commit f9b26a692f57a01e0984bd629178895ec4dc79cb Author: Mike Percy Date: Tue Jun 28 13:44:51 2016 -0700 FLUME-1899. Make SpoolDir work with subdirectories (Phil Scala and Bessenyei Balázs Donát via Mike Percy) Change-Id: I591af946dc6fe4ab91cd72e14e9ad6edfdf2092e commit 97be8528005b8a846fa2bc110d04a38ad0fa7fdb Author: Mike Percy Date: Mon Jun 20 01:09:07 2016 -0700 FLUME-2918. Speed up TaildirSource on directories with many files This patch greatly improves the performance of TaildirSource on directories that contain a large number of files. (Attila Simon via Mike Percy) Change-Id: Ifc19657e3585cde0d857c327c15dec5b2cedb75b commit ec64de374878b896b66fb6edb1594bfb054fb88a Author: Mike Percy Date: Fri Jun 10 12:52:29 2016 -0700 FLUME-2910. AsyncHBaseSink: Failure callbacks should log the exception that caused them (Abraham Fine via Mike Percy) Change-Id: Idbd57b330ea4371b424a56751c590650c17fa741 commit 815cfe523cd1f15cc5f97fe52ee0caee2dfddcec Author: Mike Percy Date: Fri May 27 12:10:41 2016 -0700 FLUME-2913. Don't strip SLF4J from imported classpaths It is no longer necessary to strip other versions of SLF4J from classpaths imported from hadoop or hbase. With recent versions of SLF4J, when multiple connectors are found, one of them "wins" and the logging does not break. A warning is printed once, however. This is acceptable because having too long of a classpath can cause major problems on systems with a low ARG_MAX. (Bessenyei Balázs Donát via Mike Percy) Change-Id: I739430203ea063e21a84ef729c614b5e4ae5fb85 commit b43394efe88f474c7b6aa66590605389cef4dfcc Author: Jarek Jarcec Cecho Date: Fri Jun 10 15:52:20 2016 +0200 FLUME-2920: Kafka Channel Should Not Commit Offsets When Stopping (Kevin Conaway via Jarek Jarcec Cecho) Change-Id: I3352a09d78b692e322aa44c85fb36233f6349787 commit 76dea820eb46bacf345e2a8d5c06c02c08d5e339 Author: Jarek Jarcec Cecho Date: Fri Jun 10 15:34:24 2016 +0200 FLUME-2915: The kafka channel using new APIs will be stuck when the sink is avro sink (Jeff Holoman via Jarek Jarcec Cecho) Change-Id: Ia6fb5dbe4a1140b0480c24307dcd4171cd62d269 commit 23e371807d22934c1e4f9fd4f5ccc5040ac1628c Author: Mike Percy Date: Fri May 27 12:10:41 2016 -0700 FLUME-2913. Don't strip SLF4J from imported classpaths It is no longer necessary to strip other versions of SLF4J from classpaths imported from hadoop or hbase. With recent versions of SLF4J, when multiple connectors are found, one of them "wins" and the logging does not break. A warning is printed once, however. This is acceptable because having too long of a classpath can cause major problems on systems with a low ARG_MAX. (Bessenyei Balázs Donát via Mike Percy) commit db344ed106d336521376287a14a9900bb0497c21 Author: Mike Percy Date: Wed May 18 10:38:29 2016 -0700 FLUME-2909. Upgrade RAT to 0.11 This allows command-line override of RAT using the command mvn -Drat.skip=true which is useful in a development environment. (Bessenyei Balázs Donát via Mike Percy) Change-Id: I0cbf36c57a3079ed8f7d24f2a02b92e5e055eea4 commit e246e0120bb4d46baebb4e1fbdc3b312c8b8546f Author: Jarek Jarcec Cecho Date: Thu Apr 21 13:37:26 2016 -0700 FLUME-2852: Kafka Source/Sink should optionally read/write Flume records (Tristan Stevens via Jarek Jarcec Cecho) Change-Id: Ie688f802c347270ec28aa98cb901e52d95a286e7 commit 35b54839fdae952c2464fc74855eff1bb5f321ff Author: Jenkins Date: Mon May 16 14:00:51 2016 -0700 Update to 5.9.0-SNAPSHOT on Mon May 16 14:00:09 PDT 2016 JOB_NAME : 'Cut-Release-Branches' BUILD_NUMBER : '333' CODE_BRANCH : '' OLD_CDH_BRANCH : 'cdh5' Pushed to remote origin git@github.sf.cloudera.com:CDH/flume-ng.git (push) commit f4c065c53fa3fa6cc75af51c24fb63e6e982755a Author: Grant Henke Date: Fri May 13 10:08:06 2016 -0500 FLUME-2908: NetcatSource - SocketChannel not closed when session is broken Change-Id: Ic412218d67682e032724d9280fc38bc87d48f33d commit 9d386e515eb189bb7f6fc3b6a0e6810fe6c8d1a3 Author: Abraham Fine Date: Fri May 6 14:26:59 2016 -0700 CLOUDERA-BUILD. CDH-40031: [FLUME] Upgrade to 0.9.3 version of libthrift Change-Id: I76a6d91ab2c9c1f5f73824b53a86d568e71a4043 commit 9fddd649c2229244520aab29d1a56ab62b5139b4 Author: Jarek Jarcec Cecho Date: Thu Mar 31 10:08:54 2016 -0700 CLOUDERA-BUILD. Forcing KafkaSourceEmbeddedKafka to use localhost Change-Id: Ia081ff9bddcf96b1a03206be2fdeb6907daa733b CDH-35364: [FLUME] Migrate to 0.9.0 version of Kafka and provide components with new producer and consumer commit 8e2dfc49ccaf060bc4a7eba2a53fc030a92c1966 Author: Jarek Jarcec Cecho Date: Tue Mar 29 11:44:29 2016 -0700 CLOUDERA-BUILD. CDH-35364: [FLUME] Migrate to 0.9.0 version of Kafka and provide components with new producer and consumer Compatibility for CDK 2.0 (e.g. 0.9.0.0 rather then 0.9.0.1) Change-Id: I14bf2cffb40af41536a87aef40cd5d75b193abfb commit 394cf2911d7532f44794884c8b86b47be0a7df2d Author: Jarek Jarcec Cecho Date: Wed Mar 30 11:28:44 2016 -0700 CLOUDERA-BUILD. Display versions used for precommit hook Change-Id: I956fff4b022b702b3e970dc4a6364d07642bd099 commit 51d926f1838f63be7b7ac4275562ca3cd717c63b Author: Jarek Jarcec Cecho Date: Tue Mar 29 09:45:40 2016 -0700 FLUME-2823: Flume-Kafka-Channel with new APIs (Jeff Holoman via Jarek Jarcec Cecho) Change-Id: I25ec520bb01a865013c6083bf9e2e41667bc9700 commit 0c99803713181cd5290cca71963a8509c1b52b26 Author: Jarek Jarcec Cecho Date: Tue Mar 29 09:43:40 2016 -0700 FLUME-2822: Flume-Kafka-Sink with new Producer (Jeff Holoman via Jarek Jarcec Cecho) Change-Id: I415b92eb588a780ec3ed25c96d032329fbef2e63 commit 962523b554249e77dfe4b2e8b57ae07fa414518a Author: Jarek Jarcec Cecho Date: Tue Mar 29 09:42:24 2016 -0700 FLUME-2821: Flume-Kafka Source with new Consumer (Grigoriy Rozhkov via Jarek Jarcec Cecho) Change-Id: I0e0528f046236a0290cd7df4476f599b903c8c5e commit af803fc62fd5c81d4df15307aebacfcbe1f98afa Author: Jarek Jarcec Cecho Date: Tue Mar 29 10:59:07 2016 -0700 CLOUDERA-BUILD. Revert "CLOUDERA-BUILD. Switch build to use Cloudera Distribution of Kafka 2.0" This reverts commit 657507bd66715165c6079c1dab22056360459ab4. Change-Id: I4701f2cefa2f888392f3311e4a717827d31173dd commit f54f15761af2f656fd93ec1adde02a889c2633f6 Author: Jarek Jarcec Cecho Date: Tue Mar 29 08:10:31 2016 -0700 FLUME-2897: AsyncHBase sink NPE when Channel.getTransaction() fails (Mike Percy via Jarek Jarcec Cecho) Change-Id: I5ac5a32637afd097048691ee7d78b2f11bc4b1c1 commit 1c0e47abf316859c29824b386f91bfb355391a14 Author: Jarek Jarcec Cecho Date: Wed Mar 9 11:05:01 2016 -0800 FLUME-2891: Revert FLUME-2712 and FLUME-2886 (Hari Shreedharan via Jarek Jarcec Cecho) Change-Id: Ib41d9178b15a8412b8abcac8f6ffd6b25e28e0a0 commit 3dfa3a63acc3d64316935b6e7efb922a68caf971 Author: Jarek Jarcec Cecho Date: Tue Feb 23 08:17:34 2016 -0800 FLUME-2886: Optional Channels can cause OOMs (Hari Shreedharan via Jarek Jarcec Cecho) Change-Id: I6c4d8b068d2187d5274dcbd999759aa909cad90d commit 6e8ed8fbc206d356540ab9fe5d92bbcbee65d01d Author: Hari Shreedharan Date: Thu Oct 8 18:28:31 2015 -0700 FLUME-2781. Kafka Channel with parseAsFlumeEvent=true should write data as is, not as flume events. (Gonzalo Herreros via Hari) Change-Id: I26939154b9d1660930be34e39095db046768072c commit fadc2f00961e038af61186bc652a4eccc588e949 Author: Jarek Jarcec Cecho Date: Thu Feb 18 12:11:56 2016 -0800 CLOUDERA-COMMIT. Add PATCH.txt to rat ignore list CDH-37375: Add PATCH.txt to rat ignore list Change-Id: I9633c42188cf96f767085541b68e05698b577813 commit f3b20873c0882b45171a259c8b2a571b396422e6 Author: Johny Rufus Date: Wed Oct 21 15:18:42 2015 -0700 FLUME-2632: High CPU on KafkaSink (Ashish Paliwal via Johny Rufus) Change-Id: I5d11cc706db424c560fdd9f4945a34529897f8f9 commit 9d6215dccc4287636270e3130775300144a2413b Author: Jarek Jarcec Cecho Date: Sun Feb 14 11:46:15 2016 -0800 CLOUDERA-BUILD. Removing no longer used build profile from pre-commit hook Change-Id: Ie7c541b85517ee40047ea154a6cd2b74a2b0eab6 CDH-37246: Flume tests are regularly failing on HBase tests commit dadf965b241a1810e780f1dcf22d1451ea8b23d6 Author: Hari Shreedharan Date: Fri Oct 30 16:36:40 2015 -0700 FLUME-2712. Optional channel errors slows down the Source to Main channel event rate (Johny Rufus via Hari) Change-Id: I4a820aa6854d150cf283ba0c46a53b6c30bfbe64 commit 668659ebb270dae757bccff1f5fcb2ded9c4c136 Author: Jenkins Date: Fri Feb 12 20:26:36 2016 -0800 Updating Maven version to 5.8.0-SNAPSHOT commit 657507bd66715165c6079c1dab22056360459ab4 Author: Jarek Jarcec Cecho Date: Thu Feb 11 15:53:10 2016 -0800 CLOUDERA-BUILD. Switch build to use Cloudera Distribution of Kafka 2.0 Change-Id: I5a2f667ab8f1c5268c71d8502f68ecf52510365f CDH-31716: Flume should depend on CDH Kafka and not on Apache Kafka commit 150f5c4df4596163695477496c560c1c01435501 Author: Jarek Jarcec Cecho Date: Wed Nov 18 07:37:01 2015 -0800 FLUME-2841: Upgrade commons-collections to 3.2.2 (Hari Shreedharan via Jarek Jarcec Cecho) Change-Id: If6cca667adae85a5a56d95995a639ddf1d821a89 commit 0c99387e9502581f361b2b5dc34f4b5bc3235cac Author: Jarek Jarcec Cecho Date: Fri Oct 9 08:01:34 2015 -0700 CLOUDERA-BUILD. Add pre-commit test script Change-Id: Ia64587e009d212b32c2dea888426e2dc8e627fa4 commit 5e08d741626307528f8410ea6b772f8bb8160dbc Author: Jarek Jarcec Cecho Date: Wed Sep 30 09:34:31 2015 -0700 FLUME-2734: Kafka Channel timeout property is overridden by default value (Johny Rufus via Jarek Jarcec Cecho) commit 85fd2449e99ed4d19d124a23874b58942653e0c3 Author: Jarek Jarcec Cecho Date: Wed Sep 30 09:20:29 2015 -0700 FLUME-2751: Upgrade Derby version to 10.11.1.1 (Johny Rufus via Jarek Jarcec Cecho) commit 40a5516d9807eeb655443a48dd6f6c3750fd0e0c Author: Roshan Naik Date: Tue Sep 29 14:43:34 2015 -0700 FLUME-2804. Hive sink - abort remaining transactions on shutdown (Sriharsha Chintalapani via Roshan Naik) commit ef38513ebce3ebd8709256d7733abe2529a4a68b Author: Hari Shreedharan Date: Thu Sep 24 22:45:04 2015 -0700 FLUME-2773. TailDirSource throws FileNotFound Exception if ~/.flume directory is not created already (Johny Rufus via Hari) commit 8d7822d4f720d9b53c8f68778017363ed463476a Author: Johny Rufus Date: Mon Sep 21 13:43:50 2015 -0700 FLUME-2095. JMS source with TIBCO (Michelle Casbon via Johny Rufus) commit 0b916598b0c4bbef9efdd289b8bacedb1e5ba15c Author: Johny Rufus Date: Tue Sep 15 18:35:28 2015 -0700 FLUME-2672. NPE in KafkaSourceCounter (Rigo MacTaggart via Johny Rufus) commit 22f386fc212a9ba23f5e82fbdd2602ecd9dda1e7 Author: Roshan Naik Date: Tue Aug 25 18:38:14 2015 -0700 FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions (Deepesh Khandelwal via Roshan Naik) commit 8de1cc9f477c0fbec16e20995358cc7f401ec868 Author: Johny Rufus Date: Thu Aug 20 08:11:13 2015 -0700 FLUME-2763. flume_env script should handle jvm parameters like -javaagent -agentpath -agentlib ( Philip Zeyliger, Neerja Khattar via Johny Rufus) commit d0b23b343f07e41b8782574ec483bb3ee399be42 Author: Jenkins Date: Fri Sep 4 15:15:34 2015 -0700 Updating Maven version to 5.7.0-SNAPSHOT commit 0dbde12ecd28dbe4c497b197db5b7ddd7d39465a Author: Andrew Bayer Date: Thu Sep 3 21:16:43 2015 -0700 CLOUDERA-BUILD - use cdh.spark.version commit 5fca338ee4f3066596ba4612b4d01a76f6d16f5a Author: Johny Rufus Date: Thu Aug 27 16:22:35 2015 -0700 CLOUDERA-BUILD. Tail Directory source related pom.xml changes commit 8ae19374460bacce2e334e196f1ea71feebb3c72 Author: Roshan Naik Date: Mon Aug 17 19:34:03 2015 -0700 FLUME-2498. Implement Taildir Source (Satoshi Iijima via Roshan Naik) commit c998d0c12e83b77b4320fb4f3bef791a840dbec8 Author: Ashish Date: Thu Aug 6 13:55:43 2015 -0700 FLUME-2753 Error when specifying empty replace string in Search and Replace Interceptor (Johny Rufus via Ashish Paliwal) commit 0541f737459f17e8aee09f5af1c7a67d2bec5435 Author: Johny Rufus Date: Wed Aug 5 07:55:51 2015 -0700 FLUME-2485. Thrift Source tests fail on Oracle JDK 8 (Miroslav Holubec via Johny Rufus) commit e8301c7933f8fa9b66e8e097dc7156f077895ea6 Author: Johny Rufus Date: Wed Jul 29 15:02:33 2015 -0700 FLUME-2660. Add documentation for EventValidator. Fixed doc formatting issue (Ashish Paliwal via Johny Rufus) commit 22c25c9e0cbad3e77239035d187b06a55ed3f18c Author: Hari Shreedharan Date: Mon Jul 27 21:41:07 2015 -0700 FLUME-2749. Fix kerberos configuration error when using short names in multiple HDFS Sinks (Johny Rufus via Hari) commit ee827dfa6ea2ef0b29bcd49575c092fa73c9ce49 Author: Johny Rufus Date: Thu Jul 23 23:58:12 2015 -0700 FLUME-2660. Add documentation for EventValidator (Ashish Paliwal via Johny Rufus) commit a06797ed26842b90bfd5fc93a8d659d92c7f533e Author: Johny Rufus Date: Mon Jul 13 18:01:10 2015 -0700 FLUME-2628. Add an optional parameter to specify the expected input text encoding for the netcat source (Lionel Herbet via Johny Rufus) commit 1324da41cd895950ab69eb2dfcd8ce0eea519558 Author: Jarek Jarcec Cecho Date: Tue Jul 14 09:29:30 2015 -0700 FLUME-2737: Documentation for Pollable Source config parameters introduced in FLUME-2729 (Ted Malaska via Jarek Jarcec Cecho) commit d795e76a90a4b943aea2fe29896a8f05866d7e28 Author: Hari Shreedharan Date: Thu Jul 9 12:21:17 2015 -0700 FLUME-2738. Fix file descriptor leak in AsyncHBaseSink when HBase cluster goes down. (Johny Rufus via Hari) commit 05cf76f13cab47016ce24b70ca5c66c7546c5357 Author: Hari Shreedharan Date: Tue Jul 7 21:44:01 2015 -0700 FLUME-2732. Make maximum tolerated failures before shutting down and recreating client in AsyncHbaseSink configurable (Johny Rufus via Hari) commit 2f528dcfc79daf4b6e4934eba0b72b1af8b85285 Author: apaliwal Date: Tue Jul 7 16:53:46 2015 -0700 Patch for FLUME-2713 commit 2baa0b01b677881497695cd30d172830793e3ad7 Author: Johny Rufus Date: Mon Jul 6 16:19:41 2015 -0700 FLUME-2729. Allow pollableSource backoff times to be configurable (Ted Malaska via Johny Rufus) commit 2849e8b934dce080be6a4562af40d0cb0a7f91b7 Author: Johny Rufus Date: Fri Jul 3 11:22:38 2015 -0700 FLUME-2575. FLUME-2548 brings SSLv2Hello back for Avro Sink, but UG says it is one of the protocols to exclude (Li Xiang via Johny Rufus) commit a4da45618b276e7e95de2f9a19f4c98375db20e1 Author: Hari Shreedharan Date: Wed May 27 09:58:23 2015 -0700 FLUME-2215. ResettableFileInputStream can't support ucs-4 character (Alexandre Dutra via Hari) commit 411f723175c75d7b0d6774c9afeede0f0c39bf90 Author: Johny Rufus Date: Wed Jul 22 11:57:30 2015 -0700 CLOUDERA-BUILD. Backports for CDH build