commit 8bce4bd28a464e0a92950c50ba01a9deb1d85686 Author: David S. Wang Date: Wed Feb 13 15:31:42 2013 -0800 HADOOP-9303. command manual dfsadmin missing entry for restoreFailedStorage option (Andy Isaacson via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1445657 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 00b2b7f076056b0d47319b21cbea6d11fee841da) commit e98e9ba94ff118b130f55061d393d46c3dd81964 Author: David S. Wang Date: Wed Feb 13 15:21:47 2013 -0800 HADOOP-9302. HDFS docs not linked from top level (Andy Isaacson via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1445648 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 90088136fdcd6dfa457bc3956161e145c74299f9) commit 0a87c11b8a91a0d441270a1705a5ae7b6b091fe6 Author: David S. Wang Date: Wed Feb 13 15:05:05 2013 -0800 HADOOP-8427. Convert Forrest docs to APT, incremental. (adi2 via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1425527 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ff941e77f871e0737c6db8ee2620c17e7ec28512) commit a0a03303905198624c1717bd8f8f55b9ef925950 Author: David S. Wang Date: Wed Feb 13 14:35:30 2013 -0800 Merge -r 1407657:1407658 from trunk to branch-2. Fixes: HADOOP-8860. Split MapReduce and YARN sections in documentation navigation. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408290 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 07b3f85080186b5bf3c2ce3f4a8552511f554335) commit dec78dc05888036cab6e617bbc0692df0430c3a7 Author: Aaron Twining Myers Date: Wed Feb 13 19:46:27 2013 +0000 HADOOP-9305. Add support for running the Hadoop client on 64-bit AIX. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1445885 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f99f752337c57e725965592a92a3596e37a68941) commit e08e50cc0860cf23053ac7000d2d27b88a3efed1 Author: David S. Wang Date: Wed Feb 13 08:55:43 2013 -0800 merge HADOOP-9221 from trunk. Convert remaining xdocs to APT. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1440246 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3eae5dbf92a0ccd772f05cd344a625db4f9f1100) commit 29d985f644f2eb1b74a3b618c32c88e3e2399a92 Author: David S. Wang Date: Wed Feb 13 08:52:09 2013 -0800 HADOOP-9190. packaging docs is broken. (Andy Isaacson via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1439966 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3349fd243515133cc8b350c1992e138fda4863ab) commit 92cd3e713ae9db0c2b4e57df415702cf110cd620 Author: Todd Lipcon Date: Wed Feb 13 07:26:42 2013 +0000 HDFS-4496. DFSClient: don't create a domain socket unless we need it. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1445491 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bf44ece028a3544bfa984858de940c60148ea1e9) (cherry picked from commit e1c8bcab6ad3f54162543b4964255ce5fca1061c) commit 9b646ae0c2c61c3d675d5f4ad88636fd2e61338d Author: Alejandro Abdelnur Date: Tue Feb 12 16:16:16 2013 -0800 CLOUDERA-BUILD. hadoop client must exclude servlet/jsp/jetty/tomcat JARs. commit 7e221b24705c32f0f03e87445f40d3e9071d3075 Author: Aaron Twining Myers Date: Sat Feb 9 00:58:46 2013 +0000 HDFS-4485. DN should chmod socket path a+w. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1444304 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bbc4efb7ae28f44ecd4a734323cdd7384ca5f1d4) commit 32580851b109a446783884178dcf2c1c04a58d4d Author: Andrew Wang Date: Tue Feb 5 16:18:07 2013 -0800 Backport HDFS-4471 Namenode WebUI file browsing does not work with wildcard addresses configured (cherry picked from commit dd2a2a26076e0c8ac3d388274a938bcf806ab8b8) commit 02a97a7b2926bc63fbaa949b437f7d8f85ade1ee Author: Aaron Twining Myers Date: Thu Feb 7 00:02:12 2013 +0000 HFS-4473. Don't create domain socket unless we need it. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1443283 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0f8cbe4ffd436c86941731d8c7cd5ff4d503ae18) (cherry picked from commit 8509f387a859c10e243ae859271daa7d3fb1af94) commit 93c73edee1dad2fb29117a1b93586f9b4fdcc7c0 Author: Aaron Twining Myers Date: Thu Feb 7 03:15:56 2013 +0000 HADOOP-9283. Add support for running the Hadoop client on AIX. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1443306 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7299d5d3e3db760e4b47eaa59da4b9934ba7c278) commit 4568ae02221facef05136c9d00b780d4b37dbcd6 Author: Alejandro Abdelnur Date: Wed Feb 6 12:02:37 2013 -0800 MAPREDUCE-4977. Documentation for pluggable shuffle and pluggable sort. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1443168 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a7a41c3de87baf6b9dd60a18e96369cfe8186a3f) Conflicts: hadoop-mapreduce-project/CHANGES.txt hadoop-project/src/site/site.xml commit 4be06e7a7aa0ac46b7a2f8bfadafbd31b539a1b7 Author: Aaron Twining Myers Date: Tue Feb 5 03:23:46 2013 +0000 HDFS-4404. Create file failure when the machine of first attempted NameNode is down. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442462 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a96aed2a1634b8df0ff6147894ff772db4d7364a) commit d033b46b3a178ee3f417afb7c59ec43f9a111ca3 Author: Aaron Twining Myers Date: Mon Feb 4 21:32:02 2013 +0000 HDFS-4462. 2NN will fail to checkpoint after an HDFS upgrade from a pre-federation version of HDFS. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1442378 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4b868caae3393a2c1155db0f920cfe1c615a5b85) commit b52ac99f36160fb856ea8065d178c7c9f98918a4 Author: Harsh J Date: Tue Jul 10 19:58:49 2012 +0000 HADOOP-8423. MapFile.Reader.get() crashes jvm or throws EOFException on Snappy or LZO block-compressed data. Contributed by Todd Lipcon. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359866 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7d64cde31e4ec83f004ffdbf8da287bbaa47275e) commit b7a4c494afcb5131dd9650e74d1851cc35e9018a Author: Eli Collins Date: Mon Oct 8 18:17:39 2012 +0000 HADOOP-8804. Improve Web UIs when the wildcard address is used. Contributed by Senthil Kumar git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395703 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 461285dc6eaaacd338d3d69c647d6eceb4e90786) (cherry picked from commit 5f564609cc63f7e53c49919ac78a6bd0d00025b3) commit 4aa53e8f6284e13f476457b7642a8e9e461c8ac2 Author: Aaron T. Myers Date: Wed Jan 30 18:06:56 2013 -0800 Revert "svn merge -c 1373683 from trunk for HADOOP-8700. Use enum to define the checksum constants in DataChecksum." This reverts commit 747fff4fb533e42045933b0df0a1bf7d52b8ade8. (cherry picked from commit cf025f948f09075d31afbfe38b7608928d239f62) commit ce3f208d4496b41e9e03f5622b614130eaa82438 Author: Jenkins slave Date: Wed Jan 30 10:28:41 2013 -0800 Preparing for CDH4.2.0 release commit dc46169974fbca5aa985f5d8555028861a5f741a Author: Alejandro Abdelnur Date: Fri Jan 25 00:25:59 2013 +0000 MAPREDUCE-2264. Job status exceeds 100% in some cases. (devaraj.k and sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438277 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 834458411cad90c9be3b91845c8ae7a262786487) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit b6a6c9b842b309f654171f417242f8cfffe6460d Author: Alejandro Abdelnur Date: Fri Jan 25 09:56:46 2013 -0800 HADOOP-8857. hadoop.http.authentication.signature.secret.file docs should not state that secret is randomly generated. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1438601 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 55f0d031bea2da7a0e0772fc07d556c87ffe8201) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt hadoop-common-project/hadoop-common/src/site/apt/HttpAuthentication.apt.vm commit 851cc092fffff943ea8828392ab4f59a3dd7f009 Author: Aaron Twining Myers Date: Fri Jan 25 00:44:37 2013 +0000 HDFS-4440. Avoid annoying log message when dfs.domain.socket.path is not set. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438280 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ce168a4a2b63652253609f623774efeb6e77266e) commit 1a158aa10b1c011d61202591371a70dadacd7475 Author: Aaron Twining Myers Date: Fri Jan 25 00:39:02 2013 +0000 HDFS-4438. TestDomainSocket fails when system umask is set to 0002. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1438279 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f679b5d3732a6a74a95b40637344d4756a9ea9bb) commit 31fa70d23ca07bcb07f140101ff65c0b34def247 Author: Todd Lipcon Date: Tue Jan 22 02:59:32 2013 +0000 HDFS-4403. DFSClient can infer checksum type when not provided by reading first byte. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1436731 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit efca1645e44a4c97f4e4395202883ab037f62b3a) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSClient.java Trivial conflicts due to commit of HDFS-4363 (combine PBHelper and HdfsProtoUtil) upstream which isn't in CDH4 yet. Replaced use of PBHelper with HdfsProtoUtil for backport. commit eaa5133d4bf49766dd9f976a483f65b39c68900d Author: Suresh Srinivas Date: Fri Oct 12 14:34:42 2012 +0000 HDFS-4044. Duplicate ChecksumType definition in HDFS .proto files. Contributed by Binglin Chang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397584 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5f59a7d7b1ede30441252e5d8880c3041cb13940) commit fe7f5c40912d380ccee6a06f7c60c6c26c4f5781 Author: Todd Lipcon Date: Wed Jan 23 12:30:29 2013 -0800 HDFS-4046. Rename ChecksumTypeProto enum NULL since it is illegal in C/C++. Contributed by Binglin Chang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406013 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/protocol/datatransfer/DataTransferProtoUtil.java Trivial conflicts due to missing earlier commit which merged PBHelper and HdfsProtoUtil commit c7f0b52237676dff191297c52e486957e0a8ecb8 Author: Todd Lipcon Date: Wed Jan 23 20:01:33 2013 +0000 HDFS-4433. Make TestPeerCache not flaky. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437680 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 751130613deafa477f836ad206404fc51903bedf) commit 420978e036c6b0a86ba5c758f4cb9ca953c5bca0 Author: Todd Lipcon Date: Wed Jan 23 18:38:56 2013 +0000 HDFS-4417. Fix case where local reads get disabled incorrectly. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1437616 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2309858edd34912daf7b76b391827220536ad1b3) commit 47d21bad992e1d8be395ecd04fa2063ffb610b9b Author: Todd Lipcon Date: Mon Jan 21 19:29:06 2013 +0000 HDFS-4416. Rename dfs.datanode.domain.socket.path to dfs.domain.socket.path. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1436568 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5599747fa86e7a030e5d69cc53ca88de1ff591c5) commit bf62225a202fc39c635bff465f1511c08e806608 Author: Todd Lipcon Date: Thu Jan 17 23:11:30 2013 +0000 HDFS-4418. increase default FileInputStreamCache size. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1434953 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 76f88ecebf8080ab79056a0195ba8416a5350979) commit fecd6ca6c8ac03323ae7f2c8f785012431df6751 Author: Thomas White Date: Wed Jan 23 10:53:05 2013 +0000 YARN-319. Submitting a job to a fair scheduler queue for which the user does not have permission causes the client to wait forever. Contributed by shenhong. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1437336 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fd6bde5522e98a21bd608f756c1de656bcf54e88) commit 152ff13d582192c4e52fd0cf086dc3bf0e6bdbb6 Author: Alejandro Abdelnur Date: Wed Jan 23 09:58:06 2013 -0800 MAPREDUCE-4808. Refactor MapOutput and MergeManager to facilitate reuse by Shuffle implementations. (masokan via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1436936 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a99cba48b9c773afec6d9d3f4cef7bec5c3d3864) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit 21ac70c9cd24e32788ea71a619519303830821af Author: Todd Lipcon Date: Wed Jan 16 22:29:53 2013 +0000 HADOOP-9193. hadoop script can inadvertently expand wildcard arguments when delegating to hdfs script. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434450 13f79535-47bb-0310-9956-ffa450edef68 commit f23f9bcef6c38af304de8937e98f6d588db21dbd Author: Todd Lipcon Date: Thu Jan 17 01:37:41 2013 +0000 HADOOP-9215. when using cmake-2.6, libhadoop.so doesn't get created (only libhadoop.so.1.0.0). Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434530 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9153e532e8e66830e506b6eef30066cefa01edda) commit 9ea7cbe7eb3f2dc2b134a0d648f8d76e99a8e68c Author: Aaron Twining Myers Date: Fri Jan 18 18:40:44 2013 +0000 HDFS-4359. Slow RPC responses from NN can prevent metrics collection on DNs. Contributed by liang xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1435300 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d6681aab50a13ef12f46b9a98b0447c5f9bb9362) commit 813fcb735bf101e08111d317b1ea028d17fff99f Author: David S. Wang Date: Fri Jan 18 07:58:29 2013 -0800 HDFS-3813. Log error message if security and WebHDFS are enabled but principal/keytab are not configured. Contributed by Stephen Chu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394341 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6b56e7b05c01d851e01e9ea5fce928232aa2a5b2) commit 4d11d852c0d36bd54d39aff0257a4e495462a98f Author: Alejandro Abdelnur Date: Fri Jan 18 00:48:22 2013 +0000 YARN-302. Fair scheduler assignmultiple should default to false. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434996 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5a9facefefd0987f502dc24d2eb5dc7b43828d67) commit 35653b68adcc37a95a702551354a8fea40adf8d6 Author: Alejandro Abdelnur Date: Fri Jan 18 00:40:58 2013 +0000 MAPREDUCE-4923. Add toString method to TaggedInputSplit. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434993 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 002e822a9ed6ff7a2f51667aae620a6db5c39653) commit 89d6996b0543376ce33bfdab415a3fda9a34ffd7 Author: Alejandro Abdelnur Date: Fri Jan 18 00:37:23 2013 +0000 YARN-331. Fill in missing fair scheduler documentation. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1434990 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 83c5083aa043f37a0b20244b0d78529132ecd985) commit 76d102dfff34f8df3ca07372a162b58ad303b05c Author: Harsh J Date: Tue Jan 15 13:55:49 2013 +0000 MAPREDUCE-4925. The pentomino option parser may be buggy. Contributed by Karthik Kambatla. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433416 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0aae3189dff591139adff37ba459e1c3d81cfcb5) commit a378c4e078f8a20688638411eb47d9097ee29bc5 Author: Harsh J Date: Tue Jan 15 13:47:53 2013 +0000 MAPREDUCE-4678. Running the Pentomino example with defaults throws java.lang.NegativeArraySizeException. Contributed by Chris McConnell. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433412 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b2e1f335a1d869cabd3360dc7c6a575a844da6d2) commit 9a0aca1c9e5c367b47642ea30fc18bacdbb83a79 Author: Vinod Kumar Vavilapalli Date: Mon Jan 7 06:36:20 2013 +0000 YARN-217. Fix RMAdmin protocol description to make it work in secure mode also. Contributed by Devaraj K. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1429683 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 80b68254e23e7012abe09f332aefbde2939735b8) commit cbf2f3b622ab8bdbb62a6a11ab43daed1ae1bf24 Author: Thomas White Date: Wed Jan 16 10:26:21 2013 +0000 Merge -r 1433878:1433879 from trunk to branch-2. Fixes: HADOOP-9212. Potential deadlock in FileSystem.Cache/IPC/UGI. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433882 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 682b6c2e22dc91608a0f5fa92059d69f8dfc0469) commit 641abfded8ea3e6faf183b3aca30dd31de2a139c Author: Alejandro Abdelnur Date: Wed Jan 16 00:08:25 2013 +0000 MAPREDUCE-4924. flakey test: org.apache.hadoop.mapred.TestClusterMRNotification.testMR. (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433753 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 167dc3e4ea31a9894c05fe017476fa299943a6a3) commit 56544ecc19f17d9fc7c2cf54e2b9c148eb4f4611 Author: Eli Collins Date: Tue Jan 15 03:27:14 2013 +0000 Add missing file from previous commit (HADOOP-9178). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433276 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 61c1330b5e57f0675c7b2ca2f56ff23fb0270f5e) commit 5a1f3c8dec34ad432acb4fd9c8f1f66ea04bbeca Author: Eli Collins Date: Tue Jan 15 03:25:12 2013 +0000 HADOOP-9178. src/main/conf is missing hadoop-policy.xml. Contributed by Sandy Ryza git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433275 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6e1288e1a3f9da26f0df0045da0a8522389fde6b) commit c917fdb27a1a833d4d2c4afbeadb917a6ffd4d74 Author: Eli Collins Date: Thu Oct 18 22:30:11 2012 +0000 HADOOP-8925. Remove the packaging. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399889 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 444894dbf3e734710eef77620271545b412bb784) commit ce48302a2f1f3e804742bd21e3b1eb75e3be5d0f Author: Todd Lipcon Date: Tue Jan 15 20:43:35 2013 +0000 HADOOP-8712. Change default hadoop.security.group.mapping to JniBasedUnixGroupsNetgroupMappingWithFallback. Contributed by Robert Parker. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1433625 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 15bf20b06687e9556b13cb81d90b80de8d6f8dad) commit 91d655479b1c666ad0543dba46a640b4057ad811 Author: Alejandro Abdelnur Date: Tue Jan 15 11:14:33 2013 -0800 MAPREDUCE-4842. Shuffle race can hang reducer. Contributed by Mariappan Asokan git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425071 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d7c8d17f650afed1009ee4004538f3e2aee072e0) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit 5e0769855337cc1ff18da3424c813b73e36f53f8 Author: Alejandro Abdelnur Date: Tue Jan 15 11:13:08 2013 -0800 MAPREDUCE-4807. Allow MapOutputBuffer to be pluggable. (masokan via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422345 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a6f3fe83b0deb804a621d56acc7514260a06efe1) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit d22acf520f905031c4ee13987d01c6b8a2c11c17 Author: Alejandro Abdelnur Date: Tue Jan 15 11:12:38 2013 -0800 MAPREDUCE-4809. Change visibility of classes for pluggable sort changes. (masokan via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1422341 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c10b045302bd190ed9ea8973bd559294fd11e0dd) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit dcc9b036b7c04e5342c74518ccb9cabe21a6e379 Author: Alejandro Abdelnur Date: Tue Jan 15 11:10:52 2013 -0800 MAPREDUCE-4049. Experimental api to allow for alternate shuffle plugins. Contributed by Anver BenHanoch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418173 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab9bf12f9b5a892c52a8b79497dc8b50135aab14) Conflicts: hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml commit 348dddba849f44537e7f29f0773c8adb31a33d96 Author: Thomas White Date: Tue Jan 15 17:09:48 2013 +0000 YARN-336. Fair scheduler FIFO scheduling within a queue only allows 1 app at a time. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433526 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5bc9d5a75efecbf420f6fe8889fa488baa9e6e8f) commit 2f4bd417d49438e27d975ab0ae364245b2bbf9f4 Author: Thomas White Date: Tue Jan 15 16:12:33 2013 +0000 YARN-335. Fair scheduler doesn't check whether rack needs containers before assigning to node. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433484 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab67daf534a35b0c38d893bbe5ed95593d6cad28) commit c7cba38e76e561d2421b603645136b95e8728ce6 Author: Arun Murthy Date: Thu Nov 29 01:56:33 2012 +0000 YARN-229. Remove old unused RM recovery code. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415029 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a9e4ee59f3316fb78243f3d6e3c26a403a984e7b) commit 46a89af6b5ff06f068f62c74a2b88b2d27fd17ba Author: Thomas Graves Date: Wed Nov 28 19:19:16 2012 +0000 MAPREDUCE-4817. Hardcoded task ping timeout kills tasks localizing large amounts of data (tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414873 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 27e76aef8bcb82f4c6aa68af66dff036a109a154) commit 34015f6919be614894f5ca6197a1af1937fdb366 Author: Robert Joseph Evans Date: Wed Nov 28 17:52:45 2012 +0000 MAPREDUCE-4825. JobImpl.finished doesn't expect ERROR as a final job state (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414840 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 37eae2a4f58f94b458316a7383d1d886dc00da85) commit b1978178f17991f9c3ff9aadeaf453694c44e07f Author: Robert Joseph Evans Date: Tue Nov 27 16:05:16 2012 +0000 YARN-204. test coverage for org.apache.hadoop.tools (Aleksey Gorshkov via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414239 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c506df64e678452941971429c42dc2ee94ec243d) commit 5044c06082cb3fa9e452df8294bc8f9ce2cdced0 Author: Eli Collins Date: Tue Sep 11 17:56:19 2012 +0000 HADOOP-8789. Tests setLevel(Level.OFF) should be Level.ERROR. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383494 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8cc64ca79cb8d94178dc0b8d555ace63e82f3b83) commit fe819a0511271d1c60802f5dea1a57c6d1dcd8f6 Author: Robert Joseph Evans Date: Mon Nov 26 17:37:05 2012 +0000 MAPREDUCE-4764. repair TestBinaryTokenFile (Ivan A. Veselovsky via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1413739 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 93239a850e161c929938471e7715c8f13b69beec) commit 08f504ce58df604466f0559b8ec329fee875f1d3 Author: Jason Darrell Lowe Date: Thu Nov 22 00:05:26 2012 +0000 MAPREDUCE-4811. JobHistoryServer should show when it was started in WebUI About page. Contributed by Ravi Prakash git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412377 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 005a57134c6b627c2ea281bfb5ca85c590f6d373) commit 061fe091ff170097eb03e6fa26bde543a2a2f9fb Author: Robert Joseph Evans Date: Mon Nov 19 16:41:11 2012 +0000 YARN-219. NM should aggregate logs when application finishes. (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411289 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9825cb2decf239d4c576cf37f74c8234235e6ffe) commit 5ffcf5de469d70f03b82a3fdc7c53ee99ee2f0d2 Author: Robert Joseph Evans Date: Fri Nov 16 18:26:19 2012 +0000 YARN-214. RMContainerImpl does not handle event EXPIRE at state RUNNING (jeagles via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410522 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5746110b3e9522f281235afcf8ceea1bfde03dc4) commit 7a03544d8240345b5b8c2cba387292cbe2b1091f Author: Alejandro Abdelnur Date: Tue Jan 15 10:49:40 2013 -0800 HADOOP-8816. HTTP Error 413 full HEAD if using kerberos authentication. (moritzmoeller via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433567 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f6a954c2d865e7fdc76903ae41549a050ffc3db) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit e10affb15921b494e6980603a7a8390b472d6d10 Author: Todd Lipcon Date: Mon Jan 14 20:47:08 2013 +0000 HDFS-3429. DataNode reads checksums even if client does not need them. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1433117 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8360a7a6a4497c47cf6a389a2663a4a2b4867a19) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/RemoteBlockReader.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/RemoteBlockReader2.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestParallelRead.java Resolved simple conflicts mostly due to changes in the context area -- this patch was applied to trunk upstream, but being applied to CDH4 after HDFS-347 patches have gone in. commit cd32c2af4655b9a3ddc0fa841df67cabd3648f37 Author: Todd Lipcon Date: Tue Jan 15 00:31:35 2013 +0000 HDFS-4402. Some small DomainSocket fixes: avoid findbugs warning, change log level, etc. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433242 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7f0452f515fe83cb3bf7c9f2322b1ca4dc6e8ef6) commit 944963e0dd2105db839a0d35fa6354da578eb804 Author: Todd Lipcon Date: Tue Jan 15 00:12:47 2013 +0000 HDFS-4401. Fix bug in DomainSocket path validation. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433229 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e384f380c80c9b9d1e66ba509c8722307e2b8626) commit 48659c3c56d357cb58c2c0483b1f815ad046d211 Author: Todd Lipcon Date: Mon Jan 14 21:34:22 2013 +0000 HDFS-4400. DFSInputStream#getBlockReader: last retries should ignore the cache. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1433144 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 681737e78ba0ce574b92ff0ef3bd1794492af27e) commit ed397fa85bbe38e491866ed54113a092f500b98e Author: Suresh Srinivas Date: Tue Oct 16 16:52:42 2012 +0000 HADOOP-8923. JNI-based user-group mapping modules can be too chatty on lookup failures. Contributed by Kihwal Lee. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398883 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 49da1307b1fe9dc6661fc4a065bb6ae3f31d05b4) commit 96ed3a056cb0fb0f62979d8af4f0b8f261c371f9 Author: Daryn Sharp Date: Thu Nov 15 20:33:30 2012 +0000 HDFS-4186. logSync() is called with the write lock held while releasing lease (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409988 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7a47aa9a2488498a8f6e61014669001b9ac522b0) commit 650d0db0f5f1d7958fca41f562c61164163d5225 Author: Daryn Sharp Date: Tue Nov 13 15:29:04 2012 +0000 HDFS-4181. LeaseManager tries to double remove and prints extra messages (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408779 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 613543d6585d9e7f12d83c78653ac71e99ff6aaf) (cherry picked from commit 7cf84be29a37684d941935fd3c3507e98fda9a44) commit e82925146490b2264365e2888083e04cd21b5528 Author: Todd Lipcon Date: Sat Jan 12 01:19:27 2013 +0000 HDFS-4390. Bypass UNIX domain socket unit tests when they cannot be run. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432350 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 463acdb8fbc5d0216eda021e40b980f3aa84d9fb) commit 9b197be257364903967ecc51e314b328897bec1d Author: Todd Lipcon Date: Sat Jan 12 00:12:30 2013 +0000 HDFS-4388. DomainSocket should throw AsynchronousCloseException when appropriate. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432339 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6aa6d73a0abb2cbc7b6b3e9d3a150f4f90b96960) commit 51d6fc750c4f8552b0c79bc52eecdb57f8cc2d76 Author: Todd Lipcon Date: Fri Jan 11 23:52:22 2013 +0000 HDFS-4356. BlockReaderLocal should use passed file descriptors rather than paths. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1432335 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e60a6bb6672394113786c43921a2f6c24320cd0f) commit f93b36b9fcfe353c95d5c5b094f34be3642acfbd Author: Todd Lipcon Date: Wed Jan 9 21:37:34 2013 +0000 HDFS-4354. Create DomainSocket and DomainPeer and associated unit tests. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431102 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c245150719b2bdf77677903bb185b4b1949e9f29) commit e648f122a647001032147ff1994e5a97644b7e96 Author: Todd Lipcon Date: Wed Jan 9 21:34:13 2013 +0000 HDFS-4353. Encapsulate connections to peers in Peer and PeerServer classes. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-347@1431097 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e31ac2550a192988b79a1a8a4824d877030a16a1) commit 3bf460073036217bcf18c8f5e3c6ef3e0ddfae66 Author: Aaron Twining Myers Date: Mon Jan 7 21:47:41 2013 +0000 HDFS-3970. Fix bug causing rollback of HDFS upgrade to result in bad VERSION file. Contributed by Vinay and Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430037 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3f6f4ea524cc7afc941430d9878bc9f93a02e0fb) commit 030da20f1c0713867100dcbec1cebd66e57db2a0 Author: Arun Murthy Date: Mon Dec 24 00:14:59 2012 +0000 HDFS-4326. bump up Tomcat version for HttpFS to 6.0.36. Contributed by Alejandro Abdelnur. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1425560 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5d72eb6005e9f4792e4c1064e952f41ae2d61f96) Conflicts: hadoop-hdfs-project/hadoop-hdfs-httpfs/pom.xml commit 3e6cdb152c26568c542d192858498a6582df90ef Author: Eli Collins Date: Fri Jan 11 18:47:52 2013 +0000 HDFS-4384. test_libhdfs_threaded gets SEGV if JNIEnv cannot be initialized. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1432221 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1fce59fc7511805e2e74da83dfcf129b473e3150) commit ff37bdc4081efd617467346bc06c95b410c5b4a9 Author: Alejandro Abdelnur Date: Thu Jan 10 17:27:58 2013 +0000 MAPREDUCE-4907. Ammendment, forgot to svn add testcase in original commit git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431510 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4735e26d5c6aca9a7eee5381e487a05ec554d51a) commit f8385412923f6eb063a005a6a5a9bb1d75d7a562 Author: Alejandro Abdelnur Date: Thu Jan 10 00:50:03 2013 +0000 MAPREDUCE-4907. TrackerDistributedCacheManager issues too many getFileStatus calls. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1431166 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1c0b2463c8db2e4ef68e71cca240921d3a1c03ff) commit 17293454236c67d3296923ae0d58a0bf9be1de05 Author: Thomas White Date: Thu Jan 10 10:09:06 2013 +0000 Merge -r 1431250:1431251 from trunk to branch-2. Fixes: HADOOP-9183. Potential deadlock in ActiveStandbyElector. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1431252 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1ea60b498d92de1fbbfdaa2a6df48bfc87b46500) commit b90b34d5b2f7eedb22c7602a6fb1dd7643d12dc1 Author: Robert Joseph Evans Date: Fri Nov 16 00:52:43 2012 +0000 MAPREDUCE-4801. ShuffleHandler can generate large logs due to prematurely closed channels (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410131 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 79e446ea1c0dcb745553269741da62691c337ea8) commit 2806219effa3c918c50b99409a844f757c0cec86 Author: Robert Joseph Evans Date: Thu Nov 15 15:15:51 2012 +0000 YARN-188. Coverage fixing for CapacityScheduler (Aleksey Gorshkov via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409827 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 46bd222bbd1d6c814d8ea5ce9359b3a2c5cd8960) commit 6d4752d0084172d1ea4455ad4a98ab8281ae6525 Author: Robert Joseph Evans Date: Wed Nov 14 23:02:29 2012 +0000 MAPREDUCE-4797. LocalContainerAllocator can loop forever trying to contact the RM (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409525 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 39c48a56aa6879c7c82e4f9f285104e3b55d7665) commit 262bff7a11ea3082b2963b9dc9ef679a8eec5161 Author: Jason Darrell Lowe Date: Wed Nov 14 19:22:11 2012 +0000 YARN-216. Remove jquery theming support. Contributed by Robert Joseph Evans. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409313 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 37fe34f9b6532310a248889d665ee08e79c8cd7b) commit b0efdf6cce4566a2f3966ce41e9f9832eb8da039 Author: Thomas Graves Date: Tue Nov 13 23:47:57 2012 +0000 MAPREDUCE-4517. Too many INFO messages written out during AM to RM heartbeat (Jason Lowe via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409032 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7aae0035ad433627f437ce616ae2cf2a6f5c2ebc) commit d0f8b266295cf4dbbe2f721c74d6492805cf7a00 Author: Jason Darrell Lowe Date: Tue Nov 13 15:59:13 2012 +0000 YARN-212. NM state machine ignores an APPLICATION_CONTAINER_FINISHED event when it shouldn't. Contributed by Nathan Roberts git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408812 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 33687dbefc53459dd402567b6fb5e7dcb5d2fe5c) commit 0315e366ddcc1bca41f883526564e63248439463 Author: Robert Joseph Evans Date: Mon Nov 12 17:15:45 2012 +0000 MAPREDUCE-4425. Speculation + Fetch failures can lead to a hung job (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408360 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 53deea13d52e7d69963572243f7c72312dac758a) commit 437f0324ac74941751b18db9fccc696abc83e7e5 Author: Robert Joseph Evans Date: Mon Nov 12 15:15:52 2012 +0000 MAPREDUCE-4751. AM stuck in KILL_WAIT for days (vinodkv via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408314 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8f7f57c37450b1370b658f1f326f19d03cbda3a0) commit c3bc084a9222829d4fd3b4ad8ee6793345167a1c Author: Robert Joseph Evans Date: Fri Nov 9 22:55:57 2012 +0000 MAPREDUCE-4774. JobImpl does not handle asynchronous task events in FAILED state (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407679 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ec5dc31433a3fc8d4d5f73864728853af9cd6f9e) commit fdaae51b14150e9711d177a5ccf8ed1265a542dd Author: Jonathan Turner Eagles Date: Fri Nov 9 22:14:06 2012 +0000 MAPREDUCE-4666. JVM metrics for history server. (jlowe via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407669 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bfb4dcc24092bd1c21cd9f32f541294d3226aa50) commit 4f6ffdfb04d4f80bf274058ad7e10ec8a2e64b85 Author: Jonathan Turner Eagles Date: Fri Nov 9 19:52:28 2012 +0000 YARN-206. TestApplicationCleanup.testContainerCleanup occasionally fails. (jlowe via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407606 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cc7739235bec95167d8e2c3e7d57bc5c6f32b269) commit d01045c4d45fcfd65e86279fb1621adc5c0bedcc Author: Robert Joseph Evans Date: Fri Nov 9 15:52:33 2012 +0000 MAPREDUCE-4782. NLineInputFormat skips first line of last InputSplit (Mark Fuhs via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407505 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 408b5b8b037f9a0115e6dec267134aa287ff6d06) commit a05b3b85161db01e0a3cda284055f34968669c4e Author: Robert Joseph Evans Date: Thu Nov 8 17:22:52 2012 +0000 YARN-186. Coverage fixing LinuxContainerExecutor (Aleksey Gorshkov via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407171 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 772e66959612c120ebf4f108a962afcae6a79de3) commit f383e8238fd0f7f8f7967488c50905a7297d2872 Author: Robert Joseph Evans Date: Thu Nov 8 15:17:34 2012 +0000 MAPREDUCE-4772. Fetch failures can take way too long for a map to be restarted (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407118 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 09a3bf64b0f90ab94955207eb01663a65ba2621c) commit 5b18fecbb047570bc320cd28604997834cc46331 Author: Thomas White Date: Thu Nov 8 10:33:29 2012 +0000 YARN-169. Update log4j.appender.EventCounter to use org.apache.hadoop.log.metrics.EventCounter. Contributed by Anthony Rojas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406999 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8e335999ad323df60c5490f2f1323d1177c29897) commit d81099b230048bc8ff9898f1f1e020da746d8de0 Author: Arun Murthy Date: Wed Nov 7 21:56:18 2012 +0000 YARN-201. Fix CapacityScheduler to be less conservative for starved off-switch requests. Contributed by Jason Lowe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406834 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b9297ec622f886aaa4c468820572035bd7091439) commit 5b0016b3d1da4dff047f8a2ecedd72fa06b437e8 Author: Robert Joseph Evans Date: Tue Nov 6 18:48:49 2012 +0000 YARN-202. Log Aggregation generates a storm of fsync() for namenode (Kihwal Lee via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406269 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5feda036e8a598d213e3e695de1efd1ff1efbf5a) commit 4f318865420a71665d16f0d00d235ddff5f8bd74 Author: Robert Joseph Evans Date: Mon Nov 5 21:52:06 2012 +0000 MAPREDUCE-4771. KeyFieldBasedPartitioner not partitioning properly when configured (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1405975 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5a794a93abc23e15201d8216a65191b17fc5d258) commit 734d10cbc3a0bf08784a13b5db8c5dc82fa4ec1e Author: Robert Joseph Evans Date: Fri Nov 2 15:00:56 2012 +0000 MAPREDUCE-4763 repair test TestUmbilicalProtocolWithJobToken (Ivan A. Veselovsky via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404988 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b7ff4d65e591571f04a4bc5470c8e20d24fc1fee) commit f8538fcd42511352f1ee54b627299c03a6d601f9 Author: Jason Darrell Lowe Date: Thu Nov 1 22:59:43 2012 +0000 MAPREDUCE-4729. job history UI not showing all job attempts. Contributed by Vinod Kumar Vavilapalli git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404817 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 35d1de7ea06e572d28c1cbcacc9e7ef6deaecb0e) commit 5962489c091b055744040e6d2f22a68fc4d1e559 Author: Robert Joseph Evans Date: Thu Nov 1 17:02:52 2012 +0000 MAPREDUCE-4746. The MR Application Master does not have a config to set environment variables (Rob Parker via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404674 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9f66704f4fa62ada0a34739144a8147e91952f65) commit cb17ca965f2f86468349ab2f58175172eb49086e Author: Vinod Kumar Vavilapalli Date: Thu Nov 1 00:32:37 2012 +0000 YARN-189. Fixed a deadlock between RM's ApplicationMasterService and the dispatcher. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404431 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a946928b4258afb69eb6ec45f253490a562d7b70) commit 4770d731c1daa336579eb67c3341bb4e6c206ad9 Author: Robert Joseph Evans Date: Wed Oct 31 19:13:03 2012 +0000 MAPREDUCE-4724. job history web ui applications page should be sorted to display last app first (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404305 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 609c0c4dd42d760e67927a58ad55f0541a9146cf) commit 6383d16f3043447b88b6dbbdbef295df555a3c6c Author: Robert Joseph Evans Date: Wed Oct 31 16:56:23 2012 +0000 YARN-166. capacity scheduler doesn't allow capacity < 1.0 (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404247 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0a62840aa8fd198d46ef0f801c46c06a7dff8cae) commit 1b99ece541aad672636b6cd66cdf3a7fc7fe1472 Author: Robert Joseph Evans Date: Wed Oct 31 15:47:11 2012 +0000 YARN-165. RM should point tracking URL to RM web page for app when AM fails (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404211 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 552b7f16424333e6999da5ef1b8cc71f0ca87316) commit 6a499c19705dc258ab5eb322d1a7f8a79a3bfec5 Author: Thomas Graves Date: Wed Oct 31 14:57:12 2012 +0000 MAPREDUCE-4752. Reduce MR AM memory usage through String Interning (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1404177 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2ef1a81732a552f9828edf0f3be604dc5ce6a3e3) commit 46c5ce986758c5f7c031cda242d72f0e5e9ea628 Author: David S. Wang Date: Tue Jan 8 15:06:12 2013 -0800 svn merge -c 1379537 FIXES: HADOOP-8727. Gracefully deprecate dfs.umaskmode in 2.x onwards (Harsh J via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379538 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8f649ee167a61bd85796a2cab90be34ecc2089ac) commit 64a918dc1e16faed0140b4d190112254f6a3d9e8 Author: Thomas White Date: Tue Jan 8 16:26:33 2013 +0000 MAPREDUCE-4278. Cannot run two local jobs in parallel from the same gateway. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1430363 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4aab73e6f81b5dcbc8ef4a96bde2b9401b35d2fd) commit 686997b4494642953101a4d1ff60f8508a8f4918 Author: David S. Wang Date: Tue Jan 8 10:00:53 2013 -0800 HADOOP-8418. Update UGI Principal classes name for running with IBM JDK on 64 bits Windows. (Yu Gao via eyang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418573 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f6ef111510be5fcc2a308b3c244eea7e542aee4a) commit 0f3a9eda40b4f5d6f6766263c9657aafb8219229 Author: David S. Wang Date: Tue Jan 8 09:39:15 2013 -0800 HDFS-4307. SocketCache should use monotonic time. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421573 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e1e95ef741609c3455558287566c94dc2cca0a35) commit 0d7cf0f83909b41e341b2158a02be147693d4fce Author: David S. Wang Date: Tue Jan 8 09:38:44 2013 -0800 HADOOP-9135. JniBasedUnixGroupsMappingWithFallback should log at debug rather than info during fallback. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421012 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 598107252cdf68cca9999d553b504d9092252584) commit f55cc39b0123eb4cb72c52d9c39b50e530f481c5 Author: Jason Darrell Lowe Date: Fri Oct 26 21:02:52 2012 +0000 MAPREDUCE-4748. Invalid event: T_ATTEMPT_SUCCEEDED at SUCCEEDED. Contributed by Jason Lowe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402658 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dac7a1dfa9fa0b46b1ccf8825c9d5d1b28c61acf) commit 63349b2659c339c4698cb7c05e6911d4ac4831c8 Author: Vinod Kumar Vavilapalli Date: Thu Oct 25 01:26:30 2012 +0000 MAPREDUCE-4730. Fix Reducer's EventFetcher to scale the map-completion requests slowly to avoid HADOOP-8942. Contributed by Jason Lowe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401941 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3ff64234dbbd6771e485b5ab23ecb51b3ab48da1) commit a549233e692edff58601309fcd1eac0ed571183e Author: Jason Darrell Lowe Date: Wed Oct 24 15:45:35 2012 +0000 MAPREDUCE-4741. WARN and ERROR messages logged during normal AM shutdown. Contributed by Vinod Kumar Vavilapalli git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401738 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4ef5162d3d6c8777e15ce68c4708080f048deb54) commit 3d99719d7f6d83d7f5fcde3f0e9f5db11cdb266b Author: Jason Darrell Lowe Date: Wed Oct 24 15:20:58 2012 +0000 YARN-139. Interrupted Exception within AsyncDispatcher leads to user confusion. Contributed by Vinod Kumar Vavilapalli git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401726 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 527ce8fca41eb57e5a97d65a7a9c2ac0da1aac9d) commit 5ae68180c6145c1fa2b343e06e06454479e63fc5 Author: Robert Joseph Evans Date: Wed Oct 24 14:16:49 2012 +0000 YARN-180. Capacity scheduler - containers that get reserved create container token to early (acmurthy and bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401703 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6e3202a7a39979f08cdc723e4bb60f6da0b3d584) commit a5ce9729e76282167676887ce6f012a64535b1d9 Author: Robert Joseph Evans Date: Wed Oct 24 14:07:16 2012 +0000 YARN-178. Fix custom ProcessTree instance creation (Radim Kolar via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401698 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a98e85a1de2a2564ad5c59c2beba23b2a9e3d8af) commit a1788836d8d6eee39c960b9b4b230fd631bab420 Author: Thomas Graves Date: Wed Oct 24 13:21:09 2012 +0000 YARN-177. CapacityScheduler - adding a queue while the RM is running has wacky results (acmurthy vai tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401668 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b76b1cb5bba0815bb1fe44dfcdbc6879223e5b74) commit 36fdfac0e6fa99fa33817a70da55c14f9f7e21cb Author: Vinod Kumar Vavilapalli Date: Tue Oct 23 22:48:49 2012 +0000 YARN-181. Fixed eclipse settings broken by capacity-scheduler.xml move via YARN-140. Contributed by Siddharth Seth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401504 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5cf27a5b09f711ed7f6ebe86a11607928e388436) commit 9ca3f3b62b51752d27c5c2f991e38642f59b87f2 Author: Daryn Sharp Date: Tue Oct 23 21:01:03 2012 +0000 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401473 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c37b2fc81e7893c4ce377f51bbacca16e8d75a59) commit 2d4ccc5330027f1e7179392a67f0dadb8b87b955 Author: Daryn Sharp Date: Tue Oct 23 20:57:36 2012 +0000 MAPREDUCE-4229. Intern counter names in the JT (bobby via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401467 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 07d4e4c0646ab554e8ed83b0dc7cf8b561841555) commit 25c3f70840a09893afe935d8da9eb817641e9eea Author: Siddharth Seth Date: Tue Oct 23 21:06:36 2012 +0000 YARN-179. Fix some unit test failures. (Contributed by Vinod Kumar Vavilapalli) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401481 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e3944a6d49b142cec5e68ac06b423771e7ce10f3) commit 38b5134072fae1c9c4bddecb4f23bad5068c19d8 Author: Aaron Twining Myers Date: Tue Dec 18 02:38:14 2012 +0000 HDFS-4140. fuse-dfs handles open(O_TRUNC) poorly. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423257 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 223af8ee7e94282f6499ad352f814bc36d6a781c) commit 073f8ab52ab7c2c319465d975404fb3f68ad9a16 Author: Robert Joseph Evans Date: Tue Oct 30 15:46:15 2012 +0000 HADOOP-8986. Server$Call object is never released after it is sent (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403745 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5fd0639ec9a561d755bcf6541704b57cb44860eb) commit 70e7848c81b158bfda98984cd17eb09f0b9699ea Author: Robert Joseph Evans Date: Tue Oct 23 15:47:26 2012 +0000 HADOOP-8962. RawLocalFileSystem.listStatus fails when a child filename contains a colon (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401325 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 84e23033549b8a111c43abb4778888d0e18ee110) commit ae582d890b89fd9f62381ec8e91552c29f6df377 Author: Harsh J Date: Wed Sep 26 10:21:17 2012 +0000 MAPREDUCE-4685. DBCount should not use ACCESS. Contributed by Viji. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390372 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 509a9fdc2236575da32fb744a6f86eec75c5228b) commit 894d8fbbcf2c3e4da172cf9e46251a55043c07ba Author: Siddharth Seth Date: Tue Oct 23 21:02:22 2012 +0000 MAPREDUCE-4637. Handle TaskAttempt diagnostic updates while in the NEW and UNASSIGNED states. (Contributed by Mayank Bansal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401474 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 81a90a0242b948e4c5f3c656537ca19f6c4ce8f8) commit 4c50eed2f80cf3d7afff84b5a889676fd5ba4149 Author: Jason Darrell Lowe Date: Mon Oct 22 19:50:23 2012 +0000 MAPREDUCE-4740. only .jars can be added to the Distributed Cache classpath. Contributed by Robert Joseph Evans git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401054 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e262950c7a29691f39845a776ec29e8ace39620b) commit f4c39225afaed3fbe5aa705efb114f6558744b1a Author: Alejandro Abdelnur Date: Fri Oct 19 23:16:07 2012 +0000 YARN-140. Add capacity-scheduler-default.xml to provide a default set of configurations for the capacity scheduler. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400335 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b3ff6f027094bac00948bb4b9d2f7acda43b2111) commit 781cf4aab08191acb93d8c3e305a980a3dcad03f Author: Siddharth Seth Date: Fri Oct 19 20:37:30 2012 +0000 YARN-136. Make ClientToAMTokenSecretManager part of RMContext (Contributed by Vinod Kumar Vavilapalli) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400278 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f606a23dc462988b17a203384459d5e9265b6c5e) commit 130d7e381dcc35d005a9de9c6dbd9a05d81862ff Author: Siddharth Seth Date: Tue Oct 9 01:56:05 2012 +0000 YARN-134. Fixes ClientToAMSecretManager creates keys without checking for validity of the appID. (Contributed by Vinod Kumar Vavilapalli) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395841 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ed07660c033429a70458a074fead3b0d7c3be21a) commit 9341d05f7a15045c360cae83fb74e0aaa3abe0a5 Author: Suresh Srinivas Date: Fri Aug 31 22:40:51 2012 +0000 HADOOP-8736. Add Builder for building RPC server. Contributed by Brandon Li git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379652 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3175eb67a2d3f9892870bee8d8ee7f8b6f757f71) Conflicts: hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/ipc/TestRPC.java commit 7f13419bcb4a47a6980716ab6417ccd83ad29eb9 Author: Vinod Kumar Vavilapalli Date: Fri Oct 19 20:18:46 2012 +0000 MAPREDUCE-4733. Reducer can fail to make progress during shuffle if too many reducers complete consecutively. Contributed by Jason Lowe via. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400264 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 01b1959284e43a3ef2305e33c3d475bf88cc64fa) commit f250b1df2e836648da0f43c3e8264f990e8f40db Author: Robert Joseph Evans Date: Fri Oct 19 17:51:33 2012 +0000 MAPREDUCE-4479. Fix parameter order in assertEquals() in TestCombineInputFileFormat.java (Mariappan Asokan via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400192 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e22da336576c09660a2fc59a569c98d2eae9d730) commit bdd8b7006c325e8f987766fc7c2626267f4e54ad Author: Robert Joseph Evans Date: Fri Oct 19 17:34:15 2012 +0000 YARN-163. Retrieving container log via NM webapp can hang with multibyte characters in log (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1400189 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab6e0eeb1f14980f396270742e554defb9bc3567) commit c6badeafc9b35b378b91f19285f7a7c593c7d443 Author: Vinod Kumar Vavilapalli Date: Fri Oct 19 05:57:57 2012 +0000 MAPREDUCE-4596. Split StateMachine state from states seen by MRClientProtocol for Job, Task and TaskAttempt. Contributed by Siddarth Seth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399976 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7cc50b69757c6c336a26b6922748bff79bb61f2b) commit b9520cb5052793e2e8d6ff12da9d1be6c46a5f42 Author: Vinod Kumar Vavilapalli Date: Thu Oct 18 19:12:13 2012 +0000 YARN-32. Fix TestApplicationTokens to not depend on test order and thus pass on JDK7. Contributed by Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399795 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c186291df36233785eefbfc74a4f0fa16010a32c) commit e59f00a4fba4c0762708d9eddef45c7882a63fd0 Author: David S. Wang Date: Fri Jan 4 13:46:54 2013 -0800 HADOOP-9127. Update documentation for ZooKeeper Failover Controller. Contributed by Daisuke Kobayashi. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1421593 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1177320758600dbf2d163f2ea6951428786eec95) commit 06255fc408be2d5c645acdf6b57c6d1fe7bdd000 Author: Karthik Kambatla Date: Fri Jan 4 11:48:41 2013 -0800 Revert "YARN-15. Updated default classpath for YARN applications to reflect split of YARN into a sub-project. Contributed by Arun C Murthy." This reverts commit d36f212f85057f92219700091c9e92f3f5dd4183. commit 78c11aea3fedf7b9ccfdea2782c3c64eb4950c85 Author: Karthik Kambatla Date: Thu Jan 3 17:26:46 2013 -0800 CLOUDERA-BUILD. CDH-9654. Post YARN-137, reset FifoScheduler as the default scheduler commit e620503f1b68c593c9090d505e49ff67835b7efe Author: Vinod Kumar Vavilapalli Date: Mon Oct 22 21:25:12 2012 +0000 YARN-174. Modify NodeManager to pass the user's configuration even when rebooting. Contributed by Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401086 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit acbdae8d079d8b1a8ed26bc1d7218d3cbfc3566c) commit 719e0176eaa9d38f1c40799989fa2b2b91b627e7 Author: Robert Joseph Evans Date: Thu Jan 3 17:09:18 2013 +0000 MAPREDUCE-4279. getClusterStatus() fails with null pointer exception when running jobs in local mode (Devaraj K via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428482 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 706f03bd11c8efbd417f020461bad69a4b6837bf) commit 6b447023378220a9d542de6a6b4adc8e83b9a6c0 Author: Sandy Ryza Date: Thu Jan 3 16:45:28 2013 -0800 Revert "MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V." This reverts commit 515bb6d7b5d77ee14b7e906415a358bd98ab0762. commit 3196d1115cdfea698e2b80c803c5f910b95afb6b Author: Sandy Ryza Date: Thu Jan 3 16:45:09 2013 -0800 Revert "MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves)" This reverts commit 3b717cebba3da0c2cfe7d917d347a01d3b6e9d1b. commit 0cb91f599b19b797eb9303cd657af85787e75a9c Author: Robert Joseph Evans Date: Wed Oct 17 14:58:08 2012 +0000 MAPREDUCE-4721. Task startup time in JHS is same as job startup time. (Ravi Prakash via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399289 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2eaa3eaff9475480cd2617b19a9f8d431b8eed9e) commit b788428c68bdd1b338045849556d2779b474f61a Author: Vinod Kumar Vavilapalli Date: Wed Oct 17 01:24:50 2012 +0000 YARN-43. Fix TestResourceTrackerService to not depend on test order and thus pass on JDK7. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399066 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 442cdbf9e72b03c1bf37d840545daf4ccf2aa39b) commit 47e58b77c897f2ff93087800876e18ff6c7702e8 Author: Vinod Kumar Vavilapalli Date: Wed Oct 17 00:31:51 2012 +0000 YARN-161. Fix multiple compiler warnings for unchecked operations in YARN common. Contributed by Chris Nauroth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399056 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 627be182c75f4e19493b0d734eac7c78e5fab361) commit 6c94455ee3e274d08a00f94a32fbc93ea464a86a Author: Robert Joseph Evans Date: Tue Oct 16 22:00:03 2012 +0000 MAPREDUCE-4521. mapreduce.user.classpath.first incompatibility with 0.20/1.x (Ravi Prakash via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399011 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 45dadfbaee7943cb3e51e9eb43d20a46988318f5) commit b16834ed9d1124c915b00a5a2552492c8e0ddd38 Author: Arun Murthy Date: Thu Oct 11 17:21:45 2012 +0000 MAPREDUCE-4616. Improve javadoc for MultipleOutputs. Contributed by Tony Burton. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1397182 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 09bea516c85295d5bca8b5368ce8254a9556e013) commit 323944d312e8a2505ce60c2ce87629810538d0bf Author: Siddharth Seth Date: Wed Oct 10 00:08:25 2012 +0000 YARN-150. Fixes AppRejectedTransition does not unregister a rejected app-attempt from the ApplicationMasterService (Contributed by Bikas Saha) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396429 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ee1172e46e247ac703781202208a582075170707) commit 4b987e05884ae19f7f563e68107e17e8a75e0de7 Author: Vinod Kumar Vavilapalli Date: Tue Oct 9 22:54:11 2012 +0000 YARN-30. Fixed tests verifying web-services to work on JDK7. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396391 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bd4318d5d9309a7ebfbfea1f939e024f61791c13) commit 7097165a48b165f36539fec588e1a71596b1bd80 Author: Vinod Kumar Vavilapalli Date: Tue Oct 9 19:40:31 2012 +0000 YARN-94. Modify DistributedShell to point to main-class by default, clean up the help message, and hard-code the AM class. Contributed by Hitesh Shah. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396226 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 28bc363a6849eab31e125afe1757dcfeb93ab39e) commit ebca90151484a2d9ce18caf18759e5a6700b8a56 Author: Siddharth Seth Date: Tue Oct 9 03:23:07 2012 +0000 MAPREDUCE-4705. Fix a bug in job history lookup, which makes older jobs inaccessible despite the presence of a valid history file. (Contributed by Jason Lowe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395850 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 472bda29518e228de55caf298d998e54478ad529) commit e5ee3cfa4dd2a4cb3e3600cdf5ab13a744ef8bda Author: Siddharth Seth Date: Tue Oct 9 02:26:24 2012 +0000 YARN-33. Change LocalDirsHandlerService to validate the configured local and log dirs. (Contributed by Mayank Bansal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395844 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 382dcf64eb1b94a0f0a7a7c2d9de2f85feee18b5) commit 32bb58fad5ab41c660eb351130d83944699338bb Author: Sandy Ryza Date: Thu Jan 3 13:58:58 2013 -0800 Revert "YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. Contributed by Vinod K V." This reverts commit 4543569919881a07a8f5539fbaf51567d6c29527. commit 390b49a3690ffad058635226564d58c51ca484fb Author: Thomas White Date: Thu Jan 3 15:26:55 2013 +0000 YARN-301. Fair scheduler throws ConcurrentModificationException when iterating over app's priorities. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428400 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 10f41f7c38a9af1981d38c87fea543249f231325) commit ef1ef8f5b6d963622641caba685552441ad0e9aa Author: Thomas White Date: Thu Jan 3 15:07:22 2013 +0000 YARN-300. After YARN-271, fair scheduler can infinite loop and not schedule any application. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428387 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bc887dc6c28427d3ddcf17b35b535d931d2b6803) commit b07e925a662f82838d19365f890c52bd9dacfb52 Author: Thomas White Date: Thu Jan 3 14:32:01 2013 +0000 YARN-288. Fair scheduler queue doesn't accept any jobs when ACLs are configured. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428362 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 45347e581c179d7ad9e7fbfee1b6c4f9aec7b4bf) commit 626d6e244a9f1f3a1919e5c719f5810e5e62ef4a Author: Thomas White Date: Thu Jan 3 12:29:13 2013 +0000 YARN-192. Node update causes NPE in the fair scheduler. Contributed by Sandy Ryza git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428314 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 12bf8447ccb4be21e9634dde97407c45edcdbb28) commit a89e5ec5eb6e120cf69e6725a99c32e65bac6072 Author: Todd Lipcon Date: Thu Jan 3 20:55:09 2013 +0000 HDFS-4302. Fix fatal exception when starting NameNode with DEBUG logs. Contributed by Eugene Koontz. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1428591 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ce03fd2e43ba5104de54a8e3420713fd31aa2ae3) commit 8e8609c0e0ae629449c954157de8bfed078c33ee Author: Aaron Twining Myers Date: Thu Jan 3 02:25:08 2013 +0000 HDFS-4338. TestNameNodeMetrics#testCorruptBlock is flaky. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1428144 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5c36fca386153f7b8cb807374313a74f8dbba58f) commit 6d247a0e74d537035f0b4a82cef768209f070591 Author: Suresh Srinivas Date: Tue Oct 23 20:02:09 2012 +0000 HDFS-2434. TestNameNodeMetrics.testCorruptBlock fails intermittently. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1401423 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3aa9241cac8eed545109d8e3c961c0f3981b68bb) commit 9a583d27e995d3b0a6c1f1f4b54387bfe57b1a2f Author: Vinod Kumar Vavilapalli Date: Mon Oct 8 22:18:42 2012 +0000 YARN-40. Provided support for missing YARN commands Contributed by Devaraj K and Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395793 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a0c3abdc8185071aa4bcaf2baa2c299cce4c1d1a) commit 5b9afde3f6b3f2fc7a61c8c1f7dc85f8b7963948 Author: Vinod Kumar Vavilapalli Date: Mon Oct 8 21:21:38 2012 +0000 YARN-127. Move RMAdmin tool to its correct location - the client module. Contributed by Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395781 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cb4e96d88d29e9043d59fb1bee9ed13548654d32) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/pom.xml commit f5877b58b879d4dc56ca1586ba4f539dfcd905fb Author: Robert Joseph Evans Date: Mon Oct 8 20:50:40 2012 +0000 MAPREDUCE-4554. Job Credentials are not transmitted if security is turned off (Benoy Antony via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395769 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 219b190ada2efd415fa01626820b44f39f3d177e) commit 3b717cebba3da0c2cfe7d917d347a01d3b6e9d1b Author: Thomas Graves Date: Mon Oct 8 19:03:43 2012 +0000 MAPREDUCE-4712. mr-jobhistory-daemon.sh doesn't accept --config (Vinod Kumar Vavilapalli via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395724 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f0ca485870fdfc4a590984591a7989f62cf2b039) commit 26f4e33ed60acd2d1a1f9a676180988b3c602177 Author: Siddharth Seth Date: Wed Oct 3 21:24:55 2012 +0000 MAPREDUCE-4123. Remove the 'mapred groups' command, which is no longer supported. (Contributed by Devaraj K) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393775 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 61653495570657ff3bc53aaa786684e8ecc78be5) commit 202f4f99145b84e114fe6dd63fe9c84bdfe27f29 Author: Siddharth Seth Date: Wed Oct 3 21:19:11 2012 +0000 YARN-102. Move the apache header to the top of the file in MemStore.java. (Contributed by Devaraj K) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393769 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 11b1df159b2bc2cfec394e755a7485c23766bf7d) commit fc66bcb9b3834d8430b7f194007379f1ea631589 Author: Siddharth Seth Date: Wed Oct 3 02:56:20 2012 +0000 YARN-131. Fix incorrect ACL properties in capacity scheduler documentation. (Contributed by Ahmed Radwan) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393262 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit be842918157cffe5d5c8e9c2e7b224d8526e8061) commit dc007ddab9f89563583d8c80d942bf26ea6793d3 Author: Arun Murthy Date: Sun Sep 30 03:32:07 2012 +0000 YARN-138. Ensure default values for minimum/maximum container sizes is sane. Contributed by Harsh J and Siddharth Seth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391944 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3cc8597e255eebd7e4676f0a628a62315f18492b) Conflicts: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/TestFairScheduler.java commit 6321a601778f2135a9a676dc49e72ee6d23f6542 Author: Karthik Kambatla Date: Thu Dec 27 23:10:00 2012 -0800 CLOUDERA-BUILD. Set DefaultScheduler to FifoScheduler commit 21a098000c77ccace60e8a0f3464fcef0cb655c4 Author: Arun Murthy Date: Sun Sep 30 00:41:24 2012 +0000 YARN-137. Change the default YARN scheduler to be the CapacityScheduler. Contributed by Siddharth Seth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391929 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 951ebce7e2ba2cefe97b084e4784e515975e7766) commit 8c9381311142659a990e47c2a24af51c130a41e1 Author: Siddharth Seth Date: Sat Sep 29 22:39:03 2012 +0000 YARN-116. Add the ability to change the RM include/exclude file without a restart. (Contributed by xieguiming and Harsh J) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391912 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a422e612f114ef84677bdeda603576775b30a151) commit df8ea42ebe45989a9712d14403ecb9950f8ee0a2 Author: Robert Joseph Evans Date: Fri Sep 28 22:17:32 2012 +0000 MAPREDUCE-4689. JobClient.getMapTaskReports on failed job results in NPE (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391679 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 076d285ac838dbae1ee28b93a4b7e492cc31f4ff) commit 25b76ff2552fe0d70c54730a765405bb237d8d77 Author: Jason Darrell Lowe Date: Fri Sep 28 21:55:45 2012 +0000 MAPREDUCE-4691. Historyserver can report "Unknown job" after RM says job has completed. Contributed by Robert Joseph Evans. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391671 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9d91daeefc9e42ed5848f214c5774bdde6c9c6bb) commit 187837e1763cf0fa560d4b2ca5c4f6ffc54745e2 Author: Robert Joseph Evans Date: Fri Sep 28 20:50:44 2012 +0000 YARN-106. Nodemanager needs to set permissions of local directories (jlowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1391649 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c89a1a41f162b54b28bdc3a7f6f4c576d042be91) commit f0dac216a3eb8100814a35def589d1964edeacbe Author: Arun Murthy Date: Fri Sep 7 15:48:39 2012 +0000 YARN-57. Allow process-tree based resource calculation et al. to be pluggable to support it on multiple platforms. Contributed by Radim Kolar. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382072 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f44ee8a38aaf7e1068bc7a898c39bc3c4629b1ba) commit 56a0c31d67ea15b19cbb960062ac01b19f04c327 Author: Thomas Graves Date: Wed Sep 26 15:22:21 2012 +0000 MAPREDUCE-4647. We should only unjar jobjar if there is a lib directory in it. (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390557 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5f8e4c992512fcc7ab495ad559a2d7bac3c5e4af) commit 515bb6d7b5d77ee14b7e906415a358bd98ab0762 Author: Arun Murthy Date: Tue Sep 25 23:49:09 2012 +0000 MAPREDUCE-4649. Ensure MapReduce JobHistory Daemon doens't assume HADOOP_YARN_HOME and HADOOP_MAPRED_HOME are the same. Contributed by Vinod K V. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390224 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 60bcf910456b959e5f27a5142a412ff86d57bffd) commit 4543569919881a07a8f5539fbaf51567d6c29527 Author: Arun Murthy Date: Tue Sep 25 23:37:32 2012 +0000 YARN-9. Rename YARN_HOME to HADOOP_YARN_HOME. Contributed by Vinod K V. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390218 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1810f5471c65e1d25d6decb53ef8094ada3f11b8) commit 24a3085c39320449647e5a03760fca491c910d48 Author: Konstantin Shvachko Date: Tue Sep 25 21:32:29 2012 +0000 MAPREDUCE-4651. Benchmarking random reads with DFSIO. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390159 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit eeb7a1375bf47300e7f4d3378d1ed26e03b0a6a3) commit 09184f9c3726d0dfccb6c2ff8e8fb770a4dc7636 Author: Konstantin Shvachko Date: Mon Sep 24 20:54:20 2012 +0000 MAPREDUCE-4645. Provide a random seed to Slive to make the sequence of file names deterministic. Contributed by Ravi Prakash. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389568 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3de5d4d0a4b3c78b69a781ad77eced26a1ab5971) commit 0fd709b171b6572c19dd86286fea0f28d7a26de0 Author: Vinod Kumar Vavilapalli Date: Mon Sep 24 00:51:51 2012 +0000 YARN-53. Added the missing getGroups API to ResourceManager. Contributed by Bo Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389176 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9e691b122a9e507cd2844d9923e4be0b55bc3505) commit 67a8c78b44cddaedfd26f1aba59575f22334f915 Author: Eli Collins Date: Fri Sep 21 20:15:07 2012 +0000 MAPREDUCE-4674. Hadoop examples secondarysort has a typo "secondarysrot" in the usage. Contributed by Robert Justice git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388661 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0f8b4a3225343995d340779e87ebc4ea19189ee4) commit ec8bc746e34beb5e866096c1e1e7b6d130d955c2 Author: Siddharth Seth Date: Fri Sep 21 17:29:33 2012 +0000 YARN-88. DefaultContainerExecutor can fail to set proper permissions. (Contributed by Jason Lowe) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388580 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 87deb7e435656dc72b2fb6ca686012b789e9cc54) commit 762c63940657a68d3fbabcdf6d3b06dbfd268aaf Author: Siddharth Seth Date: Fri Sep 21 06:28:47 2012 +0000 YARN-82. Change the default local and log dirs to be based on hadoop.tmp.dir and yarn.log.dir. (Contributed by Hemanth Yamijala) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388339 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3dac9f0ea14168ce2026001aba412a758f63218a) commit 6c2c4e3680dd8a380abb1fe4e1d1f3b3402dd4eb Author: Vinod Kumar Vavilapalli Date: Mon Sep 17 23:30:27 2012 +0000 YARN-28. Fixed TestCompositeService to not depend on test-order and thus made it pass on JDK7. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386907 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2f5acb03b4ec821a03e232e2cb882d4e7e615082) commit b2eafd2b807bc97e4a802392dcbfe02959f6c212 Author: Robert Joseph Evans Date: Mon Sep 17 21:05:11 2012 +0000 YARN-108. FSDownload can create cache directories with the wrong permissions (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386838 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e6d6e5c5d9e1ae8903b0dcda4d2c3a4ad152c2df) commit ee939eaed32ae5034d9db769cc0851921808d6cc Author: Vinod Kumar Vavilapalli Date: Thu Sep 13 00:46:39 2012 +0000 YARN-93. Fixed RM to propagate diagnostics from applications that have finished but failed Contributed by Jason Lowe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384169 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9e7a84a6716b5c91f5a3edb04aa7b01e4a7564ff) commit e07d8ac769491a815c4f221d32854aac0b16d576 Author: Vinod Kumar Vavilapalli Date: Wed Sep 12 00:59:15 2012 +0000 MAPREDUCE-4646. Fixed MR framework to send diagnostic information correctly to clients in case of failed jobs also. Contributed by Jason Lowe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383709 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 795a37ccf8c0b8927fa0d4211185998a8972f4a1) commit 951bc3758d8e7a4f15751c09f68fe0a10fec98b9 Author: Vinod Kumar Vavilapalli Date: Wed Sep 12 00:49:17 2012 +0000 YARN-78. Changed UnManagedAM application to use YarnClient. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383705 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0f77818bc4e6e44a3d7b408bbab1d6697f0e892b) commit 87989175db53a2adb36e08ffe2086a2b22e4b342 Author: Robert Joseph Evans Date: Fri Sep 7 16:45:03 2012 +0000 MAPREDUCE-4629. Remove JobHistory.DEBUG_MODE (Karthik Kambatla via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382088 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7ca6c6948aa5c15982dd484b9e8ef5a84ff1aa63) commit 72781798d3fe7147d32180231ced1ac60e709268 Author: Vinod Kumar Vavilapalli Date: Fri Sep 7 00:04:40 2012 +0000 YARN-75. Missing test. Ugh. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381811 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 08fcfa70c13b6d061f995f4be1f7e46f71da1cec) commit b9427c72328ddd6a8682e12868f8778d9fe5e1b1 Author: Vinod Kumar Vavilapalli Date: Thu Sep 6 23:55:10 2012 +0000 YARN-75. Added file missing from previous commit. Bad day with svn. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381809 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7c5c2655ec06e8716787dfb80eee7d54770e1bf) commit c4af2a62d68ad3b785840007a349b4c1540206d7 Author: Vinod Kumar Vavilapalli Date: Thu Sep 6 23:47:41 2012 +0000 YARN-75. Removing spurious file from the previous commit. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381807 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 240d2324353f4a3bfcb2c2f95d0a61a8a15a6e67) commit cf0aaa9f0f7f494cd8f45f479c97733936387d9b Author: Vinod Kumar Vavilapalli Date: Thu Sep 6 23:46:31 2012 +0000 YARN-75. Modified ResourceManager's RMContainer to handle a valid RELEASE event at RUNNING state. Contributed by Siddharth Seth. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381806 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c45794e8a10c62e6b9922ff3a664d0bb1c471cfe) commit d36f212f85057f92219700091c9e92f3f5dd4183 Author: Vinod Kumar Vavilapalli Date: Thu Sep 6 23:06:35 2012 +0000 YARN-15. Updated default classpath for YARN applications to reflect split of YARN into a sub-project. Contributed by Arun C Murthy. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381794 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dc95674753127dc6de6c63cda4d3c6cd97385f84) commit caecae9a27419294bcbe4ae0c95b40f3d01ec8cf Author: Robert Joseph Evans Date: Thu Sep 6 22:20:15 2012 +0000 MAPREDUCE-4641. Exception in commitJob marks job as successful in job history (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381784 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b86f5f5609df5c25e3381563bf6c14b1b8a4ea4e) commit 5912516aa8bae4ef7db139dba9bc7b1ffd6a99bc Author: Robert Joseph Evans Date: Thu Sep 6 14:20:43 2012 +0000 MAPREDUCE-4633. history server doesn't set permissions on all subdirs (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381614 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5a6767b2f491b3290627257de1ba3c0391d9bc5d) commit b6727f1cb697c6c1a1734f3517e6994e15e80915 Author: Robert Joseph Evans Date: Wed Sep 5 19:39:53 2012 +0000 YARN-68. NodeManager will refuse to shutdown indefinitely due to container log aggregation (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381317 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d27bff104a4150b15e384a9ea449ce6cd8aa002d) commit 7d2d95dbae17d811262780927cc76bfc4db4253f Author: Eli Collins Date: Wed Sep 5 19:34:03 2012 +0000 Fix MAPREDUCE-4580 build breakage. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381315 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d6b7706c0c61d0a3d4de2ad7febfd0aa13a97c27) commit d8989405853673a71a81af91be70594ddf6b6f66 Author: Vinod Kumar Vavilapalli Date: Wed Sep 5 17:54:32 2012 +0000 YARN-83. Change package of YarnClient to org.apache.hadoop. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381273 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3c0367303364823ccb5c96aaf50b59df02b3f473) commit 03a3df805472bc46cd3b4f64ea99e45fe39e571a Author: Vinod Kumar Vavilapalli Date: Wed Sep 5 02:46:07 2012 +0000 YARN-42. Modify NM's non-aggregating logs' handler to stop properly so that NMs don't get NPEs on startup errors. Contributed by Devaraj K. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380954 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f00495a4baaa6c3243f9519c4e19c12f07f8ae26) commit ebf0f08bf8e65cdb11f3823890c8d749b024ac29 Author: Vinod Kumar Vavilapalli Date: Wed Sep 5 00:14:35 2012 +0000 YARN-79. Implement close on all clients to YARN so that RPC clients don't throw exceptions on shut-down. Contributed by Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380942 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d123c4c0d828634756c39e67f13c0efc0984df10) Conflicts: hadoop-yarn-project/CHANGES.txt commit 5eefed12ed4a19bd99543a7282754cdd9375bb16 Author: Vinod Kumar Vavilapalli Date: Tue Sep 4 20:56:53 2012 +0000 YARN-10. Fix DistributedShell module to not have a dependency on hadoop-mapreduce-client-core. Contributed by Hitesh Shah. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380879 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dab6391f2cd55139a392c54bb9c6db763e4c520e) commit a35f20de72bcbffbd73a4618e61df8e65460105d Author: Konstantin Shvachko Date: Mon Sep 3 18:54:27 2012 +0000 MAPREDUCE-2786. Add compression option for TestDFSIO. Contributed by Plamen Jeliazkov. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380310 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 62951d0503b1cc9c345a24fbd7a73aead0d11b01) commit 2cb8098433d0270798c7fb72dade7f043a3e8f1e Author: Jonathan Turner Eagles Date: Fri Aug 31 21:25:25 2012 +0000 MAPREDUCE-4604. In mapred-default, mapreduce.map.maxattempts & mapreduce.reduce.maxattempts defaults are set to 4 as well as mapreduce.job.maxtaskfailures.per.tracker. (Ravi Prakash via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379617 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 50875a6038d797f5812acf6e42df7ff9060fb16e) Conflicts: hadoop-mapreduce-project/src/java/mapred-default.xml doesn't exist. Made changes to hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/resources/mapred-default.xml commit 1b16bcb32f94ca21f22ae0dce6e01094fe61b4ff Author: Daryn Sharp Date: Fri Aug 31 21:31:55 2012 +0000 HDFS-3852. TestHftpDelegationToken is broken after HADOOP-8225 (daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379623 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3e23ed8dadd526dccb9c37f4bffd9228fb0796d5) commit 68c0518b3e54cc53faaca6a11f1889633f7863a4 Author: Thomas Graves Date: Fri Aug 31 20:43:46 2012 +0000 MAPREDUCE-4611. MR AM dies badly when Node is decommissioned (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379599 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8528ba8bedb95a67abd0e5486d71edd92435eb7b) commit 9023bec461fd057e6cb6135516b303b3f39be293 Author: Robert Joseph Evans Date: Fri Aug 31 20:37:41 2012 +0000 MAPREDUCE-4614. Simplify debugging a job's tokens (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379595 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 14f25a609ecf8ccc8c567f1a22382dfc6e7f14d1) commit a0a279affa83b6fa3577655da1e3865d26bf4a2b Author: Robert Joseph Evans Date: Thu Aug 30 19:58:07 2012 +0000 HADOOP-8726. The Secrets in Credentials are not available to MR tasks (daryn and Benoy Antony via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379100 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f2d001c30b0b5488986a741d524638c3235fdbe8) commit ab2bbdf0367e26d7ee13d3f80ac4e54e392289fd Author: Robert Joseph Evans Date: Fri Aug 24 14:16:41 2012 +0000 HADOOP-8725. MR is broken when security is off (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376929 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4194edd29c81ea7993c749dceb77f2b1bfcb1d23) commit 452cf09d2e13c668d94573fe67f12cdfbe7b50e8 Author: Robert Joseph Evans Date: Thu Aug 23 18:06:56 2012 +0000 HADOOP-8225. DistCp fails when invoked by Oozie (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376618 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6056a9d951bdd62f2cbc224f2078f30549729947) commit 451bf34b3db748aa39fd86743217c707b7d2bd99 Author: Daryn Sharp Date: Fri Aug 17 14:05:11 2012 +0000 HADOOP-7967. Need generalized multi-token filesystem support (daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374271 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a4bd530e084b6a4c5e35fa267ac2f401c280009f) commit ac1fae11f55510d38100f56aa034d80ef6fd5b4a Author: Alejandro Abdelnur Date: Fri Dec 21 16:20:12 2012 +0000 YARN-283. Fair scheduler fails to get queue info without root prefix. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424998 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 21fde01b8b715516a3f8ddc280356a24e00c3ba7) commit 0fd5301d9928583436fe2b97f89111008f63f889 Author: Alejandro Abdelnur Date: Fri Dec 21 16:12:20 2012 +0000 YARN-282. Fair scheduler web UI double counts Apps Submitted. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424995 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit baeffc8b55383700950f263f16c8ccea90631ffa) commit e0a13ca38a5be271c6f8e2f8ee59943c25c26924 Author: Alejandro Abdelnur Date: Fri Dec 21 16:07:11 2012 +0000 YARN-278. Fair scheduler maxRunningApps config causes no apps to make progress. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424989 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 92e4dd5f5ba24a20b8b04c61f9b3fb280bda651b) commit 46c1c4c6ad4405f3e8478512f2fbc48745a5cff0 Author: Alejandro Abdelnur Date: Fri Dec 21 16:01:48 2012 +0000 YARN-272. Fair scheduler log messages try to print objects without overridden toString methods. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424984 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e8501b36dedfe6fb1ff235408dc5e6c3ca0d091a) commit 0b0f5ea5f1ef42d73f92dcdcd1e267741900421b Author: Thomas White Date: Fri Dec 21 15:10:24 2012 +0000 YARN-271. Fair scheduler hits IllegalStateException trying to reserve different apps on same node. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1424945 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 398ca56a97b332b093b54bb387b8a716b068be70) commit 13872c460043f18b948454a92fe660a794019fa7 Author: Robert Joseph Evans Date: Fri Aug 31 20:25:27 2012 +0000 MAPREDUCE-4612. job summary file permissions not set when its created (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379584 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 64890d4253130ae8d5e2f17e3ca561918b36ccc2) commit f4e79655a960629e024d37bca690e44f23eb2ef8 Author: Robert Joseph Evans Date: Fri Aug 31 19:57:34 2012 +0000 YARN-66. aggregated logs permissions not set properly (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379565 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 66173f3ea8d5e84103b9ac20ae84fd9e29972220) commit cc2a4d3614e18ce533584a02af6a9e6e3838a540 Author: Robert Joseph Evans Date: Fri Aug 31 19:24:31 2012 +0000 YARN-60: Fix minor merge conflict (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379555 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 96bf582f4b24be763883439e42b94040f57368c4) commit accd973d0c3c5e2c4a51f6c5ce8b98f584a76a2d Author: Vinod Kumar Vavilapalli Date: Fri Aug 31 19:11:05 2012 +0000 YARN-60. Fixed a bug in ResourceManager which causes all NMs to get NPEs and thus causes all containers to be rejected. Contributed by Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379550 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ce96b9873b9caaed94853d17f7df2be6d7efc7b7) commit 4d5867a5c54b0557598302dc6c8d3b489f620a10 Author: Robert Joseph Evans Date: Fri Aug 31 16:33:21 2012 +0000 YARN-63. RMNodeImpl is missing valid transitions from the UNHEALTHY state (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379498 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 71b56fc55d871712d4b89877ef7b3a83b973ad6d) commit 7019b3e7e1df60ee0d0e307edb1cf7c8361311fa Author: Vinod Kumar Vavilapalli Date: Thu Aug 30 21:02:55 2012 +0000 MAPREDUCE-4569. Fixed TestHsWebServicesJobsQuery to pass on JDK7 by not depending on test order. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379146 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9e8f0af933d7d8c1428dcfbe011fc148ae71b612) commit 8fd06cc4dc8ad7cbfea2ff647e578f1e4cf8fe80 Author: Vinod Kumar Vavilapalli Date: Tue Aug 28 03:31:11 2012 +0000 YARN-31. Fix TestDelegationTokenRenewer to not depend on test order so as to pass tests on jdk7. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377961 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fb919b6c9bf76ea129b768bb15c279274bad6931) commit 5efb2c259061fee4ba5a022e1613df33096341f2 Author: Vinod Kumar Vavilapalli Date: Tue Aug 28 02:03:26 2012 +0000 MAPREDUCE-4579. Split TestTaskAttempt into two so as to pass tests on jdk7. Contributed by Thomas Graves. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377943 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 493886b2fa1f7b0c7240c57443cbf55cd249d383) commit 47ba534a1adae6aba18cbdf95c1a5e3bc8073841 Author: Siddharth Seth Date: Tue Aug 28 00:40:02 2012 +0000 MAPREDUCE-4580. Change MapReduce to use the yarn-client module. (Contributed by Vinod Kumar Vavilapalli) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377922 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5fe26a737cf3baa0292ac9cd720562aab3ee06c6) commit 8fa1e7c119018a290ee34be931ac0abf4aaf99bc Author: Siddharth Seth Date: Mon Aug 27 19:35:45 2012 +0000 YARN-37. Change TestRMAppTransitions to use the DrainDispatcher. (Contributed by Mayank Bansal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377803 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b516b8c5c4b07f44fa8ffc9d0580f56ad255cd36) commit 90b50a5adfad4b52cdd21fdbefc13d3fd82eeebf Author: Thomas Graves Date: Thu Sep 6 02:08:37 2012 +0000 YARN-87. NM ResourceLocalizationService does not set permissions of local cache directories (Jason Lowe via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381459 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5965e6763ac374136058ad471faefcc5d288e586) commit 8fca711ea5add34ca61c08579beb62959ab4504b Author: Mark Grover Date: Wed Dec 19 17:54:39 2012 -0800 CDH-8545: Package Job Tracker High Availability commit bd7987ab54f555725c02717fcbfbb7fa79fb9000 Author: Alejandro Abdelnur Date: Wed Dec 19 03:04:39 2012 +0000 YARN-254. Update fair scheduler web UI for hierarchical queues. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423742 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2ac48a14c9d2d440b57fbd94593c9080ac387094) commit 51edb6344bf26bcef30a8192f00eedb63a55a6e4 Author: Thomas White Date: Wed Dec 19 11:15:29 2012 +0000 Merge -r 1423823:1423824 from trunk to branch-2. Fixes: HADOOP-9153. Support createNonRecursive in ViewFileSystem. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1423825 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8b3b84c62915a83803f4f5ec05217529c750b6f2) commit 49a18521e7f5c7b973443064af43ba2b9309fd48 Author: Jason Darrell Lowe Date: Tue Nov 13 05:53:26 2012 +0000 HADOOP-9025. org.apache.hadoop.tools.TestCopyListing failing. Contributed by Jonathan Eagles git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408604 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7b08bfef09e60c32865a486f55214d9784d9339e) commit f61cd119c2ee73df59661ec3b41e18b112ff8fbe Author: Thomas White Date: Tue Dec 18 15:23:49 2012 +0000 MAPREDUCE-4845. ClusterStatus.getMaxMemory() and getUsedMemory() exist in MR1 but not MR2. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1423470 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 477bf0fb14334c75b2884ab2998ae3eca8517308) commit ece7c91fd84a1efcbf26345cfda2968789f9b56c Author: Jason Darrell Lowe Date: Fri Oct 12 20:00:31 2012 +0000 svn merge -c 1397704 FIXES: HADOOP-8906. paths with multiple globs are unreliable. Contributed by Daryn Sharp. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1397708 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0de4b2b3e7978b59083820da1d5a8004bb8ba8bc) commit 38c78c42a1e0b03c50607d961ce09e983e798c25 Author: Alejandro Abdelnur Date: Mon Dec 10 18:07:20 2012 +0000 MAPREDUCE-4703. Add the ability to start the MiniMRClientCluster using the configurations used before it is being stopped. (ahmed.radwan via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1419618 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6dc8ac4726197b91dc8bd9d8b6bfd449bbede7e6) commit a21d02779d8e3d61a92189976b1c5e9406941ff0 Author: Siddharth Seth Date: Mon Aug 27 18:27:18 2012 +0000 YARN-29. Add a yarn-client module. (Contributed by Vinod Kumar Vavilapalli) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377781 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1754c8968e11d5487d3618829844e84923ede813) commit 2fd26863fe7653ec34b010167bedcb107ccfabcf Author: Siddharth Seth Date: Sat Aug 25 02:18:49 2012 +0000 YARN-39. RM-NM secret-keys should be randomly generated and rolled every so often. (Contributed by Vinod Kumar Vavilapalli and Siddharth Seth) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377180 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f69c51d9c8bbc139e2acab0f33eee99322715762) commit b616346e0c54b17a7d8fbdc9cf5bbd144cd77f16 Author: Siddharth Seth Date: Tue Aug 21 22:27:11 2012 +0000 YARN-22. Fix ContainerLogs to work if the log-dir is specified as a URI. (Contributed by Mayank Bansal) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375829 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cb9b62b9aa972484a415ce0ec943887a60fe161c) commit 2c4cadf003b844a4122a9a6e61ef3d6542afa7b4 Author: Thomas White Date: Wed Dec 12 14:35:01 2012 +0000 YARN-267. Fix fair scheduler web UI. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420704 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 15221cd7ef3b306df423b9e3c229fd353f6ae96b) commit ea00eb2d87c552199fadf728c53c27a79781cb0a Author: Jason Darrell Lowe Date: Tue Dec 11 15:45:10 2012 +0000 YARN-266. RM and JHS Web UIs are blank because AppsBlock is not escaping string properly. Contributed by Ravi Prakash git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420232 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9ddab417174657bc8de40607ffb36335016dd81b) commit 87719afb7e6cfd164f133aac3c8030f9bee567f5 Author: Robert Joseph Evans Date: Fri Nov 16 17:30:22 2012 +0000 MAPREDUCE-4802. Takes a long time to load the task list on the AM for large jobs (Ravi Prakash via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410498 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3c643ead6f2e44834aa7b7ea9ee25ee0e0fdd730) commit b734b792bfa7270a019389ad6bd4914b0f5f3bd4 Author: Jason Darrell Lowe Date: Thu Dec 6 15:39:30 2012 +0000 YARN-258. RM web page UI shows Invalid Date for start and finish times. Contributed by Ravi Prakash git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1417948 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 86ef2b587b8710bf0dc9534e6600f7fc3aa232db) commit 062a6a8f42770eacd5f1ba57c2013357cebcf971 Author: Robert Joseph Evans Date: Fri Nov 16 20:56:08 2012 +0000 YARN-151. Browser thinks RM main page JS is taking too long (Ravi Prakash via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410564 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 26f0e56ee26d800a7d9305cdf701e36de0801884) commit 3d8c3eb0505d47bc843aae10feb75d27e569d458 Author: Robert Joseph Evans Date: Thu Nov 15 00:01:07 2012 +0000 MAPREDUCE-4720. Browser thinks History Server main page JS is taking too long (Ravi Prakash via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409580 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f2da57b6ea2b8995e445605d2051fd659f1a1143) commit 69f8caf11a21b06c79cf312e7d0200324e2de624 Author: Aaron Twining Myers Date: Mon Dec 17 07:53:35 2012 +0000 HDFS-4315. DNs with multiple BPs can have BPOfferServices fail to start due to unsynchronized map access. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1422780 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b61e649388f84abfbe2abb23523d55777469d521) commit 8d1f62766450ec4e9afd61688356c088fabae712 Author: Tsz-wo Sze Date: Fri Oct 26 18:22:49 2012 +0000 HDFS-3616. Fix a ConcurrentModificationException bug that BP actor threads may not be shutdown properly in DataNode. Contributed by Jing Zhao git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402608 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 76c8aaaf6f6c02c8450e6b0e5433b1f73059bc77) commit e4538e73ebcb6717cc34e360e188374e3473f877 Author: Thomas White Date: Wed Dec 12 12:12:10 2012 +0000 MAPREDUCE-4856. TestJobOutputCommitter uses same directory as TestJobCleanup. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420634 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 31f5eebc2c789210d295f3de6d5bc4479d3ada68) commit ee99c55976607469063572121126580ed4f3a663 Author: Thomas White Date: Tue Sep 11 14:04:03 2012 +0000 MAPREDUCE-4607. Race condition in ReduceTask completion can result in Task being incorrectly failed. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383422 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ad272fe3ead72e776b66987e9d23e28819eb4fdd) commit 8bd696b022c32241db966caefadbd949fd543f1f Author: Eli Collins Date: Wed Sep 12 04:29:59 2012 +0000 HDFS-3919. MiniDFSCluster:waitClusterUp can hang forever. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383761 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f595e40f9cff46c20d4d8a7be09e15fcc9bcb4e) commit 968f0b702d7890804877da8af9940818d47ac622 Author: Tsz-wo Sze Date: Wed Sep 26 13:26:21 2012 +0000 svn merge -c 1390466 from trunk for HDFS-3373. Change DFSClient input stream socket cache to global static and add a thread to cleanup expired cache entries. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1390470 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 849de42b8b8a5ea3e114de504f331af7e7efd2da) commit fe559b30a46c8689fc02d27da630bf17bae1754d Author: Robert Joseph Evans Date: Mon Aug 20 21:17:13 2012 +0000 HADOOP-8611. Allow fall-back to the shell-based implementation when JNI-based users-group mapping fails (Robert Parker via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375221 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2b651c88e91235834bbc6602f42cdaf22b59a7ce) commit 5dff2cd5c5c700c9bad6f1d95bc5d317c961bfbd Author: Daryn Sharp Date: Thu Nov 15 15:55:36 2012 +0000 svn merge -c 1409848 FIXES: HDFS-4104. dfs -test -d prints inappropriate error on nonexistent directory (Andy Isaacson via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409850 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 309ac1a0398ecee5f5afb1a2a558abee4cc60128) commit 20c3544f166d430da0976157f9e71f365dfe01b1 Author: Eli Collins Date: Wed Dec 12 00:10:37 2012 +0000 HADOOP-9113. o.a.h.fs.TestDelegationTokenRenewer is failing intermittently. Contributed by Karthik Kambatla git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1420490 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 981fe60fc5ab568fd814488d3ba6dbfbf41443a8) commit 3e2d40de614aecdb5eb8f316b702089f14a34f9b Author: Alejandro Abdelnur Date: Tue Dec 11 19:50:32 2012 +0000 MAPREDUCE-4549. Distributed cache conflicts breaks backwards compatability. (Robert Evans via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1420363 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9aba3ebb2d455932981cc37fe8e3fa7a6ec4da82) commit e2c5be0340e33c4bb9df28a88a3d880b5aca3ee5 Author: Daryn Sharp Date: Tue Oct 23 15:12:43 2012 +0000 svn merge -c 1401309 FIXES: HDFS-4090. getFileChecksum() result incompatible when called against zero-byte files. (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1401315 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7190615179eb5c4e708a381b733cf2c53a3d7589) commit 464726f0ec0f1538f14626bbe716d29b458e94df Author: Tsz-wo Sze Date: Fri Aug 24 14:24:59 2012 +0000 svn merge -c 1376928 from trunk for HDFS-3177. Update DFSClient and DataXceiver to handle different checkum types in file checksum computation. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376937 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e828420487800a8b5d01323a61a738723b3a8962) commit aa97449e641083fd4c6cce5063ae3c04a5fd8a2e Author: Tsz-wo Sze Date: Tue Aug 21 09:49:00 2012 +0000 svn merge -c 1375450 from trunk for HADOOP-8239. Add subclasses of MD5MD5CRC32FileChecksum to support file checksum with CRC32C. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1375453 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2cd9dcfa63912b4b94ed26b761c146c40c3f7a7f) commit 9ccb3d89a3905a6effe9a8f71163c0b6e0a20175 Author: Tsz-wo Sze Date: Sun Aug 19 05:51:37 2012 +0000 svn merge -c 1374696 from trunk for HADOOP-8240. Add a new API to allow users to specify a checksum type on FileSystem.create(..). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374697 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5ba45e10500edb108447985177e601b1efff1f70) commit 747fff4fb533e42045933b0df0a1bf7d52b8ade8 Author: Tsz-wo Sze Date: Thu Aug 16 01:42:16 2012 +0000 svn merge -c 1373683 from trunk for HADOOP-8700. Use enum to define the checksum constants in DataChecksum. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373686 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 163c8ebcca8ff9a38cd9b6d4c4dc2a893ccc684f) commit 8cef4fe71529220bafff30dd29c11950e1b3823b Author: Aaron Twining Myers Date: Tue Dec 11 00:54:24 2012 +0000 HDFS-2264. NamenodeProtocol has the wrong value for clientPrincipal in KerberosInfo annotation. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419951 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c9bca2dfdbedf593fc9d707628001a8a9bf9b646) commit 15bd791f5e899423999758b3b3374acf2da33c25 Author: Uma Maheswara Rao G Date: Sun Oct 21 06:41:44 2012 +0000 Merge (r1400578) from trunk HDFS-4022. Replication not happening for appended block. Contributed by Vinay. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1400581 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 03cba7aaa8b4a2331acc8947574dad67edb18ce3) commit a44610a454113e4282ab595351b691ac8c56f8c2 Author: Todd Lipcon Date: Mon Dec 10 22:10:02 2012 +0000 HADOOP-9126. FormatZK and ZKFC startup can fail due to zkclient connection establishment delay. Contributed by Rakesh R and Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419832 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2d00b36857c15d1bfbe159477e0620a16337bd9d) commit 9523e25ee8b3b18ac5c636bb9c220ac112137cb7 Author: Todd Lipcon Date: Mon Dec 10 21:25:38 2012 +0000 HADOOP-6762. Exception while doing RPC I/O closes channel. Contributed by Sam Rash and Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419783 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 616cbf6a81b881afffc6ded55db8b1dd6ed621f6) commit 83c57eba4e1eecd25cbb26fd45fbcdc5cf9233d9 Author: Todd Lipcon Date: Mon Dec 10 19:13:09 2012 +0000 HDFS-4292. Sanity check not correct in RemoteBlockReader2.newBlockReader. Contributed by Binglin Chang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419676 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6438036709a8a5853a19aaf22654e76a464b0c2f) commit a2b4ff77decfed965d4628d4e30a32e72aab264d Author: Todd Lipcon Date: Mon Dec 10 18:55:06 2012 +0000 HDFS-4291. edit log unit tests leave stray test_edit_log_file around. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1419664 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1b97d62fcbe4c866f01ec3d422145b72be33fcde) commit cdd8f541fe1551b5f47afba199e05efaf6f082d6 Author: Alejandro Abdelnur Date: Fri Dec 7 18:46:41 2012 +0000 HADOOP-9054. Add AuthenticationHandler that uses Kerberos but allows for an alternate form of authentication for browsers. (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418429 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 460e8c4a1b0b3fc51635b833ee7ddb35c540549b) commit a6652955a0e15fff4c83675e201588e4455b2941 Author: Alejandro Abdelnur Date: Fri Dec 7 14:45:51 2012 -0800 HDFS-4236. Remove artificial limit on username length introduced in HDFS-4171. Contributed by Alejandro Abdelnur. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1418356 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e6cd334d4ae61e3c0de264eda58f19dedcc9b5da) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 4b9a60fa2587ac259b7cf64764c45b0166461420 Author: Robert Joseph Evans Date: Tue Aug 21 15:20:21 2012 +0000 MAPREDUCE-3506. Calling getPriority on JobInfo after parsing a history log with JobHistoryParser throws a NullPointerException (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375602 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 45035d7823414fe09bd1dc79df1928ba865a65de) commit 04ac6c9a73dc4c9f65b3dceab0a58ee524c0125a Author: Thomas Graves Date: Mon Aug 20 16:04:03 2012 +0000 YARN-27. Fixed location of ms.start call git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375083 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 07285eb40ab429f02454f019bb9e5eb04e8738ce) commit 62882fd726d94e42191b06d3227bd8d284dd80ed Author: Thomas Graves Date: Mon Aug 20 15:36:51 2012 +0000 YARN-27. Failed refreshQueues due to misconfiguration prevents further refreshing of queues (Arun Murthy via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375066 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 95d8ec004c178be4c7f72ab549fb5ab9bf7a79ce) commit 5c4fe446dd33a95d057d4526f49417c11d2c2378 Author: Thomas Graves Date: Fri Aug 17 20:29:38 2012 +0000 YARN-25. remove old aggregated logs (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374424 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4294b80f34027fe8f157e4a1bda71ab6ec9d41d8) commit 9c1a0d6509fedb75c35ecef709e76d53a100f740 Author: Robert Joseph Evans Date: Thu Aug 9 19:15:56 2012 +0000 YARN-14. Symlinks to peer distributed cache files no longer work (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371390 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 71d33850a6220428b9eb7a03769ee67c04240963) commit b4dc4f7cde5a401e9d40b18da6718ef8b4c91656 Author: Alejandro Abdelnur Date: Tue Aug 7 05:15:25 2012 +0000 MAPREDUCE-4484. Incorrect IS_MINI_YARN_CLUSTER property name in YarnConfiguration. (ahmed.radwan via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370120 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dfbea8610858231348efbaf599ddc17b2285a173) commit d198a0b241a942ba7c3766c29780a6de6b55a206 Author: Jonathan Turner Eagles Date: Fri Aug 3 20:29:29 2012 +0000 MAPREDUCE-4503. Should throw InvalidJobConfException if duplicates found in cacheArchives or cacheFiles (Robert Evans via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369197 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8f792ff8a9000e9a5c4184966b72d32ee2a4a61b) commit d195a74206d6255325fa7f171d1dff29d28f093b Author: Thomas Graves Date: Wed Aug 1 22:14:13 2012 +0000 MAPREDUCE-4504. SortValidator writes to wrong directory (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368294 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 91ba59d88d7fea0819d91c6debf5e535ddbe1df9) commit 791636627fa04584a2527d1558b26ceb17c02943 Author: Jonathan Turner Eagles Date: Tue Jul 31 21:26:08 2012 +0000 MAPREDUCE-4234. SortValidator.java is incompatible with multi-user or parallel use (due to a /tmp file with static name) (Robert Evans via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367789 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4e1583bd053262e34a508eec5dc00db47624eaf5) commit c782ebcedd0f3cb9d80103a56d130593e8162095 Author: Arun Murthy Date: Tue Jul 24 17:33:15 2012 +0000 MAPREDUCE-4438. Add a simple, generic client to run 'easy' AMs in YARN. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365185 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f04872c29a51a9babecc508d50b65adc3412f3ee) commit 0e27ecca24930e80b8644531ea1134f7f8e78491 Author: Thomas Graves Date: Mon Jul 9 21:08:40 2012 +0000 MAPREDUCE-4300. OOM in AM can turn it into a zombie. (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359399 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4b7c05bb1cb06ba937ea37b2352d2f0ed7097096) commit f695764ebbb74cc22e52ce215b3dd93a8f75919e Author: Robert Joseph Evans Date: Tue Jul 10 16:10:14 2012 +0000 MAPREDUCE-4252. MR2 job never completes with 1 pending task (Tom White via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359747 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e8cc100f58acd5a335212322032d4c7efb1611f5) commit 673b6524ebb45ae6b5538f15f4f6a48f1dae4d04 Author: Robert Joseph Evans Date: Thu Jun 28 19:28:42 2012 +0000 MAPREDUCE-4376. TestClusterMRNotification times out (Kihwal Lee via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355124 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d4678b9a5afd2e0105e61cd9b6f45cb3dc19ea06) commit 6fa6779a99ec95ca05567b0e65f20938041ae9b5 Author: Robert Joseph Evans Date: Tue Jun 26 19:17:33 2012 +0000 MAPREDUCE-4228. mapreduce.job.reduce.slowstart.completedmaps is not working properly (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354181 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 51d7c7685d7f5bf0afa4e3796b72b126f9185869) commit 0edbbdfe999b4b75a792b47f99b191c3155f2e86 Author: Alejandro Abdelnur Date: Mon Jun 25 21:36:17 2012 +0000 MAPREDUCE-2289. Permissions race can make getStagingDir fail on local filesystem (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353750 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 64b3044d6e4068f93b0f1f08f32c74aa00555e89) commit 7a09b285ed94132c26a298b7f6c46ee199ad3552 Author: Siddharth Seth Date: Mon Jun 11 23:14:06 2012 +0000 MAPREDUCE-3921. MR AM should act on node health status changes. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349065 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 009c58f2af36e8e9d50311a00b5a4699b71463d3) commit 859c1e23219652b86fbaf753d2684f85eab23634 Author: Todd Lipcon Date: Fri Dec 7 08:17:38 2012 +0000 HDFS-4282. TestEditLog.testFuzzSequences FAILED in all pre-commit test. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418212 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a780374935f13bd7e597aba3b5562a3315edffbf) commit 8cfe9fee1582af4843ea0ea6c3751b037d84118a Author: Aaron Twining Myers Date: Wed Nov 28 01:41:28 2012 +0000 HDFS-4214. OfflineEditsViewer should print out the offset at which it encountered an error. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1414505 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dae75ab06e961f1935c32ac14baa3e8058ae7087) commit 9f2d978d12f9fb932d4197cf25b6fb79e803fe5f Author: Aaron Twining Myers Date: Thu Dec 6 22:30:07 2012 +0000 HDFS-3680. Allow customized audit logging in HDFS FSNamesystem. Contributed by Marcelo Vanzin. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1418115 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7567291e21386f3ed979eaef0d9527aa6b5a69d7) commit 8f3c09db4e27facbf0b82e3b601029b61fda86f3 Author: Eli Collins Date: Thu Sep 20 01:35:01 2012 +0000 HDFS-3949. NameNodeRpcServer#join should join on both client and server RPC servers. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387839 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ce71b6bd5b188538c62eeec2703acfd44a866ceb) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNodeRpcServer.java commit 4ce1e3f8d1f65f5262ea8a27ef0cd540c8e3c67e Author: Aaron Twining Myers Date: Sun Aug 26 00:32:08 2012 +0000 HDFS-3683. Edit log replay progress indicator shows >100% complete. Contributed by Plamen Jeliazkov. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1377368 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c1bcddb41a9f7ea1a1426a4d945c7792224d7b8f) commit 5c2cbf3af502fc3eedea50aa428c521132e95b6b Author: Tsz-wo Sze Date: Mon Oct 15 13:48:56 2012 +0000 HDFS-4037. Rename the getReplication() method in BlockCollection to getBlockReplication(). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398288 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b0885548059be788dcd49d783373c8b6f88806e8) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/blockmanagement/TestBlockManager.java commit c5042e4ee44f2c0e4b6ab926290bba724497351c Author: Colin Patrick Mccabe Date: Thu Dec 6 16:22:19 2012 -0800 HDFS-4080. Merging change r1407566 from trunk git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407571 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f3092b96992734aa135e959aba0452bbb8a3377a) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/blockmanagement/BlockManager.java commit d6568314171b1a1ccf725aa03cb3a54fbd175a32 Author: Eli Collins Date: Wed Oct 17 21:38:03 2012 +0000 HDFS-4068. DatanodeID and DatanodeInfo member should be private. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399444 13f79535-47bb-0310-9956-ffa450edef68 commit 563eab4a362c0233e28f6ec475a49a8037387bb2 Author: Colin Patrick Mccabe Date: Thu Dec 6 15:53:30 2012 -0800 HDFS-4122. Cleanup HDFS logs and reduce the size of logged messages. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403120 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 49e1c1e67d3ad9582a383baefdd75a8a131fffab) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSNamesystem.java commit c4adc1a60b1b6f6d870182c3ccdabbe58c354731 Author: Eli Collins Date: Wed Oct 17 05:00:04 2012 +0000 HDFS-4029. GenerationStamp should use an AtomicLong. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399097 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ce7393a8f30fbbb1cc02b403692457768f2c0085) commit 06f466e9fb2762686d452d7b1942df749e595d5a Author: Aaron Twining Myers Date: Sat Oct 6 00:16:08 2012 +0000 HDFS-3483. Better error message when hdfs fsck is run against a ViewFS config. Contributed by Stephen Fritz. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394866 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0b3d31466d3c247216b70cfd6aaa2340935a808f) commit 3ad223b7edd912e8967056053325094d624d4beb Author: Colin Patrick Mccabe Date: Thu Dec 6 15:29:05 2012 -0800 HDFS-4048. Use ERROR instead of INFO for volume failure logs. Contributed by Stephen Chu git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1407346 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ff4cffd5a9653bf211142ec99b70ca6ac803776e) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/common/Storage.java .../apache/hadoop/hdfs/server/common/Storage.java | 8 ++++---- .../datanode/fsdataset/impl/FsVolumeList.java | 2 +- commit 8f658bf2a643eca3d96222db41ff5c206f3ff352 Author: Todd Lipcon Date: Tue Nov 6 22:05:39 2012 +0000 HDFS-4155. libhdfs implementation of hsync API. Contributed by Liang Xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1406373 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 70cb9e8a93f7d7beada867c6246236093c421972) commit 14ef110045cd7ad265974e84ef13d96d1c4eebed Author: Todd Lipcon Date: Mon Oct 8 19:19:13 2012 +0000 HDFS-4007. Rehabilitate bit-rotted unit tests under hadoop-hdfs-project/hadoop-hdfs/src/test/unit/. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1395730 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 45ad9670fd2b7c2c21ff5c3a7b17fa56341fec65) commit b45ee4a38f73f27febae683426270ebe48db2f90 Author: Eli Collins Date: Thu Aug 16 20:37:32 2012 +0000 HDFS-2963. Console Output is confusing while executing metasave (dfsadmin command). Contributed by Andrew Wang git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374042 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b294a9cad6f2f7b15d387d66da9aef1428eaf60b) commit 8055d7720d16b0745879ca3ec03777fe3e456e1b Author: Eli Collins Date: Fri Aug 10 03:47:12 2012 +0000 HDFS-3758. TestFuseDFS test failing. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371556 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 88fcabf96dbc40a1186ac881a8c5366b7ed57a95) commit 2f36a0055526a83ea126f02ff8b9285f069483e5 Author: Todd Lipcon Date: Wed Dec 5 21:18:16 2012 +0000 HDFS-4238. Standby namenode should not do purging of shared storage edits. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417652 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7442dfaddcee19c5c5506e121b2c724111c1720d) commit 519a2db9e28c8dfe6faa6c946cf6cad9c1db6066 Author: Todd Lipcon Date: Wed Dec 5 21:14:01 2012 +0000 HADOOP-9103. UTF8 class does not properly decode Unicode characters outside the basic multilingual plane. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1417650 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 14b90808043dcc91f9c8a093d2947701b034cbf3) commit b7e41aa1e6f906929b5543ff6733e93ea5e18eef Author: Robert Joseph Evans Date: Mon Nov 12 17:06:07 2012 +0000 MAPREDUCE-4787. TestJobMonitorAndPrint is broken (Rob Parker via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408355 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 61d6ebbe88ee9a277c436ae650ff5e6c4fd3f931) commit 29f1814a8eecdbddf6069d1e8889bbfa9d7987d4 Author: Todd Lipcon Date: Fri Nov 16 21:45:48 2012 +0000 HDFS-3935. Add JournalNode to the start/stop scripts. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410584 13f79535-47bb-0310-9956-ffa450edef68 commit 15d5298b2d6f9612b25e21477b7706beff21086e Author: Uma Maheswara Rao G Date: Sun Sep 2 16:20:13 2012 +0000 HDFS-3469. start-dfs.sh will start zkfc, but stop-dfs.sh will not stop zkfc similarly. Contributed by Vinay git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380003 13f79535-47bb-0310-9956-ffa450edef68 commit 508945b724af04a9e28ceb2b771dae8748eb41e8 Author: Thomas White Date: Fri Nov 30 12:03:25 2012 +0000 YARN-187. Add hierarchical queues to the fair scheduler. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1415592 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bff252250dcf2fe6e4c04cc034309f3292d991cb) commit 8cdb1c418d8cc94585ffde05f8b33aea055f4759 Author: Sandy Ryza Date: Wed Nov 28 23:19:40 2012 -0800 Amend MAPREDUCE-4778. Fix test compilation error in TestFairSchedulerEventLog commit df6723c3fda68eb9de2c5c2fc6667f94d0f09ea8 Author: Thomas White Date: Wed Nov 28 14:40:40 2012 +0000 MAPREDUCE-4778. Fair scheduler event log is only written if directory exists on HDFS. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414729 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7214e7b0888d42e46ca22f9b7f747b84469fda9b) commit 528e639ff31801885b4f25d7ef72c5cb016f37d9 Author: Thomas White Date: Wed Nov 28 12:27:30 2012 +0000 YARN-224. Fair scheduler logs too many nodeUpdate INFO messages. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414647 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5309eb1dc26244f6b770ddf3b2590276db571061) commit 5efe22a9e9dfd84512d77c6aa18d824d31574282 Author: Thomas White Date: Wed Nov 28 12:53:29 2012 +0000 YARN-222. Fair scheduler should create queue for each user by default. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414655 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6c1f5b1c0787e494a1943254ddd8ff0c265577e2) commit 80dfb18a815f65a52a4306e6951bb6e18629407d Author: Alejandro Abdelnur Date: Tue Nov 27 19:41:08 2012 +0000 HADOOP-9064. Ameding CHANGES.txt with correct JIRA ID, wrongfully used HADOOP-9084 before (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414347 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6877726384cbdfd01ae7dfa03515d364886909de) commit 9a4114ffca4f29251424486ed56f1cfccd33447a Author: Alejandro Abdelnur Date: Tue Nov 27 19:23:05 2012 +0000 HADOOP-9084. Augment DelegationTokenRenewer API to cancel the tokens on calls to removeRenewAction. (kkambatl via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1414326 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9d67fb9146c0231dfd723613ebf3423a63129ccf) commit dad081d56afbfe4b1b668a0e245bbf2fb3149137 Author: Harsh J Date: Mon Nov 26 16:59:08 2012 +0530 MAPREDUCE-3678. The Map tasks logs should carry the input split it processed. Description: MR map tasks don't currently log the splits they use, so its harder to debug to find the file behind a specific failed task. Reason: Customer Request Author: Harsh J Ref: CDH-6951 commit 96a359c7a25a1e0887fa25d5c13cdc84bf3f46ce Author: Suresh Srinivas Date: Fri Oct 19 04:58:55 2012 +0000 HDFS-4072. Merging change 1399965 from trunk. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399966 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a9338e972e85aee40904111ccffdd096529ac9b4) commit 794f416c68b4496a3628cab1f7e12b66a57783dc Author: Daryn Sharp Date: Thu Sep 6 14:15:15 2012 +0000 svn merge -c 1381606 FIXES: HDFS-3890. filecontext mkdirs doesn't apply umask as expected (Tom Graves via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381608 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d69fdd699c419c6d59d95ebda1ae57c69125ed26) commit 0f8a57b6ca27b963634d294d0b132782ccf4519d Author: Daryn Sharp Date: Mon Nov 19 15:05:59 2012 +0000 svn merge -c 1411229 FIXES: HDFS-4178. Shell scripts should not close stderr (Andy Isaacson via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1411231 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cdeef9663e3fc69b08f21b229107923028658882) commit 6ed39e454e549dbd29ed73b76ebc77c96651d96d Author: Eli Collins Date: Wed Oct 17 04:39:28 2012 +0000 HDFS-4055. TestAuditLogs is flaky. Contributed by Binglin Chang git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399094 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1293d252c21dd9463234c6b08dca5427640d3539) commit be08bb7a89d63b03476b4457c1dbc8265c4b241c Author: Aaron Twining Myers Date: Wed Oct 17 01:12:02 2012 +0000 HDFS-3997. OfflineImageViewer incorrectly passes value of imageVersion when visiting IS_COMPRESSED element. Contributed by Mithun Radhakrishnan. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399063 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c98fd04db9ac9dfbaae7f5afc728d3f8d26afec7) commit 98c944e8e57ea10b57b6e5322bc7733d4a0b06d6 Author: Aaron Twining Myers Date: Thu Oct 11 00:34:58 2012 +0000 HDFS-4021. Misleading error message when resources are low on the NameNode. Contributed by Christopher Conner. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1396882 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ae09d83f5ee30086dc1df4f32a560a7000986ffa) commit f3e2f40c332166713fc06732445574f1da2ab281 Author: Siddharth Seth Date: Mon Nov 19 16:43:29 2012 +0000 MAPREDUCE-4723 amendment. Fix JobHistory Event handling. (Contributed by Sandy Ryza) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1411292 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 74dce7dd5c124579e7a1bd7bf7ca7b085786f6fa) commit 6472ff560b265ebcbe564c0a27af697868b132db Author: Eli Collins Date: Thu Nov 15 00:16:35 2012 +0000 MAPREDUCE-4723. Fix warnings found by findbugs 2. Contributed by Sandy Ryza git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409601 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6e424491898a0887e2070467a7bb3b44887f5aaf) commit 7c2fcb461baed50280511413741c280d9556938c Author: Thomas White Date: Wed Nov 21 12:29:37 2012 +0000 HADOOP-9049. DelegationTokenRenewer needs to be Singleton and FileSystems should register/deregister to/from. Contributed by Karthik Kambatla. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1412077 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 624c885482c2ae2e2bb3f4a3762fadecc47f59c6) commit c310a462bc7559015e095084632c8a083637911a Author: Todd Lipcon Date: Tue Aug 7 14:28:11 2012 -0700 HDFS-4049. Fix perf regression due to nagling in mirror stream Author: Todd Lipcon Reason: perf regression (cherry picked from commit 14f1d6f5a3f99ebcda52ec38a2a884276e97f069) commit 3123d5fb475fff5a170c7ecce5811dccfb392356 Author: Daryn Sharp Date: Tue Nov 6 19:27:47 2012 +0000 HDFS-4075. Reduce recommissioning overhead (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406278 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a6d82b0d10fd5bb91c1427ccef3d9d79e3764a75) commit b691f38c34f5e6490dd63d3762d57a2426cbeae1 Author: Tsz-wo Sze Date: Thu Oct 25 18:53:25 2012 +0000 HDFS-3948. Do not use hflush in TestWebHDFS.testNamenodeRestart() since the out stream returned by WebHdfsFileSystem does not support it. Contributed by Jing Zhao git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402270 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e697f3dd34fae3627601824821361ee840427d2e) commit b03d17d12425f7b5ed52afae6869b7c0265b95ab Author: Alejandro Abdelnur Date: Sun Nov 18 05:00:56 2012 +0000 YARN-184. Remove unnecessary locking in fair scheduler, and address findbugs excludes. (sandyr via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410826 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f55c495aefb5b82705b074f4d1f3afe0368b03ba) commit e60a5f00f17f32403bca9aec0c7fc35c4c3568c1 Author: Thomas White Date: Fri Nov 9 12:38:10 2012 +0000 YARN-183. Clean up fair scheduler code. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407433 13f79535-47bb-0310-9956-ffa450edef68 commit f3100685acee159eec3d40c0b12422d3a41518d0 Author: Sandy Ryza Date: Fri Nov 16 14:59:43 2012 -0800 CLOUDERA-BUILD. Remove Windows line endings in wordcount example stats files commit cdbcf7eeefa1aafac1b2c7281643fab571a510bf Author: Alejandro Abdelnur Date: Sat Nov 17 20:48:00 2012 -0800 HDFS-4171. WebHDFS and HttpFs should accept only valid Unix user names. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1410824 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4aff5cc873d05c395207c0575f96f8ff14e34ab2) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/web/resources/TestParam.java commit a805854c7109d24ee22c93c994f9761073072cb2 Author: Robert Joseph Evans Date: Wed Nov 14 19:29:17 2012 +0000 svn merge -c 1409311 FIXES: HDFS-4182. SecondaryNameNode leaks NameCache entries (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1409316 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8aae13c20f1c88d08443b3396cfa90b71f7fda4a) commit 088169e2108ac7c98f31ca926a60ce9cb4c10fd6 Author: Alejandro Abdelnur Date: Thu Nov 15 11:22:51 2012 -0800 HADOOP-6607. Add different variants of non caching HTTP headers. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409921 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 70b48010101afb14e3ef8ea8db69e21a3bef6495) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit 9332dda3d2e1fc720946a077b4af028d223c6619 Author: Eli Collins Date: Wed Nov 14 06:17:19 2012 +0000 HDFS-4139. fuse-dfs RO mode still allows file truncation. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409088 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 47fb743fb5bb0c84b850342cc4bbe21cbe1a12f2) commit bb414a9ed9731715dcaebedf9f71485a8a2db049 Author: Eli Collins Date: Tue Nov 13 01:28:33 2012 +0000 HDFS-1322. Document umask in DistributedFileSystem#mkdirs javadocs. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408532 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 351e93a7cb64d9ca3b6a3a51fcf5a9c10950cb9d) commit 1747673eedca72c3e25073e6aaabf52db24dd1d3 Author: Eli Collins Date: Mon Nov 12 22:20:43 2012 +0000 HDFS-4164. fuse_dfs: add -lrt to the compiler command line on Linux. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1408477 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fee385ed1504c69f67df1808d02e4557f8d71631) commit 1c4c2c9e6303d3fd8f3139f33b6e95bb1f8bc70c Author: Suresh Srinivas Date: Thu Oct 25 18:32:41 2012 +0000 HDFS-4067. TestUnderReplicatedBlocks intermittently fails due to ReplicaAlreadyExistsException. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402261 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e88724b03f3a7f228f7ec50f4da8510d9cb81543) commit 8f7c4e9423fddb87a4fcf82d242a600bd108dee7 Author: Alejandro Abdelnur Date: Tue Nov 13 22:31:47 2012 -0800 HADOOP-8998. set Cache-Control no-cache header on all dynamic content. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1409095 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fc3a61458ed6e59fb03739cf9c9c42ea95b37c62) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit 4f83ad253bbcc585201e2efbe9a713011635fddb Author: Alejandro Abdelnur Date: Tue Nov 13 11:55:45 2012 -0800 MAPREDUCE-4266. remove Ant remnants from MR (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407551 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2d9e27a910cb1b109d47835eb0004766da8ef36e) Conflicts: hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/build.xml hadoop-mapreduce-project/ivy/hadoop-mapred-instrumented-template.xml hadoop-mapreduce-project/ivy/hadoop-mapred-template.xml hadoop-mapreduce-project/ivy/ivysettings.xml hadoop-mapreduce-project/ivy/libraries.properties hadoop-mapreduce-project/src/contrib/build.xml hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java hadoop-mapreduce-project/src/contrib/index/sample/data.txt hadoop-mapreduce-project/src/contrib/index/sample/data2.txt hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/HashingDistributionPolicy.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/IdentityLocalAnalysis.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/LineDocInputFormat.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/LineDocLocalAnalysis.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/LineDocRecordReader.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/LineDocTextAndOp.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/example/RoundRobinDistributionPolicy.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/lucene/LuceneIndexFileNameFilter.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/lucene/LuceneUtil.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/lucene/MixedDeletionPolicy.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/lucene/MixedDirectory.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/lucene/RAMDirectoryUtil.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/lucene/ShardWriter.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/main/UpdateIndex.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/DocumentAndOp.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/DocumentID.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IDistributionPolicy.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IIndexUpdater.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/ILocalAnalysis.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IndexUpdateCombiner.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IndexUpdateConfiguration.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IndexUpdateMapper.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IndexUpdatePartitioner.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IndexUpdateReducer.java hadoop-mapreduce-project/src/contrib/index/src/java/org/apache/hadoop/contrib/index/mapred/IntermediateForm.java hadoop-mapreduce-project/src/contrib/index/src/test/org/apache/hadoop/contrib/index/lucene/TestMixedDirectory.java hadoop-mapreduce-project/src/contrib/index/src/test/org/apache/hadoop/contrib/index/mapred/TestDistributionPolicy.java hadoop-mapreduce-project/src/contrib/index/src/test/org/apache/hadoop/contrib/index/mapred/TestIndexUpdater.java hadoop-mapreduce-project/src/docs/changes/changes2html.pl hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/rumen.xml hadoop-mapreduce-project/src/docs/src/documentation/content/xdocs/tabs.xml hadoop-mapreduce-project/src/java/mapred-default.xml hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/JobInProgress.java hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/JobTracker.java hadoop-mapreduce-project/src/java/org/apache/hadoop/mapred/TaskScheduler.java hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/SortValidator.java hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobInProgress.java hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestJobQueueInformation.java hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestSetupAndCleanupFailure.java hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/TestSubmitJob.java hadoop-mapreduce-project/src/test/mapred/org/apache/hadoop/mapred/UtilsForTests.java hadoop-mapreduce-project/src/test/tools/data/rumen/small-trace-test/goldFoldedTrace.json.gz commit 1c16de88d51b14f70e33f98c32431a969c013416 Author: Aaron Twining Myers Date: Tue Nov 13 01:30:34 2012 +0000 HDFS-3921. NN will prematurely consider blocks missing when entering active state while still in safe mode. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1408534 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c1a62bb793e0b9acda7dfa50fc6f37e6bc3f3c3c) commit 6aa97ff9dcf9fe785060df1a6e56a6c8d7c5fd8a Author: Robert Joseph Evans Date: Tue Oct 16 21:40:53 2012 +0000 HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser (Damien Hardy via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1399001 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 36192f6d414a290e6c5829ae363db582902a6eb9) commit af0805d5982c65d29c071043dfeb0840fd495403 Author: Aaron T. Myers Date: Mon Nov 12 13:39:58 2012 -0800 Revert "HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby)" This reverts commit 74e1186fe69eaf7cf57fa5b692d645f819e8189b. Reason: Bad merge from trunk of HADOOP-8922. Should have merged from branch-2. Ref: CDH-9009 commit 4d006b16baeb6871f485aecca389b18296af52c2 Author: Alejandro Abdelnur Date: Fri Nov 9 10:46:52 2012 -0800 HADOOP-7115. Add a cache for getpwuid_r and getpwgid_r calls (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407577 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 535ed824c49738f31b3cb4309acf19b7a56b58ec) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit 82aec1b9a7e82c1351d28dbf0148d110bfcc56f2 Author: Aaron Twining Myers Date: Wed Nov 7 06:29:37 2012 +0000 HDFS-4153. Add START_MSG/SHUTDOWN_MSG for JournalNode. Contributed by liang xie. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406473 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f02821b5a1675f3ca190a91d404cbdde7abdc68) commit 7ba145da05dbd72434150b9f8592e4f57808e3bb Author: Suresh Srinivas Date: Thu Nov 8 19:54:55 2012 +0000 HDFS-4165. Faulty sanity check in FsDirectory.unprotectedSetQuota. Contributed by Binglin Chang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1407245 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d63993a4930d2a5a797011f4eba822e4dab0ca48) commit 7476f3c805bcb5da65db222ed827328020295729 Author: Thomas White Date: Wed Nov 7 14:11:59 2012 +0000 MAPREDUCE-4777. In TestIFile, testIFileReaderWithCodec relies on testIFileWriterWithCodec. Contributed by Sandy Ryza git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1406645 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a0f49f0d5deee51249f6b05247bbd672ee8c45b3) commit 74e1186fe69eaf7cf57fa5b692d645f819e8189b Author: Robert Joseph Evans Date: Tue Oct 16 18:00:01 2012 +0000 HADOOP-8922. Provide alternate JSONP output for JMXJsonServlet to allow javascript in browser dashboard (Damien Hardy via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398904 13f79535-47bb-0310-9956-ffa450edef68 commit 12f64fbb962ef1cbfea7ff372095919bcb81d587 Author: Aaron Twining Myers Date: Tue Oct 16 01:59:46 2012 +0000 HDFS-2946. HA: Put a cap on the number of completed edits files retained by the NN. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398609 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5491195f822ec4f0b9ad2a011f2f3d891103bacf) commit eee16cb9d05fb7adef16067a2cd11074b521976e Author: Alejandro Abdelnur Date: Tue Oct 30 05:41:59 2012 +0000 MAPREDUCE-1806. CombineFileInputFormat does not work with paths not on default FS. (Gera Shegalov via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1403614 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fc7be5c1dfcbf308b816dd88178bc1f2ba109ad3) commit 9dd0f33f9a1936d590af9256deb1b4f19a417508 Author: Thomas White Date: Fri Oct 26 20:55:57 2012 +0000 YARN-145. Add a Web UI to the fair share scheduler. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1402657 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0494ab76f0a1c67d83fd96b92045c916c2fa2ed7) commit ce96ccf4306c8b042fedd8411de7fe6e9b5c9f4f Author: Arun Murthy Date: Wed Aug 8 18:53:29 2012 +0000 YARN-12. Fix findbugs warnings in FairScheduler. Contributed by Junping Du. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370889 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b6846c81df794c7bac93b96e9a0b205ebef58251) commit 35520bd5efb02e2f7c87d210b70a403c4d3bed3b Author: Suresh Srinivas Date: Wed Oct 17 18:36:32 2012 +0000 HADOOP-8900. BuiltInGzipDecompressor throws IOException - stored gzip size doesn't match decompressed size. Contributed by Slavik Krassovsky. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399377 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3d6b546e1ca8e845b7ea8adcd8def88f70b50546) commit 4d844fa59462f61fe2e7c276e329120886b0f1d2 Author: Todd Lipcon Date: Mon Aug 13 21:26:39 2012 +0000 HDFS-3276. initializeSharedEdits should have a -nonInteractive flag. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372628 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bd6df087ece504c0e20cc15f10fa1e75ac4edd6a) commit 7e9b40adca75f792c013a1988fc78038e36f339b Author: Eli Collins Date: Thu Oct 18 21:52:09 2012 -0700 Amend MAPREDUCE-4447 to resolve build.xml. commit a9ef4818a23b473a27fde283946318c369d56bb4 Author: Sandy Ryza Date: Thu Oct 4 17:46:43 2012 -0700 Fix NodeManager to verify the application's user-name. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390825 13f79535-47bb-0310-9956-ffa450edef68 commit 88b90e39e5229f225ef60ee3ab91a90c5041c529 Author: Eli Collins Date: Tue Oct 16 21:29:18 2012 +0000 HADOOP-8931. Add Java version to startup message. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398998 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2f4295c24b589120ecb2b4b4fd89b582a0764511) commit f007b29b8e847d6f2653c54a55e1dad725568b8d Author: Eli Collins Date: Tue Oct 16 21:59:15 2012 +0000 HDFS-4061. TestBalancer and TestUnderReplicatedBlocks need timeouts. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1399010 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b9a42ed8691afcdd189d18853621718578261882) commit cea63f9d366a9ad4f4e033d6c827e90a69d2bf78 Author: Alejandro Abdelnur Date: Tue Oct 16 17:39:27 2012 +0000 HADOOP-8883. Anonymous fallback in KerberosAuthenticator is broken. (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398895 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5702ae93107bc4c287cb485e2e1f0f318c317934) commit 537cf7d09684a37ab2fc25c9433a82b53c6a399c Author: Eli Collins Date: Tue Oct 16 16:29:21 2012 +0000 HDFS-3985. Add timeouts to TestMulitipleNNDataBlockScanner. Contributed by Todd Lipcon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398874 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 21915e9284076dc6da86b84e539d70da757bcb89) commit 079f86f9999bd20a0a8bc1d7ca67b967434d2d59 Author: Eli Collins Date: Tue Oct 16 02:12:59 2012 +0000 HDFS-4058. DirectoryScanner may fail with IOOB if the directory scanning threads return out of volume order. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398612 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab55c2dacbf3948b4e34be56aac59cfbab1e5de2) commit b05aefd5289ff84f78ca5b71eaeace468b960296 Author: Todd Lipcon Date: Mon Oct 15 17:44:02 2012 +0000 HADOOP-8901. GZip and Snappy support may not work without unversioned libraries. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1398416 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d8111555659c13a781619923079dcb5cc21da994) commit 3982bfbb0d383ce56c85ce78c5cc5b3b90884009 Author: Eli Collins Date: Wed Oct 3 00:06:39 2012 +0000 HADOOP-8756. Fix SEGV when libsnappy is in java.library.path but not LD_LIBRARY_PATH. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393243 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c7ae145728854ac1c69d0a78eac1516fafd63eb5) commit 2bd3f230805cf523440a3044237a9cbd4fd9fa70 Author: Thomas White Date: Thu Oct 11 10:07:01 2012 +0000 YARN-146. Add unit tests for computing fair share in the fair scheduler. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396972 13f79535-47bb-0310-9956-ffa450edef68 commit e81f84a9e6fbdc467dbb4bb4881cf68d351ca472 Author: Suresh Srinivas Date: Thu Oct 11 05:17:03 2012 +0000 HADOOP-8913. hadoop-metrics2.properties should give units in comment for sampling period. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396904 13f79535-47bb-0310-9956-ffa450edef68 commit c9d9855b64eb254514aa4e5aaefb172bc46aec82 Author: Eli Collins Date: Wed Oct 10 18:42:54 2012 +0000 HDFS-4020. TestRBWBlockInvalidation may time out. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396725 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c73700d3b13c6240fbccc8822f54d718e2ffd203) commit 37e549db3ab9e61537f3128dfc6636e839091b5c Author: Eli Collins Date: Tue Oct 9 00:18:27 2012 +0000 HDFS-4018. TestDataNodeMultipleRegistrations#testMiniDFSClusterWithMultipleNN is missing some cluster cleanup. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395821 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2e9f61689d522b0324dcac60ca85eb9fd7855fee) commit 24410ea27ac9b8a6585e9f0f5ef679daa357d506 Author: Eli Collins Date: Mon Oct 8 18:11:53 2012 +0000 HDFS-4008. TestBalancerWithEncryptedTransfer needs a timeout. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395700 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8cfcbc31951c7cf19d7a5c4730f2e30388d6b6bc) commit 9d39c043a8de3d4d6d88509d3e0856cc5f1bdbb3 Author: Thomas White Date: Tue Oct 9 14:37:46 2012 +0000 MAPREDUCE-4654. TestDistCp is ignored. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1396047 13f79535-47bb-0310-9956-ffa450edef68 commit d3f6accc2e7766e33c8a8429f2b15426485629ad Author: Eli Collins Date: Sun Oct 7 21:35:51 2012 +0000 HDFS-4006. TestCheckpoint#testSecondaryHasVeryOutOfDateImage occasionally fails due to unexpected exit. Contributed by Todd Lipcon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395387 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6cc42eb36339ea963e89913c999e8a1422726134) commit 51298d375a1e4a9e97be6066b76fadd75eca0941 Author: Eli Collins Date: Sun Oct 7 21:16:08 2012 +0000 HDFS-3682. MiniDFSCluster#init should provide more info when it fails. Contributed by Todd Lipcon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1395385 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5ea83b3a91516e977c030f58fe63b58fa2ce76d7) commit d1e4c05cfd2a2ae7c97eef59f047adc2141bfc97 Author: Todd Lipcon Date: Sat Oct 6 00:58:50 2012 +0000 HADOOP-8889. Upgrade to Surefire 2.12.3. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1394881 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8db9f075fce1ea86072c76ba646452c46971a828) commit 3557115e7e29b6321e8b4fd0b3f9b2ac76ac8434 Author: Eli Collins Date: Thu Oct 4 02:41:04 2012 +0000 HDFS-4000. TestParallelLocalRead fails with "input ByteBuffers must be direct buffers". Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393884 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 95dd2a99c8e2ae148969e8ecd318e24c1dd950bc) commit 3278e65c91b92cd1d51d8d4eb3ec04088f414552 Author: Eli Collins Date: Tue Oct 2 19:13:53 2012 +0000 HDFS-3753. Tests don't run with native libraries. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1393113 13f79535-47bb-0310-9956-ffa450edef68 commit 6eed6c601658bce34bd79090234df8e579ba060e Author: Alejandro Abdelnur Date: Thu Oct 4 11:28:23 2012 -0700 HDFS-3999. HttpFS OPEN operation expects len parameter, it should be length. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394170 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dfd32134c5d5e779f1dd2d4441c7b43753c512b0) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 6a022b482be96d6a74114a55619f13c0ac2d9c3d Author: Alejandro Abdelnur Date: Thu Oct 4 11:27:38 2012 -0700 HADOOP-8881. FileBasedKeyStoresFactory initialization logging should be debug not info. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1394166 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2d1bc6e2b6e497586c8cc40d38b06628fd87901a) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit c29c78ff65657cd7cf18730abf63e78d5a9044ec Author: Aaron Twining Myers Date: Tue Oct 2 01:28:17 2012 +0000 HADOOP-8616. ViewFS configuration requires a trailing slash. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1392707 13f79535-47bb-0310-9956-ffa450edef68 commit fed4addde0bb770555749da3bb9f67233d589d49 Author: Alejandro Abdelnur Date: Thu Sep 27 13:18:05 2012 -0700 CLOUDERA-BUILD. Not able to use hadoop-test.jar to run tests Reason: need to have junit and mockito-all JARs in the classpath for TestDFSIO to run Author: Alejandro Abdelnur Ref: CDH-8097 commit 3218cfcf687cf5326f76361b5eae98a2981413b0 Author: Eli Collins Date: Thu Sep 27 05:03:42 2012 +0000 HADOOP-8855. SSL-based image transfer does not work when Kerberos is disabled. Contributed by Todd Lipcon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390841 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1b39d3d777b3053b9d7b1d78c496e6a6c5873260) commit c9b91a6a2cdbffe0b29cdf342e035263c0348bb7 Author: Eli Collins Date: Wed Sep 26 21:25:04 2012 +0000 HDFS-3972. Trash emptier fails in secure HA cluster. Contributed by Todd Lipcon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1390729 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f365b1c04f8ff3f50b792ec731cfd6be649bfe5) Conflicts: hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/SecurityUtil.java commit c7a55ffe2e8557d1e3185c2b16093f08ccc228a4 Author: Owen O'Malley Date: Mon Sep 24 03:45:07 2012 +0000 CDH-8186. Fix the length of the secret key. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1389194 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 185d80ebc07778f929605732476134771a6ca3fb) commit 7f477d96e42aa45bdf78a3624d1cddec16ab038f Author: Harsh J Date: Sat Sep 22 18:56:07 2012 +0000 HADOOP-8833. fs -text should make sure to call inputstream.seek(0) before using input stream. Contributed by Tom White and Harsh J. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388869 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0f31d10262c4d6b642ab95701d1b0d0e2b9a9ba7) commit dbf78dacd2014f4e7f774d3e49b5781b1291fff4 Author: Eli Collins Date: Fri Sep 21 05:48:42 2012 +0000 HDFS-3931. TestDatanodeBlockScanner#testBlockCorruptionPolicy2 is broken. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388331 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit db765939be7a0a8e51ee0c2701b71176f7046627) commit 5eb839760e3b65fc2a0d5759bfd860e5062e9415 Author: Eli Collins Date: Fri Sep 21 04:51:43 2012 +0000 HDFS-3932. NameNode Web UI broken if the rpc-address is set to the wildcard. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1388321 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 56a15b5f9e3046f33e7e23dc1229f94e2bb5e6fc) commit 5e025ebcd2bd4a2bd12893f0e48a1154189b65fe Author: Todd Lipcon Date: Wed Sep 19 23:40:59 2012 +0000 HDFS-3956. QJM: purge temporary files when no longer within retention period. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387817 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6efc634444d0039c1a9c9c1a6ecbc96e354ed17f) commit adf8e870bae90ca759b028a1f9a1719c6792fabe Author: Todd Lipcon Date: Wed Sep 19 18:57:11 2012 +0000 HDFS-3955. QJM: Make acceptRecovery() atomic. Contributed by Todd Lipcon. Also incorporates: Amend HFDS-3955. Forgot an import of ImmutableList in previous patch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387706 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f2a2bfa410293d3f30484811b56a03a831450c12) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387740 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9679b092f987ca5e22fe923670cbb5246d6e66dc) commit 4e0f224f9ba3df6409bb1c75521c86ef31eaffb4 Author: Todd Lipcon Date: Wed Sep 19 18:52:15 2012 +0000 HDFS-3950. QJM: misc TODO cleanup, improved log messages, etc. Contributed by Todd Lipcon. Amended for CDH4 backport: do not depend on the new RPC Server.Builder API since that is not yet in branch-2 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1387704 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 813006296a2f95fea3556ccf2a8c09e8c78090ff) commit 26655d0e135ef6a6b7df65c3e6a46706eff06376 Author: Alejandro Abdelnur Date: Wed Sep 19 10:51:50 2012 -0700 HDFS-3951. datanode web ui does not work over HTTPS when datanode is started in secure mode. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1387689 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9012e069bd57ee3380471841b9132441f5876c19) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/SecureDataNodeStarter.java commit 46b40fe66879e67f0613f82e3a53f2e14c52d4e5 Author: Eli Collins Date: Tue Sep 18 16:59:47 2012 +0000 HDFS-3936. MiniDFSCluster shutdown races with BlocksMap usage. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1387255 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit be9558b3c9d90849f06d23396cd8d031a4f5ed5f) commit d40ecc4b700dd1c134835691c31bd3da8887ca98 Author: Alejandro Abdelnur Date: Mon Sep 17 22:49:46 2012 -0700 HDFS-3944. Httpfs resolveAuthority() is not resolving host correctly. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1386995 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 95a0fbcf5eb7ed026ddb3495985b541a71e02c03) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 07c6001903a9797321d65473507dddecbda1e4c3 Author: Todd Lipcon Date: Mon Sep 17 21:51:40 2012 +0000 HDFS-3943. QJM: remove currently-unused md5sum field. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1386863 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 198e339ba69707eaffb900feab5a272af205a165) commit 2d88785bf3b2420ea438e7a47897fd5cdde379e5 Author: Eli Collins Date: Mon Sep 17 19:30:07 2012 +0000 HADOOP-8806. libhadoop.so: dlopen should be better at locating libsnappy.so, etc. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1386784 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8f6dfdd0d5f7890e55df7e3100310e3ca24b96a9) commit dcfe94e0a7bbe16a3bfab098e2bd323ab1b47d90 Author: Arun Murthy Date: Fri Sep 7 05:10:51 2012 +0000 YARN-80. Add support for delaying rack-local containers in CapacityScheduler. Contributed by Arun C. Murthy. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381872 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c82897cdfffbdd0e614881781dc624de79285c7e) commit 7af92f5a5dc5b267bc165768cad184e77002a663 Author: Todd Lipcon Date: Thu Sep 13 16:39:06 2012 -0700 HADOOP-8786. HttpServer continues to start even if AuthenticationFilter fails to init. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384456 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 69e595deb27fd36a4799a2e9bddeb02710d02fb4) commit c3e42348d194dcdf9dcd7b078eeed76578507810 Author: Todd Lipcon Date: Thu Sep 13 16:38:43 2012 -0700 HADOOP-7688. When a servlet filter throws an exception in init(..), the Jetty server failed silently. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384416 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 776df44cbfb36b759e46687857b268c0a1b7e4bc) commit df430a55a8e408ee0285412c172faed1a2e5de94 Author: Suresh Srinivas Date: Sun Sep 16 22:33:13 2012 +0000 HADOOP-8821. Fix findbugs warning related concatenating string in a for loop in Configuration#dumpDeprecatedKeys(). Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1385389 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9393a514416637eec796ca815197d2eb6a6b0e4c) commit c594e41e0a575a6f7a5b803d34a8f766e49747a4 Author: Thomas White Date: Fri Sep 14 16:05:30 2012 +0000 HADOOP-8780. Update DeprecatedProperties apt file. Contributed by Ahmed Radwan git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384833 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5627591ca2e1800a255b08cf6a7e319e3c04a28b) commit 7be703311cec8ec1021a6fd9f10764d5812cd259 Author: Alejandro Abdelnur Date: Fri Sep 14 09:37:53 2012 -0700 HDFS-3938. remove current limitations from HttpFS docs. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384843 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2e895a96156f37fbbe1015a15f55749ffcf73b3f) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 11e2526647f431744636441770ff78cc13899c90 Author: Aaron Twining Myers Date: Thu Sep 13 23:49:06 2012 +0000 HDFS-3924. Multi-byte id in HdfsVolumeId. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1384603 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 87ae32413da9d66cb4ed9fc88821948ee6cd87d0) commit fade376faad87331777731edc53feb00ff4f69da Author: Sean Mackrory Date: Thu Sep 13 16:19:50 2012 -0700 HADOOP-8795: Making BASH tab completion work as long as hadoop is in the PATH commit 1094ea03d1abb87e5660d1c2149eaa3df0f012f2 Author: Aaron Twining Myers Date: Thu Sep 13 23:02:32 2012 +0000 HDFS-3926. QJM: Add user documentation for QJM. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384595 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 08c8376ed70e5491b5dd6c8114af9fb727032614) commit 1e3ead3ad1d801d25dec6d02e11ec3e718df0426 Author: Todd Lipcon Date: Thu Sep 13 23:00:22 2012 +0000 HDFS-3894. QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1384592 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cd90b74523120a80bda4042fd341c5e1d8ca1dad) commit 34bdbb2a6019f51d09c5f53f8e00c6aa343101eb Author: Eli Collins Date: Thu Sep 13 17:56:49 2012 +0000 HADOOP-8801. ExitUtil#terminate should capture the exception stack trace. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384435 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cb701e15fde84247baa7e58b856f1160fe4fcbae) commit 9e15ebc3ecda9d9f6c7342de92eaae8209259b94 Author: Eli Collins Date: Wed Sep 12 18:36:01 2012 +0000 HDFS-3902. TestDatanodeBlockScanner#testBlockCorruptionPolicy is broken. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384081 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fc8f685c5059d0d34e97cc26b987f05629fef659) commit d2eefe3a3d5d681bfdecd0bd909c13536b1b0af7 Author: Eli Collins Date: Wed Sep 12 19:15:38 2012 +0000 HDFS-3928. MiniDFSCluster should reset the first ExitException on shutdown. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1384092 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ff375e49465ec9c0fe67c6c0d7c8b2435f41c2a7) commit dc1d24f105d76d2a7e07983081f302a6dc604b1b Author: Eli Collins Date: Wed Sep 12 04:10:58 2012 +0000 HDFS-3664. BlockManager race when stopping active services. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383753 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 57f8eabbba7b44a41a4fe61f6f8fba9612c30995) commit fe13090e6ada0c621a90d863efd69122bb45adc7 Author: Eli Collins Date: Tue Sep 11 21:24:12 2012 +0000 HDFS-3910. DFSTestUtil#waitReplication should timeout. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383618 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7df393513dadeada65169d88979acb359d03965a) commit fbdd722437068d5cf182c51b9909be5336b20de1 Author: Todd Lipcon Date: Tue Sep 11 06:33:47 2012 +0000 HDFS-3840. JournalNodes log JournalNotFormattedException backtrace error before being formatted. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383252 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2e42658f8a5c209bea9325e1019779b4b85bbd3a) commit a5e722f5cf5c275091d0a030eaf03d44fbd7514c Author: Todd Lipcon Date: Tue Sep 11 06:31:42 2012 +0000 HDFS-3906. QJM: quorum timeout on failover with large log segment. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383251 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c9b8ee36bfd3349d0762e54b7ba79fa45ea7c5f5) commit ef33101044e8df88d1225186088c0ee364f565fc Author: Todd Lipcon Date: Tue Sep 11 04:53:08 2012 +0000 HDFS-3915. QJM: Failover fails with auth error in secure cluster. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383242 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit eec260caad6d3ccf5becd99700a97488a37f606f) commit c827d760cdf4973b0de513b92308b92b712466ed Author: Todd Lipcon Date: Mon Sep 10 23:20:49 2012 +0000 HDFS-3914. QJM: acceptRecovery should abort current segment. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383148 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c977968250e658f16d572543a3c643d175350e26) commit 09d544c6f1d184697be1cdffce136b4de2ac3bde Author: Todd Lipcon Date: Mon Sep 10 22:39:46 2012 +0000 HDFS-3899. Add client side metrics for QJM. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383139 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7aae11feba591b6341a596083de62e3b8b46146) commit 97f7aff66001ab0615ff3b0b1ff540c3c8b7f3d4 Author: Todd Lipcon Date: Mon Sep 10 22:30:52 2012 +0000 HDFS-3901. QJM: send 'heartbeat' messages to JNs even when they are out-of-sync. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383137 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 81c0038a0dc034ddc692f3d0af509d1ff2d3e19b) commit 4e9dc714ca4a7e8b5f33cd6951a7dd4f503dfedd Author: Alejandro Abdelnur Date: Mon Sep 10 15:54:38 2012 -0700 HADOOP-8781. hadoop-config.sh should add JAVA_LIBRARY_PATH to LD_LIBRARY_PATH. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383144 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d5514c8a372e3d09860d2a2614b00ae1c8ca7f03) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit bc82aaa5bc620cf359609c48d739e5e8403f8a38 Author: Aaron Twining Myers Date: Fri Sep 7 18:40:30 2012 +0000 HADOOP-8775. MR2 distcp permits non-positive value to -bandwidth option which causes job never to complete. Contributed by Sandy Ryza. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382119 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b255bed1ab5f3cda1de3da0c5593d478bc21196f) commit d06067916f6e87f238918fefc33d134e7b164b1b Author: Eli Collins Date: Fri Sep 7 01:25:30 2012 +0000 HADOOP-8431. Running distcp wo args throws IllegalArgumentException. Contributed by Sandy Ryza git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381840 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 113bb64e7f251d0e775d7fbd90a418e13b48ef2a) commit eeada587be09651f437afad57d5ffea160c3ed66 Author: Todd Lipcon Date: Mon Sep 10 18:53:41 2012 +0000 HDFS-3900. QJM: avoid validating log segments on log rolls. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383041 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9d7c43aa8d8d718e921f6f2fcb72928d1a8676c4) commit 08c2c3c4fff6eb2d765bc9b81f03d385c501aee4 Author: Todd Lipcon Date: Mon Sep 10 18:51:15 2012 +0000 HDFS-3885. QJM: optimize log sync when JN is lagging behind. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383039 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 73afd003d6654bdf169d9df4029bdd005c0004f8) commit 9bbec9ca8421492c94dc0aa7b5b07be488b11031 Author: Todd Lipcon Date: Mon Sep 10 13:28:01 2012 -0700 HDFS-3510. Editlog pre-allocation is performed prior to writing edits to avoid partial edits case disk out of space. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1383098 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4a001ee8d900197d404ca7b88fae7c9bd65832b8) commit fe465270b22fcfdc9dc78ecd322a236889fe6581 Author: Todd Lipcon Date: Mon Sep 10 13:03:32 2012 -0700 HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348945 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5d80662ebba51f8d6d7fb9c563043a1e17dfe5c6) commit 7c60460ab2fd297a6e8221e597cf0864fe8ae3ea Author: Todd Lipcon Date: Mon Sep 10 18:46:58 2012 +0000 HDFS-3898. QJM: enable TCP_NODELAY for IPC. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1383033 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 009ef7c655114d2a2974973b96a0baee09f918f1) commit ff6fda06e4a5876689c07c272b94fcc13781e576 Author: Eli Collins Date: Mon Sep 10 18:46:13 2012 +0000 HDFS-3907. Allow multiple users for local block readers. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1383031 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0c9e9575c3c1b03cd9ac553b901b247423e1fe02) commit 76e58d56ad5bbc6fd0cd901c688aa27109a15332 Author: Eli Collins Date: Mon Aug 20 21:10:44 2012 +0000 HADOOP-8614. IOUtils#skipFully hangs forever on EOF. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375216 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2bbf983483860c2fcf02192d96921f987acbf279) commit 70533626713a6976cf601f1acc8635479dbdad70 Author: Eli Collins Date: Sun Sep 9 06:37:31 2012 +0000 HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382409 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f6bdb974fed0a01ae50a749925ea5c3db169a000) commit b228bb80f297e3b6a9f1e72511df951178d22e74 Author: Alejandro Abdelnur Date: Fri Sep 7 17:05:11 2012 +0000 MAPREDUCE-4642. MiniMRClientClusterFactory should not use job.setJar() (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1382093 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 31bd4c942614192000808a85f586a79e2a7e4551) commit c8ff12eb5dd48e1ca41916683e8eda03eb0a1b32 Author: Jenkins slave Date: Thu Sep 6 15:39:50 2012 -0700 Preparing for CDH4.2.0 development commit 81d0801da0ce772cf556cb868480ebff3ef36f6f Author: Alejandro Abdelnur Date: Thu Sep 6 18:15:37 2012 +0000 HADOOP-8749. HADOOP-8031 changed the way in which relative xincludes are handled in Configuration. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381703 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f9b86f31b637fe5673b56144d1d7b813ae58bef) commit fb3f14f122f3cb0bc583b45641e63110b53d7726 Author: Aaron Twining Myers Date: Fri Sep 7 02:01:21 2012 +0000 HDFS-3897. QJM: TestBlockToken fails after HDFS-3893. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381842 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7095cd25124885bb8e84d9b02be76db6a3d74298) commit dcbf82cb27bbe56655bb117b0183523382df2240 Author: Aaron Twining Myers Date: Thu Sep 6 21:42:14 2012 +0000 HDFS-3893. QJM: Make QJM work with security enabled. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381770 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 833f32938e48edfd42fa64b4e94efa90f04341f2) commit a22a232d5b6bb301f0ca2b642d6a570981d2f7ea Author: Alejandro Abdelnur Date: Thu Sep 6 12:12:24 2012 -0700 HDFS-3895. hadoop-client must include commons-cli (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1381720 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 87c6db314f02f1ba9c6848b088aa2154fdacdb3b) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 118ee3e01dedf946609c76c7a99c3e88db666f8d Author: Eli Collins Date: Thu Sep 6 06:19:30 2012 +0000 HDFS-3828. Block Scanner rescans blocks too frequently. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381472 13f79535-47bb-0310-9956-ffa450edef68 commit 24049a7f9799b009939260c9ec4e72f17d4c3a62 Author: Todd Lipcon Date: Thu Sep 6 07:03:57 2012 +0000 HDFS-3726. If a logger misses an RPC, don't retry that logger until next segment. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381482 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ed8e32a033659370cbfd6081ca05a25b8a1b5002) Amend HDFS-3726. Add previously missing file JournalOutOfSyncException.java git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381681 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f39b9596bc00368333922144c47a74cc3181713e) commit 3a2e34026008987510a74eb6c94c18d8df396c99 Author: Todd Lipcon Date: Thu Sep 6 06:57:18 2012 +0000 HDFS-3891. Make selectInputStreams throw IOE instead of RTE. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1381481 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2ce2dc14f62931e04eba1571a435286ab8461a37) commit 6d3ac0bb46fcc23a68a195a28443e46756d1877a Author: Owen O'Malley Date: Fri Aug 31 22:33:52 2012 +0000 HDFS-3466. Get HTTP kerberos principal from the web authentication keytab. (omalley) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379648 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b02366fad4f63cccab6e2fb2e59b710bad95abe3) commit 5f23cf47be0944350cb7c1ff84c00b8be9167433 Author: Aaron Twining Myers Date: Wed Sep 5 23:15:20 2012 +0000 HADOOP-8766. FileContextMainOperationsBaseTest should randomize the root dir. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381437 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 765f663ac875a725d5e4798d94f7b7853541740b) commit 532bb98cd20a67477497c6214007df225fe753dc Author: Todd Lipcon Date: Wed Sep 5 18:54:45 2012 +0000 HDFS-3054. distcp -skipcrccheck has no effect. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381296 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 54804a3c2a9f23d0e912e8732a4bddcf7129785d) commit 9076f04f2cf7f588ef5a2abe3fa1ef66442c9038 Author: Eli Collins Date: Wed Sep 5 22:19:40 2012 +0000 HADOOP-8648. libhadoop: native CRC32 validation crashes when io.bytes.per.checksum=1. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381419 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d2b46d18183ad70c0aad5ce278f49fbd52c88a08) commit 734292ce4d4aebde75345f181e464c34872e172b Author: Eli Collins Date: Wed Sep 5 19:42:09 2012 +0000 HADOOP-8770. NN should not RPC to self to find trash defaults. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1381319 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6b72940c497b81c0c965557407401705039dc3ab) commit 8ddce96a5841c4894258750ece33d4a702192129 Author: Todd Lipcon Date: Tue Sep 4 22:54:08 2012 -0700 HDFS-1490. TransferFSImage should timeout. Contributed by Dmytro Molkov and Vinay. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380988 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 100a4511322a117892ce4cdf935f585757ec39ba) commit d19965554a9a4c79662710e78ff4c155749abbd7 Author: Todd Lipcon Date: Tue Sep 4 22:54:01 2012 -0700 HDFS-2793. Add an admin command to trigger an edit log roll. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1380982 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cd24354052e26d70f66c2d1539ea4278c552db38) commit e1f036a257856f74332856fb31317bb0fb08797f Author: Todd Lipcon Date: Wed Sep 5 04:30:51 2012 +0000 HDFS-3870. Add metrics to JournalNode. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380980 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 45ba4001a78ad1c1d3f00e95f660c209f07d396d) commit cfb4443749431a3a54333604c6248f22b038b08b Author: Todd Lipcon Date: Wed Sep 5 04:27:49 2012 +0000 HDFS-3884. Journal format() should reset cached values. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380979 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6e66ae35d17f5cc302c02024d915f62737715ce0) commit 65bcfa19b48588367c406ead8efed2c2a1467cde Author: Todd Lipcon Date: Tue Sep 4 22:53:22 2012 -0700 HDFS-3869. Expose non-file journal manager details in web UI. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380978 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0247d0e8f932319a584ff81947e09e56c541d733) commit 312af735e4f1579636979f96e5a7b92a6543659c Author: Todd Lipcon Date: Wed Sep 5 04:13:19 2012 +0000 HDFS-3863. Track last "committed" txid in QJM. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1380976 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5bfed791bffb37e9541e22303a8c406eb79db7dd) commit fa21b92dff404549bb30b79747b64ce7dbfab0ab Author: Todd Lipcon Date: Tue Sep 4 18:05:43 2012 -0700 CLOUDERA-BUILD. embedded jetty may fail to start about 1/5000 times Upgrades Jetty dependency to 6.1.26.cloudera.2. This addreses a race condition (JETTY-1316) which caused the Acceptor thread to sometimes not start, which caused reducer fetch timeouts, etc. The source for this Jetty release can be found at https://github.com/cloudera/jetty-hadoop-fix and corresponds to commit 51042f4a6cd36fe90be7c0f0d208dca5397b527a in that repository. Author: Todd Lipcon Ref: CDH-7767, MAPREDUCE-3851 commit 9d3eaa700a28c77c26eea31e38db05047873bc2b Author: Eli Collins Date: Sat Sep 1 00:35:19 2012 +0000 HDFS-3877. QJM: Provide defaults for dfs.journalnode.*address. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1379681 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2810da12a8dd810cc6718d63411a961d74a9f371) commit 2345b24ce4b9f21558a8c0969b292441bff8f98e Author: Eli Collins Date: Fri Aug 31 22:39:52 2012 +0000 HDFS-3879. Fix findbugs warning in TransferFsImage on branch-2. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379651 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d90ab0a6c3b88342ef83e4a1e54ee3dd96134867) commit 00000c7683be32596bb64c4a35b6d1d325cfc135 Author: Todd Lipcon Date: Tue Aug 14 00:52:10 2012 +0000 HDFS-3792. Fix two findbugs introduced by HDFS-3695. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372690 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3af7ea7700202e897cfef8a694236b821ca66391) commit 1f698db07bfa929acb933775e8bdb25c13786d2e Author: Eli Collins Date: Fri Aug 31 15:17:03 2012 -0700 Revert "HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby)" This reverts commit cbc2cd9d786afdae9a31359f74630e933171245d. commit 94777ffc56a0d6bcb914e7a19d854f598d8ad856 Author: Daryn Sharp Date: Thu Aug 30 19:46:14 2012 +0000 HDFS-3861. Deadlock in DFSClient (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379093 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8e7caa298d5024ba3c7e4bdc6bc81b0ccd8e1e90) commit d1e89b4318088ae1f9caa94f0f6996056b8d519c Author: Jitendra Nath Pandey Date: Thu Aug 23 04:05:12 2012 +0000 HDFS-3819. Should check whether invalidate work percentage default value is not greater than 1.0f. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376360 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fcbb99b5f6d6b09bfed5e15d93af1e7b1c30bc6e) commit 535b1e28117230673c67ac5b64e1c691f8a8ba65 Author: Suresh Srinivas Date: Sat Aug 18 19:57:36 2012 +0000 HDFS-3816. Invalidate work percentage default value should be 0.32f. Contributed by Jing Zhao git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374648 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ac1325a5258b67f3a2e3970bed47bb5d6a524d67) commit 33bfec221502676255b1218c25bbcfd1c10719cf Author: Suresh Srinivas Date: Wed Aug 15 00:28:41 2012 +0000 HDFS-3723. Add support -h, -help to all the commands. Contributed by Jing Zhao git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373173 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 071fa7bb1f8de527831f7ddcc363987b6a9cc545) commit dfef183e72779173b9543436fb95fcfd96cfb8ae Author: Todd Lipcon Date: Tue May 15 18:16:49 2012 +0000 HDFS-3412. Fix findbugs warnings in auto-HA branch. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1338817 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 681018b2b99d971acb73318fcde3dfbf0a2e1321) commit 6c76c9fc51fd848d57eb780751bfa650606573b0 Author: Eli Collins Date: Fri Aug 31 04:08:23 2012 +0000 HDFS-3733. Audit logs should include WebHDFS access. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1379278 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2fff3e82aee878d9591551644315392905eb60e5) commit 948693166be75a947aba0319a1359aa72d760350 Author: Thomas White Date: Thu Aug 30 17:14:07 2012 +0000 Merge -r 1379021:1379022 from trunk to branch-2. Fixes: MAPREDUCE-4610. Support deprecated mapreduce.job.counters.limit property in MR2. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1379023 13f79535-47bb-0310-9956-ffa450edef68 commit 0792dfd7f7528b79f9f07b98dd514180351ef534 Author: Andrew Bayer Date: Thu Aug 30 11:46:01 2012 -0700 Download Tomcat tarball from archive.cloudera.com commit 76c80bb394146b6d0d33eb79e4eb004b745d26f2 Author: Thomas White Date: Thu Aug 30 10:02:31 2012 +0000 Merge -r 1378872:1378873 from trunk to branch-2. Fixes: MAPREDUCE-4608. hadoop-mapreduce-client is missing some dependencies. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1378874 13f79535-47bb-0310-9956-ffa450edef68 commit 83148af5ca7ce0dc0cf03809368695441bc130bc Author: Thomas White Date: Wed Aug 15 19:10:52 2012 +0000 HADOOP-8278. Make sure components declare correct set of dependencies. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373574 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 15802f248e4a6c6e934a91d7156a2dec96313b8d) Conflicts: hadoop-hdfs-project/hadoop-hdfs/pom.xml - CDH requires zookeeper, upstream doesn't commit 4a1bae5ab1ff7cd821b94d5d5e2941c299bcb6ed Author: Robert Joseph Evans Date: Thu Aug 23 19:18:05 2012 +0000 HADOOP-8709. globStatus changed behavior from 0.20/1.x (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376653 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1f158ebe2831c61b049626d4b5a0907292bd21fe) commit 9c3fa7abc1c18a7a0a1281a4924302de75197d8a Author: Jonathan Turner Eagles Date: Mon Aug 20 18:32:13 2012 +0000 MAPREDUCE-4323. NM leaks filesystems (Jason Lowe via jeagles) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375164 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 558f55be8d7a70d196306241a2e126de8c01c896) commit 27230a7745c3c4285842d0c0f5ede0004ae6a4c9 Author: Alejandro Abdelnur Date: Tue Aug 28 15:30:43 2012 +0000 HADOOP-8738. junit JAR is showing up in the distro (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378175 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bef28430d855dc2c7e8380caf88be78989b6a2c0) commit 022b1dcff50af635ee85f03c5e4938a9ef235dcd Author: Todd Lipcon Date: Wed Aug 29 17:28:02 2012 -0700 HADOOP-8632. Configuration leaking class-loaders (Costin Leau via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376546 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a8f81311ae835211e20bdc155453f7d68f5af694) commit e66a71b76be7f58bb74aa4c0e1dc5b69cd9d661b Author: Alejandro Abdelnur Date: Wed Aug 29 23:40:51 2012 +0000 HADOOP-8747. Syntax error on cmake version 2.6 patch 2 in JNIFlags.cmake. (cmccabe via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378770 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 62392914c440c818817a7f201a04b083d9217107) commit 5be600333034fe14b78ace2d1318ca246163ca84 Author: Eli Collins Date: Tue Aug 21 00:00:33 2012 +0000 HDFS-3707. TestFSInputChecker: improper use of skip. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375336 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4b5d175a9b355fb1265f45f0a12a44b150bf8662) commit 306bc6cf9e2b0432a4d297b0aea230e15d3fb215 Author: Eli Collins Date: Fri Aug 24 22:10:38 2012 +0000 HDFS-3731. 2.0 release upgrade must handle blocks being written from 1.0. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377137 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cac709fb2a32960c74196510dae41b6fbc475a35) commit d98c72abe3007b1a726e3ca356d35e85658a0611 Author: Karthik Kambatla Date: Tue Aug 28 18:39:51 2012 -0700 YARN-1. Post src move changes to relevant pom files, including our internal version changes commit 82505525c15ebf719f1bac20e09c926befe9400b Author: Karthik Kambatla Date: Tue Aug 28 18:25:57 2012 -0700 YARN-1. Shell script to create dirs and move sources commit d1a1d4b187fc0b257009e16efaf1c69715fe9c02 Author: Eli Collins Date: Wed Aug 29 05:30:06 2012 +0000 HADOOP-8737. cmake: always use JAVA_HOME to find libjvm.so, jni.h, jni_md.h. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378444 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7ce6a61465596998073c8c82a976e8b612d8a7bd) commit d648ee6e49204930b27a2c52a9631a6a434fff5a Author: Aaron Twining Myers Date: Wed Aug 29 01:22:38 2012 +0000 HDFS-3864. NN does not update internal file mtime for OP_CLOSE when reading from the edit log. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1378414 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 628e64d71fa6100e9e1427c0ac15cea29ad18f83) commit cae2c413f0c3e19b4c65158daf85514cd642f576 Author: Robert Joseph Evans Date: Tue Jul 31 21:08:40 2012 +0000 MAPREDUCE-4444. nodemanager fails to start when one of the local-dirs is bad (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367783 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8ceb625775c5c8006efa33d4263b53ca4fc2d0f8) commit 1589bf6752d040667222c4f6052369002ba74956 Author: Thomas Graves Date: Tue Jul 31 20:52:41 2012 +0000 MAPREDUCE-4457. mr job invalid transition TA_TOO_MANY_FETCH_FAILURE at FAILED (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367771 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ecf1d36f8636afdd2a71a23be3d1fbf52cdbf218) commit c3e0b3a0e863492648d3b646e782b6a88c32ab07 Author: Thomas Graves Date: Tue Jul 31 19:20:03 2012 +0000 MAPREDUCE-4493. Distibuted Cache Compatability Issues (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367713 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab5d67b75a79e3c13f51da5a9c304056f6daa290) commit 93bd3848b009b7ecbd885fbf755cf487f3fe392e Author: Thomas Graves Date: Tue Jul 31 14:46:57 2012 +0000 MAPREDUCE-4456. LocalDistributedCacheManager can get an ArrayIndexOutOfBounds when creating symlinks (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367581 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9cda74eb1bab454e1eee357f6141af8bba8769e8) commit 5458605b065888a34978bf8c9c56e98236d41b38 Author: Aaron Twining Myers Date: Tue Aug 28 22:09:27 2012 +0000 HDFS-3849. When re-loading the FSImage, we should clear the existing genStamp and leases. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1378364 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0cfd0a246eec39d3346d73e40fbc9a52335a26c9) commit a9d83e467ff8a93fea49769451904c76a5dbbb6b Author: Robert Joseph Evans Date: Tue Jul 31 19:43:51 2012 +0000 MAPREDUCE-4483. 2.0 build does not work (John George via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367726 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f50666bfc1021a9e0ca39fe7dda0f453b8398162) commit 29e5c494b6aaa61929d903fc5e70e4cb48125a1d Author: Robert Joseph Evans Date: Tue Jul 31 19:34:29 2012 +0000 MAPREDUCE-4492. Configuring total queue capacity between 100.5 and 99.5 at perticular level is sucessfull (Mayank Bansal via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367719 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2125318c0158ab540e5917e711ae75f660a9e360) commit 63a7aff059d7a152788cdabd4a5b0c8353cc06e8 Author: Arun Murthy Date: Tue Jul 17 01:43:03 2012 +0000 MAPREDUCE-4440. Changed SchedulerApp and SchedulerNode to be a minimal interface to allow schedulers to maintain their own. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362332 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 74e6f26c6c72bb1b4e1bb7ff8487315c635318fe) t commit eb7408cdc47b5edcdcf29a93d92a1a473b286bd4 Author: Robert Joseph Evans Date: Wed Aug 15 19:50:07 2012 +0000 HADOOP-8703: Fix formatting issue. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373599 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4e0028bc34f88b75b7c30831486def938fdc9e50) commit d90e66a78a57ea026e2b202e66fb599c76fe2a6b Author: Robert Joseph Evans Date: Wed Aug 15 19:16:13 2012 +0000 HADOOP-8703. distcpV2: turn CRC checking off for 0 byte size (Dave Thompson via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373581 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5087690faf6277daccc8a5b2437867ff4caabc06) commit 9ab6ec8551c219f2e1351edfd071362b5ae9ced7 Author: Aaron Twining Myers Date: Tue Aug 28 17:02:33 2012 +0000 HDFS-3860. HeartbeatManager#Monitor may wrongly hold the writelock of namesystem. Contributed by Jing Zhao. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1378229 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 73fc2655bb241c85ea33fff8b8bebe566cfcc88d) commit ecc3fbadf95d11de84d2931fbc63152b62b386a1 Author: Alejandro Abdelnur Date: Thu Aug 23 22:52:47 2012 +0000 HADOOP-4572. Can not access user logs - Jetty is not configured by default to serve aliases/symlinks (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376753 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 62c403c40ef4cfd50155ac440b166e38ddaf566c) commit 04a988cfb1f8f87034cbfa987c9a91644f805f43 Author: Eli Collins Date: Tue Aug 28 01:41:13 2012 +0000 HDFS-3856. TestHDFSServerPorts failure is causing surefire fork failure. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377934 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d6851209608f5bdfecff253759230ab9089a1e8c) commit fee67255400b8d7dd7392b6d69bf64a0ecaffbe1 Author: Thomas Graves Date: Fri Jul 6 13:38:11 2012 +0000 MAPREDUCE-4387. RM gets fatal error and exits during TestRM (Kihwal Lee via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358201 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 98fc217bb65e38ecb4140806f6aa2c5d721e4a1f) commit 653ba4fd4f766be220e658a385babd24080c7dca Author: Robert Joseph Evans Date: Mon Jul 9 16:14:24 2012 +0000 MAPREDUCE-4402. TestFileInputFormat fails intermittently (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359252 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b38e15c48d1170679c62867dee04a677e646bc45) commit 4982806ba34a087f076f005951477af8b62d6ad8 Author: Alejandro Abdelnur Date: Tue Jul 17 23:31:16 2012 +0000 MAPREDUCE-4422. YARN_APPLICATION_CLASSPATH needs a documented default value in YarnConfiguration. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362722 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8f5f00d6ebb5f1bbd6d76c4d5eb317edfd7400c0) commit f96c3dcd35fa6e645d3b2746aa108d33d26818ed Author: Robert Joseph Evans Date: Fri Jul 13 20:42:48 2012 +0000 MAPREDUCE-4419. ./mapred queue -info -showJobs displays all the jobs irrespective of (Devaraj K via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361389 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 154ec3828ea3cfd13ad020fd4f84f37dc8a4ffa2) commit 7b1e0bfa2669d562cc30a52697a4372f0e29841f Author: Robert Joseph Evans Date: Tue Jul 17 19:01:42 2012 +0000 MAPREDUCE-4283. Display tail of aggregated logs by default (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362608 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8feaf094d41461758d5c09974f858e530caf452d) commit 09e60c578e0c5fa2003f1ef942bb197423df86a7 Author: Alejandro Abdelnur Date: Mon Jul 30 22:56:15 2012 +0000 MAPREDUCE-4342. Distributed Cache gives inconsistent result if cache files get deleted from tasktracker. (mayank_bansal via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367352 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a8b2ad8720911ed492c5b6758899d1ec39fa8b4f) commit dfd142c3e7d197f43092ae82edfce20f9cea2fd2 Author: Todd Lipcon Date: Mon Aug 27 19:55:01 2012 +0000 HDFS-3845. Fixes for edge cases in QJM recovery protocol. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1377809 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3cbfd2edf3c78160ac8a0574be7633daa2b31762) commit b999755dce123a9f8dfecdd83a0f4ddfae1a6310 Author: Robert Joseph Evans Date: Tue Jul 17 19:14:33 2012 +0000 MAPREDUCE-4380. Empty Userlogs directory is getting created under logs directory (Devaraj K via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362612 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8c6b4918bdb717bc6f5e1d920e115e699a303555) commit 94d213b09e96fb0954903026652a7de5ba0ddf50 Author: Todd Lipcon Date: Wed Jul 18 00:51:32 2012 +0000 HADOOP-8537. Fix TFile tests to pass even when native zlib support is not compiled. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362729 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 885ad08eb34ea69b2a482c6c593a23d303c98bec) commit 3bdcaacfe5cbba1ba9ac4865458a7183a8931b3a Author: Aaron Twining Myers Date: Fri Jul 20 20:50:30 2012 +0000 HADOOP-8609. IPC server logs a useless message when shutting down socket. Contributed by Jon Zuanich. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363950 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1e3d53c58e483e937ee6660db436a77c4db66fe5) commit 2eafb9d10facac9cb94a948a298129435ef2e52e Author: Suresh Srinivas Date: Thu Jul 26 18:21:39 2012 +0000 HADOOP-8623. hadoop jar command should respect HADOOP_OPTS. Contributed by Steven Willis. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366126 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 36df10178f5628554c8592a62e9bc329d98bd306) commit d82d51e10335f3c5e6c2c0403ffc9e9bbbfa4087 Author: Aaron Twining Myers Date: Fri Jul 27 15:13:57 2012 +0000 HADOOP-8626. Typo in default setting for hadoop.security.group.mapping.ldap.search.filter.user. Contributed by Jonathan Natkins. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366410 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f9026fb2a1e8f91c372253530ce0c5a9aecfb11) commit 16b0f3a8c3679d786562e6701267740286a1aeaf Author: Alejandro Abdelnur Date: Thu Aug 23 23:24:25 2012 +0000 HADOOP-8031. Configuration class fails to find embedded .jar resources; should use URL.openStream() (genman via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376772 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0b45e523355dc85ff3e4c63bba861410f7c62a2f) commit 16bd098e52ceb42096064c30849cf8dbdadbfd82 Author: Thomas Graves Date: Tue Jul 10 20:50:17 2012 +0000 HADOOP-8573. Configuration tries to read from an inputstream resource multiple times (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359891 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0bd332d1b59f67b5171d40140aec5490ea2ac32a) commit 05e047c94fd76371fcceabb2c11b93b670facee5 Author: Alejandro Abdelnur Date: Fri Aug 24 23:36:55 2012 +0000 MAPREDUCE-4408. allow jobs to set a JAR that is in the distributed cached (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377149 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 566878c7e58e06220632b382e62d1905565f3815) commit 68821fe660ea6a6786c29f5df00ad5a81974a27f Author: Robert Joseph Evans Date: Tue Aug 21 17:46:07 2012 +0000 MAPREDUCE-4570. ProcfsBasedProcessTree#constructProcessInfo() prints a warning if procfsDir//stat is not found. (Ahmed Radwan via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375687 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8fdb4aa485eb78037d1626f1bcedd77a538efd55) commit 411a3ceab6c6a2b816da25dabd4ae56cf8bbb136 Author: Thomas Graves Date: Wed Aug 1 14:02:22 2012 +0000 HADOOP-8633. Interrupted FsShell copies may leave tmp files (Daryn Sharp via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368002 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dab7719ef7e38d22ed1ad50e94987918526d60f5) commit 8e31872501bcc498d2465e6f30effdd13a075f49 Author: Robert Joseph Evans Date: Tue Jul 31 18:58:43 2012 +0000 HADOOP-8637. FilterFileSystem#setWriteChecksum is broken (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367702 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 20e24c7653696e81cbf70ae218c0f607c7a64406) commit 98d65ff51034d4479fa9b8937c4b91e592315003 Author: Robert Joseph Evans Date: Mon Jul 30 20:58:44 2012 +0000 HADOOP-8635. Cannot cancel paths registered deleteOnExit (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367296 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6d1836901477e9db0637cc112c2ecb5ffb9c075b) commit 04976b36ee4caaa0bad078e9197111bbec725fd2 Author: Robert Joseph Evans Date: Mon Jul 30 18:11:32 2012 +0000 HADOOP-8550. hadoop fs -touchz automatically created parent directories (John George via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367202 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8b08fb4412a0c0b6abc4be849032ec930af086fc) commit f720f9c4e57be62a9244165275463fdc8556af74 Author: Robert Joseph Evans Date: Mon Jul 30 18:05:38 2012 +0000 HADOOP-8634. Ensure FileSystem#close doesn't squawk for deleteOnExit paths (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367196 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 19d258120b79906d0b883342ad715b43b487632e) commit 9640ca2cd4f4f8c1a84aca96c81173ef6cf2d088 Author: Robert Joseph Evans Date: Tue Jul 24 19:00:50 2012 +0000 HADOOP-8606. FileSystem.get may return the wrong filesystem (Daryn Sharp via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365224 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 690729cbe3437e2763309349c9603a6a6ae83fda) commit 24db6d6294391c7a1f0c2b6de89922186c3d6d15 Author: Aaron Twining Myers Date: Fri Aug 24 18:52:59 2012 +0000 HDFS-3678. Edit log files are never being purged from 2NN. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1377046 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 197678ed9782b70f037f83763e16579f3350799e) commit b74b78ba0642450aa2ac43fd012849413e9b1e42 Author: Aaron Twining Myers Date: Thu Aug 23 18:24:13 2012 +0000 MAPREDUCE-2374. "Text File Busy" errors launching MR tasks. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376632 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f193e4b4932a1d4f3b731a52277c2a80c65e898) commit 74e3a48637c7ee509680a38464640df37862063b Author: Eli Collins Date: Thu Aug 16 17:13:13 2012 +0000 HDFS-3194. DataNode block scanner is running too frequently. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373928 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7d67b2ae99c046e7935031d630e14792a4e82d0) commit a30663f275ae98c109b5975da7576d271b34ef7f Author: Alejandro Abdelnur Date: Thu Aug 23 00:22:14 2012 +0000 MAPREDUCE-4470. Fix TestCombineFileInputFormat.testForEmptyFile (ikatsov via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376325 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 762a03257a5c38c711688b048057f747a2005bf3) commit 46a65e0ad3f75b54af8cdb220b02a79a4768ee34 Author: Aaron T. Myers Date: Thu Aug 23 15:01:30 2012 -0700 CLOUDERA-BUILD. Change default value for dfs.datanode.hdfs-blocks-metadata.enabled to true. commit bf0aba9b291670c33118572d63df9b708de30866 Author: Todd Lipcon Date: Tue Aug 14 20:11:40 2012 +0000 HDFS-3765. namenode -initializeSharedEdits should be able to initialize all shared storages. Contributed by Vinay and Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373061 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2db527c63db27afbf7f36d40a4bbb76efdf86e41) commit a41d41a75241a16d4ad2f10434efcbfc4d97f503 Author: Eli Collins Date: Thu Aug 23 20:49:55 2012 +0000 HDFS-3715. Fix TestFileCreation#testFileCreationNamenodeRestart. Contributed by Andrew Wang git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376689 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7a4bd856a92e1e66846acdc0838c963bdc5f772c) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376698 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 124843a67c2c7fd377e952f7196b24a80a5b23d6) commit efe91709d9b3b24fde196e3763b904b4d46f1160 Author: Thomas Graves Date: Tue Jul 31 13:39:41 2012 +0000 MAPREDUCE-4375. Show Configuration Tracability in MR UI (bobby via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367539 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cc570a461ae4f7bca0434da988c5e1a33b17ac14) commit 6a4e3827e5c9c4f15b5c961f63a2dd44875b215c Author: Robert Joseph Evans Date: Tue Jul 10 16:49:24 2012 +0000 HADOOP-8525. Provide Improved Traceability for Configuration (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359775 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ac689c1bd5e8b8ad4e60ab8c2fc3e2fab9f2ed54) commit ee43bf7d0f324facefd26a41e141c63bc359f372 Author: Suresh Srinivas Date: Thu Oct 13 03:38:58 2011 +0000 HADOOP-7664. Remove warmings when overriding final parameter configuration if the override value is same as the final parameter value. Contributed by Ravi Prakash. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1182645 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 56abdd5feaeb5ef08b414e159e5d65f8d143dc7a) commit 93454746e84925916bb9ada866400a40ffcb0f1e Author: Alejandro Abdelnur Date: Wed Aug 22 21:18:34 2012 +0000 MAPREDUCE-4068. Jars in lib subdirectory of the submittable JAR are not added to the classpath (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376253 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 28656c12204b06f6142b6ff01b748162cf5c8a7a) commit 14517b88e44fd2e4e6a9d4945657743ba577a50d Author: Eli Collins Date: Thu Aug 23 00:01:00 2012 +0000 HADOOP-8075. Lower native-hadoop library log from info to debug. Contributed by Hızır Sefa İrken git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1376322 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c14fbaa36884e2e652a01c87cba4aa49689f60cb) commit 7b8a4bb338014c58b0809343d0bbcfdc7ea573c4 Author: Aaron Twining Myers Date: Wed Aug 22 22:45:30 2012 +0000 MAPREDUCE-4577. HDFS-3672 broke TestCombineFileInputFormat.testMissingBlocks() test. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376298 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e2ebfba0794164ea6cade1c6e1c5c18522de82f7) commit d431cb175d16c5d5a7bebfa519557f6a0105d182 Author: Robert Joseph Evans Date: Wed Jun 27 14:28:08 2012 +0000 MAPREDUCE-4372. Deadlock in Resource Manager (Devaraj K via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1354531 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7e01d2e06cd11bb0ea472ca192ca9496a77e4847) commit 95346c8d9a1f38a3f21b1b0db7015e8a76aa2dde Author: Robert Joseph Evans Date: Thu Aug 9 17:29:36 2012 +0000 MAPREDUCE-3782. teragen terasort jobs fail when using webhdfs:// (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371325 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1ff46434b0951682b50be6167d4f5955f3f899ad) commit fab28885f3a23d594b6c366dc65b05c95e7e904c Author: Aaron Twining Myers Date: Wed Aug 22 18:56:02 2012 +0000 HADOOP-8721. ZKFC should not retry 45 times when attempting a graceful fence during a failover. Contributed by Vinayakumar B. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376195 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8d60c96c9afb511be6ce6ddc8df4691b3d05370c) commit 0c34f4c63ff26486203ed8ac8d01d4f37ad64f2b Author: Aaron Twining Myers Date: Wed Aug 22 18:48:32 2012 +0000 HDFS-3835. Long-lived 2NN cannot perform a checkpoint if security is enabled and the NN restarts with outstanding delegation tokens. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1376189 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 415e34cd43d0551d2a098d11a3594fca25e96fec) commit ce89743597dddd4c383dc612ae123c4d1217bad2 Author: Eli Collins Date: Wed Aug 22 18:46:00 2012 +0000 HDFS-3839. QJM: hadoop-daemon.sh should be updated to accept "journalnode". Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1376187 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 06ccfe8b3953c7d76e7469a73d4350784f8ee5ed) commit e8f0b8d8d6da7f0ee7d41176ba8ef2ffab1a06a8 Author: Eli Collins Date: Mon Aug 20 23:10:29 2012 +0000 HADOOP-8686. Fix warnings in native code. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375301 13f79535-47bb-0310-9956-ffa450edef68 commit 955bf335cec0c9cbb76f944ea35ee74ab1b2bdba Author: Eli Collins Date: Tue Aug 21 03:48:00 2012 +0000 HDFS-2727. libhdfs should get the default block size from the server. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1375383 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2fe7c6dff8b9d04337a8ffcd2d3426765d9cf629) commit 5a604c329ffd7965f726de2d344c5e55a7323a85 Author: Todd Lipcon Date: Mon Jul 16 18:54:46 2012 +0000 HDFS-3625. Fix TestBackupNode by properly initializing edit log during startup. Contributed by Junping Du. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362189 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bdebfc2f21d14cfcf48c31ea8950ca9279c3b76b) commit f5eaedf48ab532218c70c9e0e58c2609a42f3326 Author: Eli Collins Date: Sun Jul 8 19:53:14 2012 +0000 HDFS-3614. Revert unused MiniDFSCluster constructor from HDFS-3049. Contributed by Arun Murthy git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358825 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9ec1c06cbb683f0bce0dbc23ccd4511bab2663e2) commit 258244e14138bb5c7dccec47257ff513f5bdcaf0 Author: Aaron Twining Myers Date: Tue Aug 21 00:48:06 2012 +0000 HDFS-3826. QJM: Some trivial logging / exception text improvements. Contributed by Todd Lipcon and Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1375356 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8597531b7c21bcde0abf30faf7c773a83e7bb40d) commit d05848b0827eaf201d2cc2d604beb2b93ecaa929 Author: Aaron Twining Myers Date: Mon Aug 20 23:44:14 2012 +0000 HDFS-3823. QJM: TestQJMWithFaults fails occasionally because of missed setting of HTTP port. Contributed by Todd Lipcon and Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1375323 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 946ce88340a918692944e11b77a2baf33d69dcab) commit 4d4803cc6ac75f6b5f53b56010456db60fba1bf9 Author: Aaron T. Myers Date: Mon Aug 20 15:32:09 2012 -0700 CLOUDERA-BUILD. Add some missing imports caused by an errant merge. commit 910f4991eef9c066aa324fa00213d3d7e0c93197 Author: Todd Lipcon Date: Wed Aug 15 18:56:05 2012 -0700 HADOOP-8642. ProtobufRpcEngine should log all RPCs if TRACE logging is enabled. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366127 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3640d524661c7c83493281bba6439b1d4882418f) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt (cherry picked from commit 48317502e8a400ea1db09f8a407e6f7a911f2a63) commit 9184efee703a05ba1def2d02aca8db244ed06df6 Author: Todd Lipcon Date: Wed Aug 15 17:42:16 2012 -0700 HDFS-3796. Speed up edit log tests by avoiding fsync(). Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373558 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d3e5f101b731add6f460ed43633b849223fbcc91) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit 572dc7f46f8dabf7a58bd0a6f920903bbefb2ea0) commit 7ba5e174d9c0475d3be4fea114818aa2ea2c442f Author: Todd Lipcon Date: Wed Aug 15 17:41:01 2012 -0700 HDFS-3571. Allow EditLogFileInputStream to read from a remote URL. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355174 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d75fb3470cfd336a80b78fceedf42120eaf254e9) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/EditLogFileInputStream.java (cherry picked from commit 1c532dd261d7404d6346259ddf1f5e6da50f94f6) commit 386734f2250bf3527e798b7adb806e0393b856f2 Author: Todd Lipcon Date: Wed Aug 15 17:38:48 2012 -0700 HDFS-3789. JournalManager#format() should be able to throw IOException. Contributed by Ivan Kelly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372566 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7a576c0b3b747347ba3d3ba007270bf826d286f) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit 91f2061ca9f28467a9174e0e1ef57eb45ab5cf4e) commit d5d0d868a21872407df4e342ebd508c4c0516aa1 Author: Todd Lipcon Date: Wed Aug 15 17:34:09 2012 -0700 HDFS-3695. Genericize format() to non-file JournalManagers. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371513 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ad77008c6b833dd539cf579da90b4f4dfe2a3e2e) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit e625253152ae8719bb2acf9ca034f5b4f587831c) commit 890f2a8cfb911424acacd5f80e12f64c673fca17 Author: Todd Lipcon Date: Wed Aug 15 17:33:58 2012 -0700 HDFS-3573. Supply NamespaceInfo when instantiating JournalManagers. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356388 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ce81bab8f9477987e869979f8c588d91d9d16180) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/server/namenode/TestGenericJournalConf.java (cherry picked from commit eeb8e0bdbb987ffb2deff36876d9e66bd185653c) commit f3275a8642ed58abba0e9fe74cb79e8cc8b055c2 Author: Todd Lipcon Date: Wed Aug 15 19:18:57 2012 +0000 HDFS-3800. improvements to QJM fault testing. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373587 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 880f478f02512bf00e9d9db6cc4e4fffc001752d) (cherry picked from commit e7f659728db361627c0a195ce72962b2978aa3c8) commit b9b8ea266ae4ca72109894076e0cd8e26a4e2f14 Author: Todd Lipcon Date: Wed Aug 15 18:58:51 2012 +0000 HDFS-3797. QJM: add segment txid as a parameter to journal() RPC. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373571 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ee4bb894b74f086c7f29ca5b69141015494b29c7) (cherry picked from commit 50a106e2347c4db81785ffe58151fb04999f5911) commit 29e1d85519288b556acdf540e2795bc9f39ee59c Author: Todd Lipcon Date: Wed Aug 15 00:57:24 2012 +0000 HDFS-3799. QJM: handle empty log segments during recovery. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373183 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 88b426f617e5c8e5a810659a3aa3be131cf6c635) (cherry picked from commit 9910cf988fa99724a3a21716c8184b24384aa8e3) commit 720197ec14a742a54c423762150136f17d93c544 Author: Todd Lipcon Date: Wed Aug 15 00:54:49 2012 +0000 HDFS-3798. Avoid throwing NPE when finalizeSegment() is called on invalid segment. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373179 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e63a7949fdf084dd8a93573a9d9b96ae5d08b407) (cherry picked from commit edf23b07067880af0b10e3fa085ecb8fe45e7e76) commit a6a7d70afc6d32df24f81f072f03fb6827c94e78 Author: Todd Lipcon Date: Wed Aug 15 00:52:24 2012 +0000 HDFS-3795. QJM: validate journal dir at startup. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373178 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2c199eef8c87a9e972100b018a4b3b519ec6b8cd) (cherry picked from commit 4eb2ae9f8414542e4e82dfab656373e8e527be12) commit 26bdc6dfddf7ffe6d7dd9c9f028dd42fe63d10e3 Author: Todd Lipcon Date: Wed Aug 15 00:48:11 2012 +0000 HDFS-3793. Implement genericized format() in QJM. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1373177 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d4dbe42ab6fa930cf8defc70e80f2c41ec7a31b8) (cherry picked from commit 6e38eed6a8ce0a6bfb6938034d8bda575037053c) commit f0c3d677ebe124ff8b168253d3d69879a5cc023d Author: Aaron Twining Myers Date: Wed Aug 8 17:21:27 2012 +0000 HDFS-3773. TestNNWithQJM fails after HDFS-3741. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370846 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 58ce6213466db4777a2e48a3655352491c5e39f1) (cherry picked from commit d6ca63104ee98851db9d44e42e5ba416363f6ad2) commit 14cf38d671043597be19bb18bd383e199aa5365b Author: Todd Lipcon Date: Tue Aug 7 20:24:01 2012 +0000 HDFS-3741. Exhaustive failure injection test for skipped RPCs. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1370497 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0a184ceb59ddedaecb7ca78beb39685b89e75425) (cherry picked from commit 0f2f825bcf22db544dd8b9f9db291bdc572fb2b2) commit 04b7709ebce4d0239ef14c465ac2b196c83f4639 Author: Todd Lipcon Date: Mon Jul 30 23:35:22 2012 +0000 HDFS-3725. Fix QJM startup when individual JNs have gaps. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1367366 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f7141bc4a6a1d28aa44f36d41d77ff4f6eacd50c) (cherry picked from commit 8b942a708f1f36fbf27a55084210b887917241eb) commit 6f5b79a69d3a298bc284736f415805b775ad2b81 Author: Todd Lipcon Date: Wed Jul 25 21:47:19 2012 +0000 HDFS-3693. JNStorage should read its storage info even before a writer becomes active. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365794 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c2065afd7cc41e5c4e0bee3e06deed57248c2837) (cherry picked from commit 7c5ebe172b9e8e5e8925405c8ba8d6f135d00570) commit 00746d620185c797dcaf409047c0c93d40c13ad1 Author: Todd Lipcon Date: Wed Jul 25 21:44:26 2012 +0000 HDFS-3692. Support purgeEditLogs() call to remotely purge logs on JNs. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365792 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0336b1117c41e4b8ca2d80fbbdf3328482a250b2) (cherry picked from commit 2b34b366e1780c97ef0912cbb2b1126f63b7ddef) commit bd0972ddcd915a844ed66a82703b4f3ad7edf9ed Author: Todd Lipcon Date: Wed Jul 25 21:40:17 2012 +0000 HDFS-3694. Fix getEditLogManifest to fetch httpPort if necessary. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1365788 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 996b5beb084cc5f0668ca040e260624bd0f2ce1f) (cherry picked from commit 534976de56316856756981a0fbe5f390b3c27e1f) commit 98c2ea6915dfd3eea34a054818e1fdcfed15a87d Author: Todd Lipcon Date: Wed Aug 15 17:31:43 2012 -0700 HDFS-3077. Quorum-based protocol for reading and writing edit logs. Contributed by Todd Lipcon based on initial work from Brandon Li and Hari Mankude. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3077@1363596 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2ceb75e437eab87c6277fa0f50182d625b517c22) Conflicts: hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/DFSConfigKeys.java (cherry picked from commit 2dbef427617849df95ef4e381f37f10308f10415) commit 25b2b0778c2606b508e5d6db384b70c310d027f4 Author: Todd Lipcon Date: Wed Aug 15 17:31:15 2012 -0700 HDFS-3049. During the normal NN startup process, fall back on a different edit log if we see one that is corrupt. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349114 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2fe437e65ed0a39132ffcf0282058c09d4d2a1d6) commit 805523acf5aabec7df610dcd1fc91e34c37d8925 Author: Todd Lipcon Date: Wed Aug 15 17:29:41 2012 -0700 Merge r:1349456 and r:1349459 HDFS-3408. BKJM : Namenode format fails, if there is no BK root. Contributed by Rakesh R. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349462 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit 2452104bab23af4e2e0da616bb90c5ee90657786) commit 68ad321dd6d73aeda6cc4b60423144b8777543b3 Author: Todd Lipcon Date: Wed Aug 15 17:29:21 2012 -0700 Merge r:1344874 HDFS-3441. Race condition between rolling logs at active NN and purging at standby. Contributed by Rakesh R. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1344876 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit 93b2ee814b3ab521d90377ea85f79bf76ce94722) commit 6d1efb9fdfb215d00c32398418c51e39e5d5367d Author: Todd Lipcon Date: Wed Aug 15 17:29:04 2012 -0700 Merge r:1344840 HDFS-3423. BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes. Contributed by Ivan and Uma. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1344852 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit f1814d5b94528220402630cdd0b99710122dd9c2) commit 6368e810fe67e25e8564f55d87b756168efd8a3f Author: Todd Lipcon Date: Wed Aug 15 17:28:49 2012 -0700 Merge r:1344423 HDFS-3468. Make BKJM-ZK session timeout configurable. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1344424 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit e1cbc8142c0c34534bc043385fae8e9cce1fd9ad) commit dd6657486238807b42887bf0f69da5fbcde65777 Author: Todd Lipcon Date: Wed Aug 15 17:28:12 2012 -0700 Merge r:1344386 HDFS-3474. Cleanup Exception handling in BookKeeper journal manager. Contributed by Ivan Kelly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1344397 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit d141f8ae7b37c80fffdb96818f8220ecafd87db0) commit 06574bbad424993b8626411588e88a17a4a74f8c Author: Todd Lipcon Date: Wed Aug 15 17:27:08 2012 -0700 Merge r:1343913 HDFS-3452. BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1343929 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit 93ac04560418eee468aeaa4e62836dd3f20a60da) commit 7807569fca1be278060a874dd6ee5029a4cf4757 Author: Todd Lipcon Date: Wed Aug 15 17:26:56 2012 -0700 vn merge -c -1342534 for HDFS-3058. HA: Bring BookKeeperJournalManager up to date with HA changes. Contributed by Ivan Kelly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1342538 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSEditLog.java (cherry picked from commit db8ac65dbdb7a6664004b5b83774afe1639143e2) commit a946b6551d83768c537dbf2a9653871e5d8e5bf6 Author: Todd Lipcon Date: Wed Aug 15 17:25:36 2012 -0700 svn merge 1340749:1340750 HDFS-2717. BookKeeper Journal output stream doesn't check addComplete rc. Contributed by Ivan Kelly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1340754 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt (cherry picked from commit ab2d9ea27f0c6a2a6affc05746faded2099cad22) commit cb5048c1389b4ace15528987f28ecee689d2c58f Author: Tsz-wo Sze Date: Wed Aug 15 02:23:21 2012 +0000 HDFS-3794. WebHDFS OPEN returns the incorrect Content-Length in the HTTP header when offset is specified and length is omitted. Contributed by Ravi Prakash git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373193 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b53e6649faf0305557bdef9666cd7319028ea95c) commit 6b14d421ece657f617b292ef5f287c3a0b462cad Author: Tsz-wo Sze Date: Fri Aug 17 01:42:35 2012 +0000 HDFS-3788. ByteRangeInputStream should not expect HTTP Content-Length header when chunked transfer-encoding is used. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374122 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f5b961b1bd236d0a4393c106ada928827dfb8ebe) commit d509e27c57bff95f6d0f229fd967e8799b700c68 Author: Eli Collins Date: Fri Aug 17 23:26:55 2012 +0000 HADOOP-8710. Remove ability for users to easily run the trash emptire. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374476 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9e95aa75d67eb939a5f2cbfed5ca201e7e14ed69) commit 45a56e268bab7c35ed5abb9dc77adcb9ced78bf3 Author: Eli Collins Date: Fri Aug 17 23:22:17 2012 +0000 HADOOP-8689. Make trash a server side configuration option. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374472 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4600bb7b82deda70576c1f6affa69310fed1ed2d) commit cf496e3e41a837b7987ec2572b481b37c9c35518 Author: Todd Lipcon Date: Mon Jul 16 22:41:56 2012 +0000 HADOOP-8599. Non empty response from FileSystem.getFileBlockLocations when asking for data beyond the end of file. Contributed by Andrey Klochkov. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362295 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 003bb07070cc117c27b00d2a6b36e94316d497fb) commit 09a0e743ae3d929fb885e7e579e694305f3aa9df Author: Robert Joseph Evans Date: Wed Jul 18 19:40:36 2012 +0000 MAPREDUCE-4157. ResourceManager should not kill apps that are well behaved (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363067 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 833103d74b2dfc0f0fe428f0e442b2d4aa937f45) commit 626cc39f777ab20500ad13f35236ae06de7cb2fa Author: Arun Murthy Date: Sun Jul 15 21:46:07 2012 +0000 MAPREDUCE-4427. Added an 'unmanaged' mode for AMs so as to ease development of new applications. Contributed by Bikas Saha. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361813 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 06859f2dcb6776686d8ed4bf1f76579b7c42c900) commit 82eda155c959b889510410cb24c540773ba7d7de Author: Aaron Twining Myers Date: Fri Aug 17 17:03:32 2012 +0000 HDFS-3672. Expose disk-location information for blocks to enable better scheduling. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1374359 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4d7d6ae20d5644ad24cd8a863893e127ba8a286b) commit a2ab89372f80fadb8a9b4ee004d25e58a13534a1 Author: Thomas White Date: Thu Aug 16 13:26:12 2012 +0000 MAPREDUCE-4562. Support for "FileSystemCounter" legacy counter group name for compatibility reasons is creating incorrect counter name. Contributed by Jarek Jarcec Cecho. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373823 13f79535-47bb-0310-9956-ffa450edef68 commit 873fa73d1c13007f54f594d00c8f584cb0feb7df Author: Thomas Graves Date: Mon Aug 13 21:48:33 2012 +0000 MAPREDUCE-4053. Counters group names deprecation is wrong, iterating over group names deprecated names don't show up (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372636 13f79535-47bb-0310-9956-ffa450edef68 commit 28d1d1fe6259f20973906ff1892a3a73b914b20e Author: Robert Joseph Evans Date: Thu Jul 5 18:09:09 2012 +0000 MAPREDUCE-4392. Counters.makeCompactString() changed behavior from 0.20 (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357776 13f79535-47bb-0310-9956-ffa450edef68 commit f2b690b37be90e116b09d71fa4872acdca994468 Author: Aaron Twining Myers Date: Thu Aug 16 23:47:33 2012 +0000 HDFS-3808. fuse_dfs: postpone libhdfs intialization until after fork. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1374106 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2619f5a2583af5850c59d7dd35586bc7f6275f5a) commit 6b1a316b5edaef8e6eafdef074a40a1c068cc978 Author: Alejandro Abdelnur Date: Wed Aug 15 23:08:40 2012 +0000 MAPREDUCE-4511. Add IFile readahead (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373669 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fbc1fd814cac8b1db0699acdbfb613b1f174321d) commit b19046a10ce71973cd9611023b79dd378eab2146 Author: Alejandro Abdelnur Date: Wed Aug 15 06:40:29 2012 +0000 HADOOP-7754. Expose file descriptors from Hadoop-wrapped local FileSystems (todd and ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373235 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c31e56de3310830c682d00b5cb5c09d8bb999783) commit 99ca77d5b85080fbab637447e1000fa033d6913f Author: Thomas Graves Date: Tue Jul 31 20:43:21 2012 +0000 HADOOP-8370. Native build failure: javah: class file for org.apache.hadoop.classification.InterfaceAudience not found (Trevor Robinson via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367764 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 67b9e5c677515dd647c214c33726b88d40425f3d) commit 7c00472c3a58ac9fd8db6efe44e0545e97411c9a Author: Daryn Sharp Date: Tue Aug 14 20:56:49 2012 +0000 HDFS-3718. Datanode won't shutdown because of runaway DataBlockScanner thread (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373090 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8b74dd62fa9da6021b8bf03ebe5813ca4aa26c62) commit 93699dd320348e9830d140e0d18bdeb116c5df75 Author: Eli Collins Date: Wed Aug 15 22:43:01 2012 +0000 HDFS-3048. Small race in BlockManager#close. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1373664 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 61d27b10120e1002323c49320b5a8a8e72c923c7) commit 4bba5ec542bbae398f75ab10a423594bfae0c45d Author: Tsz-wo Sze Date: Tue Aug 14 03:02:43 2012 +0000 HDFS-3658. Fix bugs in TestDFSClientRetries and add more tests. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372707 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7480cd863174882f5165d7e04e7d6ffa4a3c8a79) commit 0d0130e9e6f43bfacc6fc12181d492219083cb17 Author: Alejandro Abdelnur Date: Tue Aug 14 21:32:09 2012 -0700 HADOOP-8699. some common testcases create core-site.xml in test-classes making other testcases to fail. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373207 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d30638d160f63e30c25c750a7fed4d516175a5c1) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit 27237fa2fac6dbe510fc3056bbc88fab87269c86 Author: Eli Collins Date: Tue Aug 14 22:15:57 2012 +0000 HDFS-3150. Add option for clients to contact DNs via hostname. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373143 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e132d279c771ee73ee05373082a1f818aed048c0) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1373144 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 301f46057acdc9106478011a53cddf4f891d6090) commit 54bd087433d0e0c40e7fd87ba17929567fc9a3be Author: Alejandro Abdelnur Date: Fri Jul 20 23:19:23 2012 +0000 MAPREDUCE-987. Exposing MiniDFS and MiniMR clusters as a single process command-line. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364020 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7f68100c1603bf62a5b5812b6559a04a0daa806a) commit c1013123a4f4abf5fa75e22bec1ed0fb71bdf029 Author: Alejandro Abdelnur Date: Wed Jul 18 22:43:01 2012 +0000 MAPREDUCE-4407. Add hadoop-yarn-server-tests--tests.jar to hadoop dist package. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363162 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d9c677f0880e8af7717700b0100104c7ac044218) commit d7d4dee3360f68281d9ccbd7cf768529862c0534 Author: Alejandro Abdelnur Date: Wed Jul 18 03:36:46 2012 +0000 MAPREDUCE-4406. Users should be able to specify the MiniCluster ResourceManager and JobHistoryServer ports. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362751 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2d7e5cbe715c1841939954d9ce7e2f7a07252dba) commit 20215d870ca5ab7c622e01019d7cc45241e08d9c Author: Robert Joseph Evans Date: Tue Jul 17 13:50:35 2012 +0000 MAPREDUCE-4449. Incorrect MR_HISTORY_STORAGE property name in JHAdminConfig (Ahmed Radwan via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362495 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 49f4e24197ab22d813d3db19d7e93c6d046a4253) commit 8eef8601fda07d83a491e0ea0196ef3b2ce2118d Author: Siddharth Seth Date: Mon Jun 25 17:54:48 2012 +0000 MAPREDUCE-4290. Fix Yarn Applicaiton Status to MR JobState conversion. (Contributed by Devaraj K) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353684 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 09078f15defd7bc8d87dc54af5e54eb7e58ca11c) commit e1b7c5cc7793a9b2c52d4ea8ad82c55997d94822 Author: Harsh J Date: Thu Jun 21 21:12:31 2012 +0000 HADOOP-8524. Allow users to get source of a Configuration parameter. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352689 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f9d5618f8d6d97a2868f9a83f03b992272fefb2e) commit 90d8e9b305acf4d59c16be4fc88d891f5d3a154f Author: Thomas Graves Date: Thu Jun 21 15:01:35 2012 +0000 MAPREDUCE-4320. gridmix mainClass wrong in pom.xml (tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352550 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 915d1b52fc83787be78c7688ab3bf24dc67d4e46) commit 9b7d7b15ef2c3607d7060334c5ad2e926ad8a612 Author: Aaron Twining Myers Date: Tue Aug 14 00:04:55 2012 +0000 HDFS-3790. test_fuse_dfs.c doesn't compile on centos 5. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372676 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6dec97a708713561b4d2c720ea2b32a86863c7e6) commit 6a8debc2ef8bd72eda01c681105d1b46ad705d1d Author: Robert Joseph Evans Date: Wed May 30 14:48:53 2012 +0000 MAPREDUCE-4152. map task left hanging after AM dies trying to connect to RM (Tom Graves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344283 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d7ada821aeef1198416a0fba6654b1e4caf59053) commit 3b0964bb39217f62ffbfa96249186d4d5ea3764d Author: Alejandro Abdelnur Date: Mon Jun 25 15:58:55 2012 +0000 MAPREDUCE-4336. Distributed Shell fails when used with the CapacityScheduler (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353625 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c7f872543efa6711b7ec8ef5285afe3094b0dbba) commit 3942d8957bfbb040c59fec061c21a518f918c206 Author: Siddharth Seth Date: Tue Jun 19 22:00:45 2012 +0000 MAPREDUCE-4306. Fix distributed shell to work with users other than the one running the daemons. (Contributed by Ahmed Radwan) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351876 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 46242e779cef66e0d01518bc6fbb64470065418b) commit 5b2ea144ff779f3c3009cefa34d5642bf8e370b0 Author: Alejandro Abdelnur Date: Fri Jul 13 22:56:08 2012 +0000 MAPREDUCE-3451. Amendment, excluding findbugs warnings (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361436 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bd40a36a6f6e01fb44df1ab9f026cd512a509438) commit 42c84820d1ecefacf78c73bd78f5381bf2bd0050 Author: Alejandro Abdelnur Date: Fri Jul 13 20:42:00 2012 +0000 MAPREDUCE-4441. Fix build issue caused by MR-3451 (kkambatl via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361387 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b3db982dd7d182d56b90b2c5dbc554f42f895717) commit 537899cca788aacfb62a55f046bb857efd8bb2b1 Author: Alejandro Abdelnur Date: Fri Jul 13 00:43:01 2012 +0000 MAPREDUCE-3451. Port Fair Scheduler to MR2 (pwendell via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361020 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fa84b0d4abe092b855321895cec95a15e9be00ce) commit 519276841eea9fcc9360fc78db445dea2a5e7ff2 Author: Vinod Kumar Vavilapalli Date: Tue Jul 10 21:26:48 2012 +0000 MAPREDUCE-3940. ContainerTokens should have an expiry interval. Contributed by Siddharth Seth and Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359910 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 50a1e204f9c25debf2666e117e0fe45560137def) commit 6f6375ceedaf1897fe751fc8f48b89481f9de47d Author: Eli Collins Date: Mon Aug 13 20:27:14 2012 +0000 Amend HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372583 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4ad8dd2d210532c97b91218b114d9eb45e8f8a3c) commit 9475c7e379ea1d28b9f971017ee2a09c180bf89a Author: Todd Lipcon Date: Thu Aug 9 21:58:21 2012 +0000 HADOOP-8659. Native libraries must build with soft-float ABI for Oracle JVM on ARM. Contributed by Trevor Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371507 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7f3341afb5e6c7a3a5cfe6f1bd7dbc9c3a0293b7) commit 0b5b33384c79969110035aa2fe5489b2abe9729f Author: Eli Collins Date: Sun Jul 1 22:47:48 2012 +0000 HADOOP-8538. CMake builds fail on ARM. Contributed by Trevor Robinson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356041 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7a3404b300d963b0cfe5dfe99706466a00faaf61) commit b1b078bcd0a72cc452a65b09de0287c76867335a Author: Siddharth Seth Date: Thu Aug 2 21:55:37 2012 +0000 MAPREDUCE-3289. Make use of fadvise in the NM's shuffle handler. (Contributed by Todd Lipcon and Siddharth Seth) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368718 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 709c9f38eedc2c7b1907154006c0f2fda651ee43) commit 84b86999e36626a485fb12ab83062f782d570223 Author: Alejandro Abdelnur Date: Tue Aug 7 05:11:22 2012 +0000 MAPREDUCE-4494. TestFifoScheduler failing with Metrics source QueueMetrics,q0=default already exists. (ahmed.radwan via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370118 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c5ccfca8ecd5dd7018712eca177c459483b703a4) commit aa8846e6e34953cfdf9194a0c829d9d2215baf5c Author: Robert Joseph Evans Date: Fri Jul 13 20:53:43 2012 +0000 MAPREDUCE-4299. Terasort hangs with MR2 FifoScheduler (Tom White via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361397 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3ccf9271d547f18917e0403d4fd6009ec4c1ccc8) commit f75234c7a3ebe0ca17d39103e7f82a2dbce5d265 Author: Alejandro Abdelnur Date: Mon Aug 13 15:12:37 2012 -0700 HADOOP-8581. add support for HTTPS to the web UIs. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372642 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bbb2d973e8409ad804dbfe7fbac3b0b630faa3d6) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit da87876b2747fefe489b1f53623f2294825893e9 Author: Alejandro Abdelnur Date: Mon Aug 13 15:11:39 2012 -0700 svn merge -c 1367601 FIXES: MAPREDUCE-4496. AM logs link is missing user name (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367602 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 743d1f520a171905e77366ad2d14a7a97dd7e646) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit 8b3dcf02df7121f0ddad60bc5ee4c29ad253a42a Author: Alejandro Abdelnur Date: Mon Aug 13 15:10:21 2012 -0700 HADOOP-7703. Improved excpetion handling of shutting down web server. (Devaraj K via Eric Yang) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372637 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d8c9e2c7c64be2bb61a5e0e3e81e1ee99356d562) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit 78ff96a526546be9614cb1638fc65bf26c3d1b58 Author: Alejandro Abdelnur Date: Mon Aug 13 15:09:57 2012 -0700 HDFS-3190. Simple refactors in existing NN code to assist QuorumJournalManager extension. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372603 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f58d226a4a3a0b8be6867407bce1d785eea5703b) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 25f1c9416254f17e996e2ae089bf2d062c7b0f7c Author: Alejandro Abdelnur Date: Mon Aug 13 15:09:39 2012 -0700 HDFS-2330. In NNStorage.java, IOExceptions of stream closures can mask root exceptions. Contributed by Uma Maheswara Rao G. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1372599 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 44914117d46eefd6d585e011331dcbcc0c0bf539) Conflicts: hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt commit 80f335709ca9a5fc3c6f2e2290f72ec990e017b5 Author: Eli Collins Date: Mon Aug 13 22:08:39 2012 +0000 HADOOP-8687. Upgrade log4j to 1.2.17. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1372649 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 027edabc1f70bac2f4f26928cadd097b65c45318) commit cbc2cd9d786afdae9a31359f74630e933171245d Author: Robert Joseph Evans Date: Wed Jul 25 13:57:54 2012 +0000 HADOOP-8551. fs -mkdir creates parent directories without the -p option (John George via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365589 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5c55d4a7387e2715a58f555cf8b0603dd9ce7682) commit 48d1e9c793a4613e67192561232a5efc128423ea Author: Eli Collins Date: Mon Jul 2 22:46:55 2012 +0000 HADOOP-8463. hadoop.security.auth_to_local needs a key definition and doc. Contributed by Madhukara Phatak git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356513 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b6447bd35911d77f3d30a20bd1c441baa3d5b118) commit 1774606ea10b5a7f23e26ae18a79ea0006d87ec0 Author: Aaron Twining Myers Date: Wed Aug 8 02:54:59 2012 +0000 HDFS-3760. primitiveCreate is a write, not a read. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370650 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 31b46495f2e5d96e400842cd596ee26865ab762f) commit 9f48556076be49f82822c6064cd1e835c2721d44 Author: Alejandro Abdelnur Date: Tue Aug 7 17:46:24 2012 +0000 HDFS-3291. add test that covers HttpFS working w/ a non-HDFS Hadoop filesystem (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370392 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 759518e31ad64fa48114a2a12a90264d37d12c28) commit 4943e7082fc13edf46440df5b2d83372856fe813 Author: Alejandro Abdelnur Date: Thu Aug 2 22:12:58 2012 +0000 HDFS-3756. DelegationTokenFetcher creates 2 HTTP connections, the second one not properly configured. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368735 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit bc2eec634dc8c614156ea2459aeadfaf96b40d5e) commit 6b092bbdc7b978bd95b05516ce4621ee39f691d5 Author: Alejandro Abdelnur Date: Wed Aug 1 23:16:48 2012 +0000 HDFS-3724. add InterfaceAudience annotations to HttpFS classes and making inner enum static. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368310 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7710ced3f68da9806de6b6efe8d0485160ae03a) commit 2e3ce861cf0f40cdb1d0cee91402a9bbec265feb Author: Alejandro Abdelnur Date: Wed Aug 1 23:10:26 2012 +0000 HDFS-3513. HttpFS should cache filesystems. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1368305 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b1fba6745b19c019c16ad27f924f7c6f465bc937) commit e077a25a04e76d10d3042e0be2379420a1f9ad1e Author: Tsz-wo Sze Date: Wed Aug 1 01:44:03 2012 +0000 HDFS-3667. Add retry support to WebHdfsFileSystem. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367842 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab44267693db25f33b762c32fc3bcb8be275b077) commit 547fc4de45f164dbda4c9296c55c276f02875579 Author: Aaron Twining Myers Date: Mon Jul 30 18:07:53 2012 +0000 HDFS-3732. fuse_dfs: incorrect configuration value checked for connection expiry timer period. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367201 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 18ed9fb14909a410054866716ab0759e9e2bd99a) commit edb2e0fb90dcc8ee6b02432f9ea7ea59196892f5 Author: Daryn Sharp Date: Fri Jul 27 19:08:10 2012 +0000 HDFS-3553. Hftp proxy tokens are broken (daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1366501 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f700f1de65dc9719f439626630179b57bc1c32c7) commit c2a8653ba5ebedd71f4bf5d9d9eb7ecffcad0712 Author: Alejandro Abdelnur Date: Thu Jul 26 13:41:09 2012 +0000 HDFS-3113. httpfs does not support delegation tokens. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365989 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f7c98cf64c5763b668ad43eddf40e1276186d173) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365991 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fc7ee80b96f497ecba46a92c57fa7f49a8504435) commit b40c9f35a3e949c1690b0e67c9ddc85ec5c4d59d Author: Tsz-wo Sze Date: Wed Jul 25 23:43:17 2012 +0000 HDFS-3696. Set chunked streaming mode in WebHdfsFileSystem write operations to get around a Java library bug causing OutOfMemoryError. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365842 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5c115ef9694059de020b68d9c3395da8c6ebb8a6) commit 919455d0d6b4b508a495147045c92a1834d62c08 Author: Aaron Twining Myers Date: Tue Jul 24 15:27:10 2012 +0000 HDFS-3711. Manually convert remaining tests to JUnit4. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1365125 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8ffa31e753bdce5623b13f9f2a707342f61bca0d) commit 2fbf9b680ef08c32565d7bf568ae00acb7de8f16 Author: Todd Lipcon Date: Mon Jul 23 16:28:04 2012 +0000 HDFS-3697. Enable fadvise readahead by default. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1364699 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 666087592b688e0bdfad53a36868f82c21d90a46) commit d5a2c0b650c425de360f35ac8a8d2bab870ab02f Author: Aaron Twining Myers Date: Fri Jul 20 20:44:56 2012 +0000 HDFS-3583. Convert remaining tests to Junit4. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1363948 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1cd4118adf3dd52aecee946a63cc2cbb34d84172) commit 43fa8d4659a14d17fd1499d6f13f90002a0cfdfd Author: Eli Collins Date: Mon Jul 16 19:09:33 2012 +0000 MAPREDUCE-4447. Remove aop from cruft from the ant build. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362204 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dda4f2ede56ccba2ef22e268ffcbda6e5876e000) commit e816a2eea2208aaad094e9d7b794c2398b9fb86a Author: Thomas Graves Date: Thu May 24 13:10:57 2012 +0000 MAPREDUCE-4224. TestFifoScheduler throws org.apache.hadoop.metrics2.MetricsException (Devaraj K via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342244 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9d490bbf83812d62699b70d3da478df49cd8d8f1) commit a245fb9995284559329547934448a11b40de94a7 Author: Thomas White Date: Tue May 29 14:43:40 2012 +0000 MAPREDUCE-4146. Support limits on task status string length and number of block locations in branch-2. Contributed by Ahmed Radwan. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343755 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit afd5f3eea0a10a4666238bfe18b623bee0ca4c8d) Conflicts: hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java commit 68524bfaa31f4510abad0baa0696361f79f78a97 Author: Harsh J Date: Mon Jul 9 02:01:54 2012 +0000 MAPREDUCE-3907. Document entries mapred-default.xml for the jobhistory server. Contributed by Eugene Koontz. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358892 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dee90f3e0be32ff98d4b3f4a22ac31d2359628c1) commit 17d69d6db94db0d3f1e341b4ebee35c98fc0da72 Author: Harsh J Date: Sun Jul 8 17:23:40 2012 +0000 MAPREDUCE-2220. Fix new API FileOutputFormat-related typos in mapred-default.xml. Contributed by Rui Kubo. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358788 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d2faec2f8d917551f90d336d9b777f5c15615c23) commit 7a81665b38f2b3831d6649cf9f0e9b71da3a8a4d Author: Harsh J Date: Tue May 29 16:10:59 2012 +0000 MAPREDUCE-3493. Add the default mapreduce.shuffle.port property to mapred-default.xml. Contributed by Madhukara Phatak. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343804 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4dfc3f03751497b28005dc8012c106fa7c29a40b) commit d079ef2883a35a537b741f28ae47e65c26f43d6f Author: Robert Joseph Evans Date: Mon Jul 30 15:18:11 2012 +0000 HADOOP-8627. FS deleteOnExit may delete the wrong path (daryn via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1367114 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9ec1f0cde0a76b4b0b0647f9473f5c72bbf8a489) commit d41357eb0c877d4dac2d91037a700283f3e71af4 Author: Alejandro Abdelnur Date: Wed Aug 8 15:43:26 2012 +0000 HADOOP-8660. TestPseudoAuthenticator failing with NPE. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370815 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 79d778a7a7911014b499c28c07f794d1dd80d569) commit 8fa0af7d5c15d77fe3939aaec32a864eac20cc92 Author: Aaron Twining Myers Date: Mon Aug 6 21:04:33 2012 +0000 Add two new files missed by last commit of HDFS-3579. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370017 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ea575e5ac8b6f0687094fe5851e4cfff4dcf6981) commit e19df5b87267ea28e02b9f558ac09393c4dabc53 Author: Aaron Twining Myers Date: Thu Aug 9 14:44:05 2012 +0000 HDFS-3634. Add self-contained, mavenized fuse_dfs test. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1371231 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 612314e7ea6c765bf0613babaf8104c858b56f34) commit fc5b3b3697a4c4c8134a57d8324202a51c51584c Author: Aaron Twining Myers Date: Wed Aug 8 19:11:30 2012 +0000 HDFS-3710. libhdfs misuses O_RDONLY/WRONLY/RDWR. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370898 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 16f67c5d0e6b86cce11775eb7655385f7240db80) commit b35f945f6068d7649afca7d4077db7649f4eab0f Author: Aaron Twining Myers Date: Mon Aug 6 21:02:30 2012 +0000 HDFS-3579. libhdfs: fix exception handling. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370015 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 735ef5042a17b923ce00aaee0129a276655208e8) commit a0363e58eda8e5859d22ba01a6de3cf93ab62603 Author: Alejandro Abdelnur Date: Mon Aug 6 22:22:32 2012 +0000 HADOOP-8644. AuthenticatedURL should be able to use SSLFactory. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370045 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7d5d064d5ca795cec5fe584a308a275f2d628594) commit 05c2c18a2d558065de97b32f942ff12a9c8b4b22 Author: Robert Joseph Evans Date: Fri Jul 6 17:19:13 2012 +0000 MAPREDUCE-4379. Node Manager throws java.lang.OutOfMemoryError: Java heap space due to org.apache.hadoop.fs.LocalDirAllocator.contexts (Devaraj K via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358305 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b4a2bddd57ce7c76105d9b76e28697d237d52c08) commit 951ce03ba8d9d773410433a66b22cbfbab0e476a Author: Harsh J Date: Sat Jun 30 18:51:26 2012 +0000 HADOOP-3450. Add tests to Local Directory Allocator for asserting their URI-returning capability. Contributed by Sho Shimauchi. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355789 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ee48fddab8c6fd3abad42d2307d9d552fa09b309) commit 92d072f444a1bda0068c310838053dfd416743b3 Author: Aaron Twining Myers Date: Thu Aug 9 21:33:20 2012 +0000 HDFS-3721. hsync support broke wire compatibility. Contributed by Todd Lipcon and Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1371496 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2e43f9d39f2070af6c04464a43f26d584cfc2c14) commit 48ae619cbab597ebfaf0a4e32b40dbd78b63368d Author: Thomas Graves Date: Tue Jul 24 19:27:29 2012 +0000 MAPREDUCE-4467. IndexCache failures due to missing synchronization (Kihwal Lee via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365240 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 109ee794ed243a19a571a595f7a4fd2281ac8673) commit af1341f81adba85ab1b349918c5cda25daec39b2 Author: Thomas Graves Date: Thu Jul 5 21:36:02 2012 +0000 MAPREDUCE-4384. Race conditions in IndexCache (Kihwal Lee via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357937 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0b19f56e072805960bc4eb1917d5960bf268c649) commit 46e6f5ffe9ad9f60e8e3e82bd0059a160bf158fa Author: Harsh J Date: Sat Jun 30 16:49:24 2012 +0000 MAPREDUCE-4253. Tests for mapreduce-client-core are lying under mapreduce-client-jobclient. Contributed by Tsuyoshi Ozawa. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355766 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 57915e47f35ba70ff5acf09d5d9adf0e1e50217f) commit 882e140828f5a1e5342abaad8189604c0a475410 Author: Todd Lipcon Date: Wed Aug 8 13:23:16 2012 -0700 HDFS-3755. Creating an already-open-for-write file with overwrite=true fails. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370936 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 74fba83aa2d184d3a7d3c7747d53ed7d56a4a151) commit b831930d5e21f1519b21f4bd7e7112329d42ff1e Author: Eli Collins Date: Tue Aug 7 20:17:59 2012 +0000 HDFS-3754. BlockSender doesn't shutdown ReadaheadPool threads. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1370495 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 67331d3e6da48735751fc847181b4c7c2d18c882) commit 96627d2aa5d5634789a0118cbd7e675ee7e1b643 Author: Aaron Twining Myers Date: Tue Aug 7 16:46:03 2012 +0000 HDFS-3637. Add support for encrypting the DataTransferProtocol. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1370360 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8f7ec09f2a13b72622d6fe73bed6c9f3a62f15d0) commit 72c9300c98085032a3ea131d6bb90c2bb73c8fe8 Author: Alejandro Abdelnur Date: Mon Aug 6 18:14:47 2012 +0000 MAPREDUCE-4498. Remove hsqldb jar from Hadoop runtime classpath. (rkanter via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1369906 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5a12ba8b7e0c649bbb60634e01837a350fbd7f86) commit 166e91baca85f6844e494bf7fe9fbe2d276b3f2e Author: Aaron Twining Myers Date: Fri Jul 27 00:26:21 2012 +0000 HDFS-3650. Use MutableQuantiles to provide latency histograms for various operations. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366246 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dd1fc880a29496f7076d9df4e692c67bea7e4d06) commit a610dd926f5a453eaa74eff757eb13919854276b Author: Steve Loughran Date: Fri Mar 9 13:17:04 2012 +0000 HDFS-2966. TestNameNodeMetrics tests can fail under load. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298820 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5e9101ebe8cdb7a088bbd20c9b82a9a496bdebd5) commit 29ba1c8def219864ffd6d404a08c554d4b254114 Author: Robert Joseph Evans Date: Fri May 11 20:26:42 2012 +0000 MAPREDUCE-4233. NPE can happen in RMNMNodeInfo. (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337363 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 90dbbfc5743e80f016a5906c5d16e56bd0f874bf) commit 9c41e04989cad083a88829beb516aa693f888f73 Author: Eli Collins Date: Wed Aug 1 21:28:49 2012 +0000 HADOOP-8480. The native build should honor -DskipTests. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368257 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9115b373cebfc416c466d3e580fb24e9903a2c4e) commit d8b3fd61ef858a634bae0c539698e39fb6648d00 Author: Eli Collins Date: Wed Aug 1 21:23:10 2012 +0000 HADOOP-8620. Add -Drequire.fuse and -Drequire.snappy. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1368251 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f0b79377cebfd2507a55b937376bda5f80dd2fc5) commit ef71ae4b519c9b905dad77b4874931f8aea4f9e5 Author: Daryn Sharp Date: Fri Jul 27 16:39:51 2012 +0000 HADOOP-8613. AbstractDelegationTokenIdentifier#getUser() should set token auth type. (daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366440 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit be6067fb928cbd2771fb8d9f566ec7fb1fd8b861) commit 89b86f3496b6609802571007497b4b7c56a066e9 Author: Robert Joseph Evans Date: Mon Jul 23 19:31:33 2012 +0000 MAPREDUCE-3893. allow capacity scheduler configs max-apps and max-am-pct per queue (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364764 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4d72ced76594a63fbbd970ae3ab9663f678eac96) commit d0de55d7543dcde63b0ba53aa133c2b4b681c236 Author: Eli Collins Date: Wed Jun 13 05:37:27 2012 +0000 HADOOP-8433. Don't set HADOOP_LOG_DIR in hadoop-env.sh. Contributed by Brahma Reddy Battula git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349641 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f737736527b47b44d3e9b4a73d6c00d48082d021) commit 0f8eab20fbfdb05657c33cd6044bc371ecdd52f6 Author: Alejandro Abdelnur Date: Wed Jun 13 02:22:06 2012 +0000 HADOOP-8465. hadoop-auth should support ephemeral authentication (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349613 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 8948e9b15853d86227755ba0702bfc0093d7be44) commit e4d4f5a5a2003f909cb48f8fc7fe4c247c0466c0 Author: Alejandro Abdelnur Date: Tue Jun 12 20:45:57 2012 +0000 HADOOP-8458. Add management hook to AuthenticationHandler to enable delegation token operations support (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349514 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4a70e982808c409fad67b1d9821d363651c2011e) commit 6a9c91195fe8561f9b49378b8b86650af35a1e86 Author: Aaron Twining Myers Date: Wed Aug 1 02:22:30 2012 +0000 HDFS-3738. TestDFSClientRetries#testFailuresArePerOperation sets incorrect timeout config. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1367845 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d22eabcd8b542a7d03de54a536b359a581581746) commit 99bb8810b5a1ac376269c57429a925dc20bd337c Author: Thomas White Date: Mon Jun 11 20:37:03 2012 +0000 MAPREDUCE-3871. Allow symlinking in LocalJobRunner DistributedCache. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348997 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cede63d6929a8387eeaa13ef889d4ac180144366) commit b9b35b14141b8c07d9de06af41ce27d5f6b579d8 Author: Thomas Graves Date: Fri Jul 27 01:48:09 2012 +0000 MAPREDUCE-4423. Potential infinite fetching of map output (Robert Evans via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366258 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 94884cdfa126557e9f2250d4cb9fe11c44dde2b8) commit 2c49c1543aa868c6418b06e2c4043615a7a31b52 Author: Daryn Sharp Date: Tue Jul 17 19:32:14 2012 +0000 MAPREDUCE-4448. Fix NM crash during app cleanup if aggregation didn't init. (Jason Lowe via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362618 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 370c211bfe82095ae137cdcba537ee49fbe0d076) commit 7aa69a29d84fbde79b2afcb3b38e7f365fa50bb3 Author: Robert Joseph Evans Date: Mon Jul 16 19:11:08 2012 +0000 MAPREDUCE-4437. Race in MR ApplicationMaster can cause reducers to never be scheduled (Jason Lowe via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362209 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 642c6e6e00617cba467b0aa92dd2367e343e3467) commit eb1d5ade19a94df46511d51a85e7a369ba2b4b8c Author: Robert Joseph Evans Date: Mon Jul 16 14:19:36 2012 +0000 MAPREDUCE-4395. Possible NPE at ClientDistributedCacheManager#determineTimestamps (Bhallamudi via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362052 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5eb5803c3158502e02096a9aa42fa8520eb413f6) commit 5e4ef72c123e1cccd6622fdd60d6dc8058604596 Author: Thomas Graves Date: Mon Jun 11 13:54:46 2012 +0000 MAPREDUCE-3927. Shuffle hang when set map.failures.percent (Bhallamudi Venkata Siva Kamesh via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348846 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 91cee8c06bbfcee78cbdf63d3dc85435aa1c5342) commit 25c1e95e3e1dad260e5b5b11b1c3052037a9edc5 Author: Karthik Kambatla Date: Fri Jul 13 15:01:15 2012 -0700 BUILD: CDH-specific changes to hadoop-datajoin/pom.xml to support MR-4238 and MR-4270 commit 2fa533e541fbd67a9d3c296fe458aead9e299e30 Author: Siddharth Seth Date: Tue Jun 19 21:51:15 2012 +0000 MAPREDUCE-4270. Move the data_join test classes to the correct path. (Contributed by Thomas Graves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351869 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0a18589197c3c556c2465493094d5b243738a805) commit 829f93a8ff782d8d43ba7c4589d49d9307f0dd58 Author: Thomas Graves Date: Tue May 15 19:09:59 2012 +0000 MAPREDUCE-4238. mavenize data_join. (tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338835 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4900a83054b309d979a884ece699f68de730edc8) commit 28db75160e8a5653bd6764e8d8023110b1f293c4 Author: Todd Lipcon Date: Wed Jul 25 15:42:48 2012 -0700 HDFS-3626. Creating file with invalid path can corrupt edit log. Contributed by Todd Lipcon. Differs from upstream patch in test code: resolved conflicts because upstream has already converted all tests to JUnit 4, which was not yet cherry-picked into CDH4 at this time. Incorporates upstream amend commit: "Amend previous commit of HDFS-3626: accidentally included a hunk from HADOOP-8621 in svn commit. Reverting that hunk" (cherry picked from 629dcde3869feb83511ebd2c01f0c77378a55c85, fe4269049369f16f9145723136995047c03dbf2d) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365801 13f79535-47bb-0310-9956-ffa450edef68 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365817 13f79535-47bb-0310-9956-ffa450edef68 commit 03b2ed5538ea9aa1be90cc5249550a49998697ac Author: Suresh Srinivas Date: Fri Jul 27 21:51:07 2012 +0000 HDFS-3679. fuse_dfs notrash option sets usetrash. Contributed by Conrad Meyer. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1366545 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e95b0f2071e0f71e528441a4862c295a937ec489) commit ea0f99e53f57dd8b5b10b4fb9669147a25842302 Author: Robert Joseph Evans Date: Thu Jul 12 15:52:12 2012 +0000 MAPREDUCE-4416. Some tests fail if Clover is enabled (Kihwal Lee via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360735 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b3732e79bc770848e20697cf73e9fe6e1de52f11) commit 1cb817994e332a87fccbd14f5a97aa50919d1932 Author: Alejandro Abdelnur Date: Thu Jul 26 10:23:40 2012 -0700 MAPREDUCE-4417. add support for encrypted shuffle (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365979 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7dae18aa150c2eab8104c3913d057564831eb533) Conflicts: hadoop-mapreduce-project/CHANGES.txt hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/MRConfig.java commit 0b9c645442e18a9018e1749a58d23f69b5297802 Author: Siddharth Seth Date: Fri Jun 22 21:40:35 2012 +0000 MAPREDUCE-4031. Prevent a Node Manager hang during shutdown. (Contributed by Devaraj K) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353038 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ba579b792a6dc60fe2da8aeebdd23b36bd801743) commit 0ae0a286b959cfa0d13c559c34870d5356bf4d70 Author: Aaron Twining Myers Date: Wed Jul 25 21:21:14 2012 +0000 HDFS-3720. hdfs.h must get packaged. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365759 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c9e568c736d555926480b97bd077d997215b5ec9) commit 42d3c3d83a8bf89361d8c9432b19ede1861d9014 Author: Thomas Graves Date: Thu Jun 21 18:14:22 2012 +0000 MAPREDUCE-4295. RM crashes due to DNS issue (tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352638 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab17f633e6e3d4e146b80851d7f562470d5edd2a) commit 9feb901f2ab794ebb37f708a4b8499eb37e18e8a Author: Robert Joseph Evans Date: Wed Jun 20 21:22:33 2012 +0000 MAPREDUCE-3889. job client tries to use /tasklog interface, but that doesn't exist anymore (Devaraj K via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1352330 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fc93b5adb9bdd73df398d4ed8c983b28f8b73102) commit 784ecc76769f7d5eea7484e8d9836149f223e774 Author: Thomas Graves Date: Mon Jun 18 14:42:25 2012 +0000 HADOOP-8495. Update Netty to avoid leaking file descriptors during shuffle (Jason Lowe via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351363 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7b1bb2a5f4290699f40c6aab223c09185893ad9e) commit 47f94c38ec9534b0364ecb8beba67a7602745dbc Author: Alejandro Abdelnur Date: Tue Jul 24 22:08:27 2012 +0000 MAPREDUCE-4465. Update description of yarn.nodemanager.address property. (bowang via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1365322 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b3a7f95190351d0921f037fcf86d97d9b9034ed4) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit 20d17fe5eb7cb72dad351f666f2164293bc76eb9 Author: Aaron Twining Myers Date: Fri Jul 20 19:15:52 2012 +0000 HDFS-3608. fuse_dfs: detect changes in UID ticket cache. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363904 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit df354a430936cae62a08cbb2ac191ca6695fc6a7) commit eebca154e79588909a93bf12dfac5ac654454366 Author: Eli Collins Date: Tue Jul 24 01:53:29 2012 +0000 HDFS-3709. TestStartup tests still binding to the ephemeral port. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1364865 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a9ee786a7dcfb1aaf422e9a81b0318dfa3735bab) commit a62ba0f8b291d36fb3506d9aed30461c1f2cafcd Author: Todd Lipcon Date: Fri Jul 20 18:58:58 2012 +0000 HDFS-3597. SNN fails to start after DFS upgrade. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363899 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a5018d8d06b016b0571b6138c014e60281933a81) commit 53a16b5c7292ba6d174eecfdc3697a5b857b028a Author: Thomas Graves Date: Mon Jun 4 17:41:52 2012 +0000 MAPREDUCE-3350. Per-app RM page should have the list of application-attempts like on the app JHS page (Jonathon Eagles via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346047 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ee5952bc73b124d22e14056aac769cb52676959a) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346065 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0c8d706d965a2cb440a909f873467d461dec9197) commit 90d959d363658d0629165c5af175ac63a8a1c99e Author: Vinod Kumar Vavilapalli Date: Tue Jun 5 23:52:16 2012 +0000 MAPREDUCE-3873. Fixed NodeManagers' decommissioning at RM to accept IP addresses also. Contributed by xieguiming and vinodkv. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346671 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f91977623cb4372c872b6747b16895058d582f6a) commit 6fbaebbae4f22a14814fcc94d05f86154e620996 Author: Eli Collins Date: Thu Jul 19 23:04:01 2012 +0000 HDFS-3690. BlockPlacementPolicyDefault incorrectly casts LOG. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363576 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 88744ecbfb5362ce5d60fa361aa812d678ddecb7) commit 7f3fab9b9b1b5f714a83eec8f45043bcbc75ef9b Author: Eli Collins Date: Thu Jul 19 18:37:47 2012 +0000 HDFS-1249. With fuse-dfs, chown which only has owner (or only group) argument fails with Input/output error. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363466 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4533dd219fdc4f2fe1115df237901bfdfb4b055f) commit 3eb0dda346fdb59a580ff0e72cd0e53c51dc48fc Author: Eli Collins Date: Thu Jul 19 18:26:04 2012 +0000 HDFS-3675. libhdfs: follow documented return codes. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363459 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 84f7cd8bac1bc14438bd497c6449dea13ac74949) commit 1446907d1f5d642520e36fa8feedefa183aefa62 Author: Eli Collins Date: Thu Jul 19 18:22:56 2012 +0000 HDFS-3673. libhdfs: fix some compiler warnings. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363457 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2538173a98a654f4d263493361b6c0ee3229490d) commit a74ea90481e48d1cd3b316a7e921136177e298ea Author: Todd Lipcon Date: Wed Jul 18 23:42:13 2012 +0000 HDFS-3605. Block mistakenly marked corrupt during edit log catchup phase of failover. Contributed by Todd Lipcon and Brahma Reddy Battula. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363175 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a532172b3162ebc4d14ec0af0cc874dfc04b29f6) commit 66af13949a83691c41cf2c07c06c1eabed36e9ff Author: Daryn Sharp Date: Wed Jul 18 23:21:30 2012 +0000 HDFS-3646. LeaseRenewer can hold reference to inactive DFSClient instances forever (Kihwal Lee via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1363170 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2c3777a188ae449d0af64c30bb9cdeea3962bff2) commit c0ce9b0f19642b7f68b21fc86b7d803d2a790eb4 Author: Tsz-wo Sze Date: Wed Jul 18 15:12:47 2012 +0000 HDFS-3577. In DatanodeWebHdfsMethods, use MessageBodyWriter instead of StreamingOutput, otherwise, it will fail to transfer large files. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362976 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0487d2f6518081d1fc03593aad9c101b0d517979) commit 4a60a891645e6643ada7ee4a68e2770ace88ae70 Author: Daryn Sharp Date: Tue Jul 3 20:28:30 2012 +0000 HADOOP-8110. Fix trash checkpoint collisions (Jason Lowe via daryn) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356918 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit aaa9b37e9beba285baa9cff20d06bd5f5e0c710b) commit 5df491617a2a73e29eb46c61f0731bc948077280 Author: Aaron Twining Myers Date: Thu Jul 12 01:34:41 2012 +0000 HADOOP-8541. Better high-percentile latency metrics. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360502 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 279f74076101211ade8f1964ee97b040f3945fb1) commit 3f14f3bbbd2d9e237753b8e463e49b091f9315ef Author: Suresh Srinivas Date: Mon Jul 2 23:03:17 2012 +0000 HADOOP-8533. Merging change r1356504 from trunk to branch-2 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356515 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 81831aa964787548b88a89bb634a685d94c2df75) commit da50472a99a27d47d161d66c7c2b4bbffcd778c0 Author: Eli Collins Date: Mon Jul 16 16:54:49 2012 +0000 HDFS-3537. Move libhdfs and fuse-dfs source to native subdirectories. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362127 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fb154f83fa52d4f6707aec186196d037e4d61cff) commit 10502c2eb633207cae639c05095b4c150e0a6f2e Author: Eli Collins Date: Tue May 15 19:06:05 2012 +0000 HDFS-3418. svn merge -c 1338830 from trunk git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338833 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 08127bf4fca0b7654c228c7c62281056336cf8ab) commit 5aead1ca7b606c7f3b65fa47e7e8088c53ae4389 Author: Eli Collins Date: Tue Jul 3 21:43:48 2012 +0000 HDFS-3581. FSPermissionChecker#checkPermission sticky bit check missing range check. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356972 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9fa1a61b1bd6133a746fb3260e2c96a03d968998) commit b7402afbb19b0ed03ea39c95d295cce423ed6934 Author: Alejandro Abdelnur Date: Mon Jul 2 16:42:28 2012 +0000 HDFS-3575. HttpFS does not log Exception Stacktraces. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356332 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 00b1fcb764be17762e61d598bf1231744965170f) commit 3e61a7a9ce9b971627219a74241f1bcaab69a645 Author: Tsz-wo Sze Date: Mon Jul 2 07:39:02 2012 +0000 HDFS-3157. Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356095 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 206f29cf793976f81a0f232208e1869e0063bfe3) commit 57550b398689292c213f37ebfe69fdda4b75a2e9 Author: Tsz-wo Sze Date: Wed Jun 27 02:53:20 2012 +0000 HDFS-3551. WebHDFS CREATE does not use client location for redirection. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354317 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0eaf04e11593b1de35c157bc6bff9cfa71f9c29f) commit 9170f3fdc58c6810b68452a6afd742edbd983f94 Author: Aaron Twining Myers Date: Wed Jun 13 05:34:19 2012 +0000 HDFS-766. Error message not clear for set space quota out of boundary values. Contributed by Jon Zuanich. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349640 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9fba73104c20dbf7bef4bef7c600ae30bbcb5dfa) commit 95cbf48df827d2688f7660286cacbdcc065727c9 Author: Aaron Twining Myers Date: Fri Jun 8 07:04:58 2012 +0000 HDFS-2914. HA: Standby should not enter safemode when resources are low. Contributed by Vinay. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1347898 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b1d9ce1345ad00cecbb096b032e0220e35ace9fb) commit e6cc399aeec15a17ccd31af075a07fa7d5bd7832 Author: Eli Collins Date: Mon Jun 4 23:34:19 2012 +0000 HDFS-3266. DFSTestUtil#waitCorruptReplicas doesn't sleep between checks. Contributed by Madhukara Phatak git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1346194 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0844a3548acd452764b6169d33b7f2eb46e644c7) commit e66715686e77645f01233e296a95e837e7d8c3b4 Author: Uma Maheswara Rao G Date: Sat Jun 2 19:49:12 2012 +0000 Merge r:1345563 HDFS-2025. Go Back to File View link is not working in tail.jsp. Contributed by Ashish and Sravan. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1345564 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 828b056b0ece3b615adde913a9459251509de4e7) commit d5fc63aab391755dfb07dd52e1f65e94c16a9fff Author: Aaron Twining Myers Date: Sat Jun 2 00:42:09 2012 +0000 HDFS-3442. Incorrect count for Missing Replicas in FSCK report. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1345410 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit da1e6cded0a0c971c9dce46ff9a93e6401871443) commit dd7a4d327520a4777492a3357532d8f1516699a0 Author: Todd Lipcon Date: Thu May 17 22:30:52 2012 +0000 HDFS-3391. Fix InvalidateBlocks to compare blocks including their generation stamps. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339898 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4e30d27225701aaf3da0b68040d2745eeea7ecc0) commit 0885fbb343af67bac9601e3bee09329f2e8fbbe8 Author: Eli Collins Date: Thu May 17 17:01:23 2012 +0000 HDFS-1153. svn merge -c 1339706 from trunk git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339713 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 75f58fa3ad8d3cf981fdc30453ef99b7b8d78915) commit 5015147006f842aa73273a29c0edc0df08078d74 Author: Eli Collins Date: Thu Jul 12 19:59:20 2012 +0000 HDFS-3641. Move server Util time methods to common and use now instead of System#currentTimeMillis. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360896 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 151495a9bd1e98e99bdaa8607b1e83c653853c75) commit 6f9b4471fe9f7b982a1df6f1a8dd9bc9bd4bc2d4 Author: Uma Maheswara Rao G Date: Tue May 29 19:43:41 2012 +0000 HDFS-3398. Client will not retry when primaryDN is down once it's just got pipeline. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1343948 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0dafc2685f3061189dbb439928cbf01cd9f4df08) commit 051edbf632e9e6cd4cb21e83f27670c64fe6209e Author: Aaron Twining Myers Date: Wed Jul 11 16:10:50 2012 +0000 HDFS-3615. Two BlockTokenSecretManager findbugs warnings. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360256 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f7e5e1fd401dc31bd22f870da8e6fb363d809d2d) commit 9dd69692fae221ade5121cfec31e86ff6069df05 Author: Todd Lipcon Date: Thu Jun 7 18:43:45 2012 +0000 HDFS-3485. DataTransferThrottler will over-throttle when currentTimeMillis jumps. Contributed by Andy Isaacson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1347753 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9fa4a1a0eda783c875aebc2414746f233e6d8f5c) commit 0210bcdb4e8ee6a3e6459a9e27869ccfa2264083 Author: Aaron Twining Myers Date: Fri Jul 6 19:00:06 2012 +0000 Fix issue with NN/DN re-registration. Addresses the vulnerability identified by CVE-2012-3376. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358348 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1fcb422403d953ea20b8a46495b3e4f45018273b) commit 50ba6e1ea16446ebcf9adb76fa93ff6e1481cd9a Author: Todd Lipcon Date: Tue Jul 3 20:55:10 2012 +0000 HDFS-3574. Fix small race and do some cleanup in GetImageServlet. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1356937 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 70732f22b76a3857289f268888f56541327d6dbf) commit 04d4028357a6404b088151e7fcb8ac188fe748b5 Author: Tsz-wo Sze Date: Fri May 11 00:27:08 2012 +0000 HDFS-3385. ClassCastException when trying to append a file. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336977 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 001d39a13d6eb3aa8b418299de3ff3d00d083db3) commit ec0ff89569ebeb7f4972f64d33bc8c76ad5cd725 Author: Eli Collins Date: Mon Jul 16 18:34:09 2012 +0000 HDFS-3665. Add a test for renaming across file systems via a symlink. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1362179 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6565900d20865ca63b548eb3bb8cdbd7e0740f2a) commit 0f84ee942a274ed717980232e09bf408c37ad15d Author: Harsh J Date: Mon Jul 16 03:07:49 2012 +0000 HDFS-3659. Add missing @Override to methods across the hadoop-hdfs project. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361895 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1a5718449ffa51f3f9cd031b0594d05780f7c673) commit a51f19c761eb145bbea71171b32e8d5dc454d2ea Author: Eli Collins Date: Sat Jul 14 17:19:26 2012 +0000 HDFS-3610. fuse_dfs: Provide a way to use the default (configured) NN URI. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361566 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e5b8f22049a28dfc688e1f6962e4db7a5a22bd8d) commit 43b7a3e6b06273d4a3f2edb9911f00401665e3b8 Author: Eli Collins Date: Sat Jul 14 17:03:24 2012 +0000 Amend HDFS-799. Remove unnecessary tls check. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361563 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ad5f9f036727721b92dc1d834a8351722233bea8) commit a41e24632248fb61aac8f14eb93dcf61daff63b3 Author: Eli Collins Date: Sat Jul 14 00:53:07 2012 +0000 HDFS-3539. libhdfs code cleanups. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361461 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7baabd7992702bc7703679b7048b8dc18800078a) commit 0948b1088e7045b3877fadf0ab7c3c71445698fe Author: Eli Collins Date: Sat Jul 14 00:36:32 2012 +0000 HDFS-3609. libhdfs: don't force the URI to look like hdfs://hostname:port. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361455 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit de39c0501bd50b367fb7e623e8ea1fcc406e8622) commit 776851748da95e443aba4226b51ded27aae1c84c Author: Eli Collins Date: Sat Jul 14 00:22:55 2012 +0000 HDFS-3492. fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361450 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 940df5ce6f647bc4e7c0a4a8d067c7514621482f) commit 4ce324820adc3635e31624b0d4b98584896fb528 Author: Eli Collins Date: Sat Jul 14 00:04:36 2012 +0000 HDFS-470. libhdfs should handle 0-length reads from FSInputStream correctly. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361447 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cdcd912b36b9afa5e86d071761a3da29d794d055) commit 6e25bd209356c730ba7548c4afe3daa25e9ab602 Author: Eli Collins Date: Fri Jul 13 23:28:23 2012 +0000 HDFS-3606. libhdfs: create self-contained unit test. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361442 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f0aecffb9a5a8e4ebb476ba3771a11a476e9ed1a) commit 5d12b3eb23c50ecf7751d5e39b272d84387b3f78 Author: Eli Collins Date: Fri Jul 13 23:05:35 2012 +0000 HADOOP-8499. Lower min.user.id to 500 for the tests. Contributed Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361439 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c6f0a8f54cce99525ce37a622a59c6b9e93896f6) commit 145c3cf517aaaa251702c5362b5b3f359f8ae053 Author: Harsh J Date: Fri Jul 13 07:21:18 2012 +0000 HDFS-3612. Single namenode image directory config warning can be improved. Contributed by Andy Isaacson. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361060 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cf636013882e813f2ba2ab0b0192d89f8ad61708) commit 4ecbd9bbde9ce34f24f43e924811525267e0f413 Author: Eli Collins Date: Fri Jul 13 00:46:13 2012 +0000 HDFS-3306. fuse_dfs: don't lock release operations. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361022 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b99c8c875770e6088261d925db41eee766974990) commit 3aa5543ab669faaaade827fb19123e474905a6ea Author: Eli Collins Date: Fri Jul 13 00:10:26 2012 +0000 HDFS-799. libhdfs must call DetachCurrentThread when a thread is destroyed. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361009 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e50fa926e4892859740add458b62dfb6699a915e) commit 961c516dbcdc7565dcca6022c7a85c266722436f Author: Eli Collins Date: Thu Jul 12 23:53:12 2012 +0000 HDFS-3633. libhdfs: hdfsDelete should pass JNI_FALSE or JNI_TRUE. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1361006 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e4092ae97cc1a4c6b234d63b974bb9e5911cd899) commit 6cee94df8665e8a81fcd819edf8ab6a73e457aa4 Author: Aaron Twining Myers Date: Thu Jul 12 01:23:37 2012 +0000 HADOOP-8585. Fix initialization circularity between UserGroupInformation and HadoopConfiguration. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360499 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a24fc5d0177b1589c596d59170b14dc94aceda25) commit 27c40ca59b54ed34e5ec0cde7b0da9ecac90346a Author: Aaron Twining Myers Date: Tue Jul 10 18:31:25 2012 +0000 HDFS-3568. fuse_dfs: add support for security. Contributed by Colin McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359826 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ed8dc0e96c80f36e93802e501ca677ae6eccfb34) commit d8142730df3760ec2d84d6fbe7d214850606fdb4 Author: Eli Collins Date: Wed Jul 11 22:31:07 2012 +0000 HADOOP-8587. HarFileSystem access of harMetaCache isn't threadsafe. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360450 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e0b3e49e249a538d846befecb63d0b052cce17ea) commit 481ed9e36cfe12188c4395e03f72411a9617d251 Author: Eli Collins Date: Wed Jul 11 08:14:46 2012 +0000 HADOOP-8586. Fixup a bunch of SPNEGO misspellings. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360053 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit be601739e93efd59f5350b2409bfe88526794c63) commit b3da8f3d52186b1a7dd56af3796596bf97187224 Author: Harsh J Date: Wed Jul 11 03:37:55 2012 +0000 HDFS-3611. NameNode prints unnecessary WARNs about edit log normally skipping a few bytes. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360002 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b577e3d547f35519a199bd7d163101389e9e654b) commit 23863dea5c50afd73a07a4e4eb517eeb24986b1e Author: Harsh J Date: Wed Jul 11 03:15:54 2012 +0000 HDFS-3613. GSet prints some INFO level values, which aren't really very useful to all. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1360000 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 028183474cb2724954efde140a85a53ec6d4a7e0) commit 043a3914399738ff582b272f7b9bfda249df8a1b Author: Harsh J Date: Tue Jul 10 21:15:21 2012 +0000 HDFS-3629. fix the typo in the error message about inconsistent storage layout version. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359906 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 2e73ba66a2560d7ea43c825d3344d6105bac0813) commit f64ea8523ec4136e6cb56cf5da51b216679fa061 Author: Tsz-wo Sze Date: Tue May 22 23:19:33 2012 +0000 HDFS-3415. During NameNode starting up, it may pick wrong storage directory inspector when the layout versions of the storage directories are different. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1341677 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a48fab32efa9cf46beb346610cf214335229d8ab) commit c16c4ab1ad302188cb5b1da752f8016f7890c1f4 Author: Harsh J Date: Tue Jul 10 11:53:39 2012 +0000 Backport of HDFS-3555 from trunk. svn merge -c 1359619 ../../trunk. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1359621 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e81a36cbb6329d0482495fac7090b437c303fb44) commit 6100e68545a244fc29e7ede89db6ad17497ab291 Author: Harsh J Date: Sun Jul 8 00:40:02 2012 +0000 HDFS-2988. Improve error message when storage directory lock fails. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358685 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 81e29e6e30d4d82d13962f2a835d8055d1091805) commit 471bb543be5a9063c3f4bfc64c9328b71d37d1b6 Author: Eli Collins Date: Sat Jul 7 22:35:39 2012 +0000 HDFS-3604. Add dfs.webhdfs.enabled to hdfs-default.xml. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358660 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b0611937c72d1c9a075a8080088076ceaa920a74) commit 2c01640d5af5b9a14e5c44437f7b2d0f279130a9 Author: Tsz-wo Sze Date: Fri Jun 15 23:02:46 2012 +0000 svn merge -c 1350825 from trunk for HDFS-3518. Add a utility method HdfsUtils.isHealthy(uri) for checking if he given HDFS is healthy. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1350826 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4326efc19ad292030c8c956a1f238d87bb574a5a) commit cc07ee75e0533c39f8559d7b3e1c6b8a432bfe71 Author: Uma Maheswara Rao G Date: Sun Jul 8 17:56:41 2012 +0000 HDFS-3541. Deadlock between recovery, xceiver and packet responder. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1358798 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6b7f1f8458b2858fbfb31243ea856a3db5436380) commit 2f758828307ffb4fade36bd00cf6beef2b3101ff Author: Todd Lipcon Date: Thu Jul 5 22:18:16 2012 +0000 HDFS-3170. Add more useful metrics for write latency. Contributed by Matthew Jacobs. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1357969 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit deb35e642ab07ac2ab38483b84e5756be1c36847) commit 069aa98edeaaaadc5a18751bac9dc43e3211e55b Author: Tsz-wo Sze Date: Mon Jun 4 17:54:48 2012 +0000 HDFS-744. Support hsync in HDFS. Contributed by Lars Hofhansl. HDFS-731 implements hsync by default as hflush. As descriibed in HADOOP-6313, the real expected semantics should be "flushes out to all replicas and all replicas have done posix fsync equivalent - ie the OS has flushed it to the disk device (but the disk may have it in its cache)." This jira aims to implement the expected behaviour. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1346056 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6f76829ec8b19d62a4e2d5b1e608096d636b7fce) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1346050 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4a5260cc22c79cd406942546ceb6179a3d8c185e) commit e425d580faecff68f3c8ac0fd6d7012dba7fcfe6 Author: Alejandro Abdelnur Date: Fri Jun 29 22:59:09 2012 +0000 HDFS-3580. incompatible types; no instance(s) of type variable(s) V exist so that V conforms to boolean compiling HttpFSServer.java with OpenJDK git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355595 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 651d4ca1affeb684560f016ee41ec6aa6177c24b) commit 5b75ba6819acaf659b5bd0b72dfad7189dec3280 Author: Alejandro Abdelnur Date: Fri Jun 29 21:05:43 2012 +0000 HDFS-3491. HttpFs does not set permissions correctly. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355558 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 68084f14acea5078e62e8f5e593388bfbb33ae0c) commit 4e51f7d01482229462a1ac8bda8f2268e01b6e80 Author: Aaron Twining Myers Date: Thu Jun 28 20:08:08 2012 +0000 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355143 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4108252b83889b0c4d9e2baa7c5d6c29df10892f) commit a623b026d9c7b29471df3cae32aa1e47c575f269 Author: Robert Joseph Evans Date: Thu Jun 28 14:23:56 2012 +0000 HADOOP-8535. Cut hadoop build times in half (upgrade maven-compiler-plugin to 2.5.1). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355020 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0ac90bf2fc0ffdb160af7311c2ac610b48ebaa1c) commit 9b9796ae8998ec2ab0a477638d56e17311714c68 Author: Todd Lipcon Date: Wed Jun 27 22:41:26 2012 +0000 HDFS-3572. Cleanup code which inits SPNEGO in HttpServer. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354766 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f3711e1d457ea315452c938c4ee8ed4dea7d739a) commit 592c8000fc64f4d84c61d85b61c8e56cc5ed8c1b Author: Alejandro Abdelnur Date: Wed Jun 27 16:13:35 2012 +0000 HDFS-3481. Refactor HttpFS handling of JAX-RS query string parameters. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354603 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b8ac543acf0a7e9a7f99465832afe08d54915c99) commit 4934943a2a8709cd0fcdd8e05f12493df8234169 Author: Konstantin Shvachko Date: Fri May 25 06:29:17 2012 +0000 HDFS-3368. Missing blocks due to bad DataNodes coming up and down. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342512 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5b66d56cf7f5bf6470edcafef8d559e2792ac978) commit 6919ac9722bbd9ee76787629985969a4c2a39f6d Author: Tsz-wo Sze Date: Tue Jun 12 05:27:15 2012 +0000 HDFS-3504. Support configurable retry policy in DFSClient for RPC connections and RPC calls, and add MultipleLinearRandomRetry, a new retry policy. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349124 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 76dd6b0830b4c0a87767adc6c6d077637579082b) commit 817d1aa4e1e393f4a6f5ffd98b79003374180ad9 Author: Eli Collins Date: Tue Jun 12 05:00:07 2012 +0000 HDFS-3520. Add transfer rate logging to TransferFsImage. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349117 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 553b8c09cca8bb4f676c6a99e389d2f42c197fa5) commit 763f6d0016fa520b1c1bc9970fc1ec4bb17ffdcf Author: Todd Lipcon Date: Thu May 24 00:27:51 2012 +0000 HDFS-1013. Miscellaneous improvements to HTML markup for web UIs. Contributed by Eugene Koontz. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342102 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b889a0ebba466c587511512be95f2d19cc6e6ea7) commit d0fea2c0481afdbae92787793fa6a9c83c878314 Author: Tsz-wo Sze Date: Mon May 21 18:51:15 2012 +0000 HDFS-3394. Do not use generic in INodeFile.getLastBlock(): the run-time ClassCastException check is useless since generic type information is only available in compile-time. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341141 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 64f906db2603a53b93e4d5acd719ac8240574b1a) commit 740e31dd953e3123fce3eebfc392461df2e751a6 Author: Eli Collins Date: Tue May 15 17:23:50 2012 +0000 HDFS-3419. Cleanup LocatedBlock. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338802 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a78efd5860ef52b8fa8fa3cdeefa775985f16286) commit a95a681a20d1ec4565e611af57a3e6b42ab83e55 Author: Eli Collins Date: Tue May 15 16:23:52 2012 +0000 HDFS-3416. Cleanup DatanodeID and DatanodeRegistration constructors used by testing. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338784 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 68aab040955acd483794dbf1def0b12ac5ff59e8) commit d249a6b24ddaa87569b4b781f3102f2b1b13baca Author: Eli Collins Date: Tue May 15 16:01:44 2012 +0000 HDFS-3417. Rename BalancerDatanode#getName to getDisplayName to be consistent with Datanode. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338767 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 92d196b9bfeb8b7c4de54dc20af4f8bb267b55b3) commit 97599f6655e7c0d2c9a07dda4532cf98baa064d2 Author: Eli Collins Date: Fri May 11 00:03:37 2012 +0000 HDFS-3401. Cleanup DatanodeDescriptor creation in the tests. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336972 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3dcc91654d23c2f14d66b3c108c78d50c1ed8930) commit 4ffbe40c8b091ced9ea0d30548836d13175b6c9c Author: Eli Collins Date: Thu May 10 17:58:55 2012 +0000 HDFS-3230. Cleanup DatanodeID creation in the tests. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336815 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fbfd7730e9bfba738a9e03d0816a5f5139a23ae3) commit a572f8aa5c3557bd7b7830873f1b8d49ce0af4f8 Author: Tsz-wo Sze Date: Thu May 10 21:41:25 2012 +0000 HDFS-3369. Rename {get|set|add}INode(..) methods in BlockManager and BlocksMap to {get|set|add}BlockCollection(..). Contributed by John George git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336909 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fae0ef6d35a792734f11360d5d8bfa0728b6beb8) commit 5955a455bdc14779016d0d2b7cef8e80e1eb8778 Author: Suresh Srinivas Date: Tue Jan 31 18:59:58 2012 +0000 HDFS-2857. Cleanup BlockInfo class. Contributed by Suresh Srinivas. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1238747 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b3a590249bbf29b7383cfa1bfbe33d3f656185f3) commit ff64c9f0af775726f3f8b01c8820b3acf3f44d0a Author: Tsz-wo Sze Date: Tue Jun 26 01:58:13 2012 +0000 HDFS-3516. Check content-type in WebHdfsFileSystem. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1353800 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f9f5953c234af26a92f63b1d39c1f0c6409013fa) commit 32004e6dcb44935a5c61c1a9b3db73a78b26af58 Author: Alejandro Abdelnur Date: Tue Jun 12 21:52:46 2012 +0000 HDFS-3428. Move DelegationTokenRenewer to common (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349555 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 418b50cd2a1d7fd960b31c67e03fe39642fe18cc) commit 003bd9cbc6e4f7dc4573649e9b41429ed6980005 Author: Tsz-wo Sze Date: Sat Jun 9 00:54:10 2012 +0000 HDFS-3490. DatanodeWebHdfsMethods throws NullPointerException if NamenodeRpcAddressParam is not set. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348287 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9d9e32ef403ca5ea093fce24b6aac926ebca6c2b) commit aae13bfcd67ed730c781c876897f4351031b0b55 Author: Eli Collins Date: Fri Jun 29 20:57:20 2012 +0000 MAPREDUCE-4383. HadoopPipes.cc needs to include unistd.h. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355555 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 303fd1e5e9d0ef119945749c72a88b6161cca266) commit b2489c0f175480f51bd63fa948d5d7dfa200a4c9 Author: Alejandro Abdelnur Date: Wed May 23 22:22:55 2012 +0000 MAPREDUCE-4276. Allow setting yarn.nodemanager.delete.debug-delay-sec property to -1 for easier container debugging. (ahmed via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342075 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 71be391d52cfddac1d51ff735b2e03a76fddd6f6) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit 91774ff255d1816a868c0d5703cfe8007fd871ea Author: Robert Joseph Evans Date: Fri Jun 1 18:18:16 2012 +0000 HADOOP-8460. Document proper setting of HADOOP_PID_DIR and HADOOP_SECURE_DN_PID_DIR (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345304 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 53b88658e2e41c38457d18f4d574bca56b994e00) commit de46b874a27b4e44386b1d2d809039f29c07f7b2 Author: Robert Joseph Evans Date: Tue Jun 5 15:01:26 2012 +0000 MAPREDUCE-4313. TestTokenCache doesn't compile due TokenCache.getDelegationToken compilation error (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346406 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 88976ac84486ce239abf07cd61115ea04b460e1c) commit cac4f0ff518698dadcafaa2652cd657b7cd5de20 Author: Eli Collins Date: Mon Jul 16 21:49:35 2012 +0000 Amend HDFS-3666, applied earlier version of the patch. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362278 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b9a7f42e45791bb5f013fd2d3622ef2901b51655) commit 27e4c7f8930156ea6a66854da3544bf2d8a5518f Author: Eli Collins Date: Mon Jul 16 21:26:58 2012 +0000 HDFS-3666. Plumb more exception messages to terminate. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362270 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 15d4e6c8c0e113383ace43f93eeaa0c5dd04f87d) commit 0950af73a4f5f143dc57903c971020801682858f Author: Harsh J Date: Sat Jun 30 05:04:23 2012 +0000 HADOOP-8449. hadoop fs -text fails with compressed sequence files with the codec file extension. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355636 13f79535-47bb-0310-9956-ffa450edef68 commit f0840b0988d0e4d68f259f66db0f8a1acdaad265 Author: Alejandro Abdelnur Date: Mon Jul 16 17:28:49 2012 +0000 HADOOP-8552. Conflict: Same security.log.file for multiple users. (kkambatl via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1362151 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit afeaa0913ee5cb99fe418e068e9433ceeeafaa44) commit 21d47399ef90f6be90044ad3922a620c82615815 Author: Robert Joseph Evans Date: Thu May 31 15:16:48 2012 +0000 MAPREDUCE-4297. Usersmap file in gridmix should not fail on empty lines (Ravi Prakash via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344763 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fc09cbe9a6c6725c2a1a4dbab7e2f493d5c4d8ab) commit 23cef42fa414c398b48bb5fef14d528fe465fa01 Author: Eli Collins Date: Sun Jul 15 19:43:39 2012 +0000 HDFS-3663. MiniDFSCluster should capture the code path that led to the first ExitException. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1361775 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 56b363781b78c013f4d34f52ebe688978b15728c) commit 1b57d27373a657e33f34ff3aa3ef61a6834be16c Author: Alejandro Abdelnur Date: Thu Jul 5 16:29:09 2012 +0000 MAPREDUCE-4355. Add RunningJob.getJobStatus() (kkambatl via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1357723 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 6e0e0b018a6e91c3ff1543e2c9f91295ad7f4107) commit ff36544c1d72e750bd1db5bf8c7c6af24b120a29 Author: Tsz-wo Sze Date: Wed May 23 17:59:30 2012 +0000 HDFS-3436. In DataNode.transferReplicaForPipelineRecovery(..), it should use the stored generation stamp to check if the block is valid. Contributed by Vinay git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341961 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 67abd469010545ef410317c7c0622c8fd76ba233) commit 112931fe0bab59be508327a5a78062a55afdc6c9 Author: Robert Joseph Evans Date: Fri Jun 1 21:54:49 2012 +0000 MAPREDUCE-4302. NM goes down if error encountered during log aggregation (Daryn Sharp via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345362 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 973b4b90685ceac34aba9712992e3d8ca69cf741) commit c14dfaf0ad520156aa62d35d27228121b62db0c9 Author: Harsh J Date: Tue May 29 14:12:17 2012 +0000 HADOOP-8444. Fix the tests FSMainOperationsBaseTest.java and FileContextMainOperationsBaseTest.java to avoid potential test failure. Contributed by Madhukara Phatak. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343732 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b0fa24b64b667ebf12fde8889f965c3f5a8263bd) commit 2fbc0e939f377ec6e878b66a751818e739202771 Author: Eli Collins Date: Wed Jul 11 17:58:02 2012 +0000 HDFS-3582. Hook daemon process exit for testing. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1360329 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f625a610856229aee5abfa1140091a8af0847b9e) commit 2ff5be15f8b8402ed9fb465341474b4258bf2276 Author: Eli Collins Date: Sun Jul 8 19:41:55 2012 +0000 HDFS-3548. NamenodeFsck.copyBlock fails to create a Block Reader. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358822 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 390883c136cbdb217b69918b3973ee90f93ec13a) commit b08830817b7de1da9d49133116f0121842ff8849 Author: Alejandro Abdelnur Date: Mon Jul 9 19:19:00 2012 +0000 MAPREDUCE-3993. Graceful handling of codec errors during decompression (kkambatl via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359345 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5fd49fdede41f9c1d2c606069a2c2d6d5b7bc2dd) commit 15604ac4c6bb286f1d0a3ed9a442f9c152d60a1c Author: Eli Collins Date: Sun Jul 8 18:29:00 2012 +0000 HDFS-711. hdfsUtime does not handle atime = 0 or mtime = 0 correctly. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358810 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ebeb1e284c3eec37c4a9e54a8db16232f1ab7669) commit 775c7a74646f10ea17997ce03a9017a987fe65fc Author: Eli Collins Date: Mon Jun 4 20:48:47 2012 +0000 HADOOP-8481. update BUILDING.txt to talk about cmake rather than autotools. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346148 13f79535-47bb-0310-9956-ffa450edef68 commit 43940d2d9a957fa145bf96b15694521ee76105b6 Author: Todd Lipcon Date: Tue Jul 3 20:45:21 2012 +0000 HDFS-3343. Improve metrics for DN read latency. Contributed by Andrew Wang. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356928 13f79535-47bb-0310-9956-ffa450edef68 commit 4ec7277b8f1c30c67a4d923a92739ef77ad11aa9 Author: Todd Lipcon Date: Fri Jun 29 22:24:29 2012 +0000 HDFS-3446. HostsFileReader silently ignores bad includes/excludes. Contributed by Matthew Jacobs. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355584 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1510aad7ec7e858fbbd251442f1882e939bedcbf) commit 4ced3926aaea2cb0822cd8b8ca9cf585e00b2c1a Author: Alejandro Abdelnur Date: Mon Jul 9 17:40:31 2012 +0000 MAPREDUCE-2739. Update installation docs (remove YarnClientFactory) (bowang via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1359303 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit acf92b37d1adbf3b845dcf9bb4700e2b383a9f49) Conflicts: hadoop-mapreduce-project/CHANGES.txt commit f829866e009530778f34b12cc3d4b31a5ca10a73 Author: Alejandro Abdelnur Date: Fri Jul 6 22:27:13 2012 +0000 HADOOP-8566. AvroReflectSerializer.accept(Class) throws a NPE if the class has no package (primitive types and arrays). (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358454 13f79535-47bb-0310-9956-ffa450edef68 commit 280771accc585fb9a7cc926a30d6b2c97d751ae5 Author: Eli Collins Date: Sun Jul 8 18:15:30 2012 +0000 HDFS-3603. Decouple TestHDFSTrash from TestTrash. Contributed by Jason Lowe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1358804 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 69fe93266d68a02badc6878faf77b08fbf26d2d9) commit 8c0bc9e62e82674de80734cce8a83c020288fa5d Author: Harsh J Date: Fri May 25 07:04:35 2012 +0000 HDFS-2391. Newly set BalancerBandwidth value is not displayed anywhere. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342520 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3dde9ad1bb72db8b0659aaafc1a2fc28fe9fc118) commit ca3c3317fd20dd815f4b463aefe61a788a9569de Author: Thomas Graves Date: Mon May 21 19:15:41 2012 +0000 MAPREDUCE-3870. Invalid App Metrics (Bhallamudi Venkata Siva Kamesh via tgraves). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341160 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 66c3be3125c3390cbe096c2cbbba8da505e89e87) commit a051f312a0609ce18f3ed199ff10781464990545 Author: Todd Lipcon Date: Sun May 20 07:41:56 2012 +0000 MAPREDUCE-4002. MultiFileWordCount job fails if the input path is not from default file system. Contributed by Bhallamudi Venkata Siva Kamesh. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340630 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 829200091e87dc47b36b3311eab3a39091e8678e) commit ad4cf76b16dd31f0d50f5e21785a62035fd90330 Author: Harsh J Date: Mon May 28 15:36:00 2012 +0000 HADOOP-8358. Config-related WARN for dfs.web.ugi can be avoided. (harsh) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1343290 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0a8fdd5fafaccd45bf87b6ad1d502687374c97d0) Conflicts: hadoop-common-project/hadoop-common/CHANGES.txt commit 7cc0105413c543e1acdf29b81924e5dd35ce9bd5 Author: Eli Collins Date: Tue Jul 3 21:12:04 2012 +0000 HADOOP-8547. Package hadoop-pipes examples/bin directory (again). Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1356947 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e5d269e1644ddc3fc7d2cd1a684ddfdc78893f0b) commit be1d167b2c2cebd841d691a05bdd89f829223f05 Author: Eli Collins Date: Wed Jun 13 02:42:52 2012 +0000 HDFS-3531. EditLogFileOutputStream#preallocate should check for incomplete writes. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349616 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b33b9fdd3691cd25b0787c7046524a8ffcfc56cc) commit ba759b312153d6cbc248a6e012da22efc98c1e3b Author: Aaron Twining Myers Date: Thu Jun 28 20:04:49 2012 +0000 HDFS-3559. DFSTestUtil: use Builder class to construct DFSTestUtil instances. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355141 13f79535-47bb-0310-9956-ffa450edef68 (Cherry-picked-from commit a43a2f912602505ce37c76b235815bdf3035a6e9) commit 5bc67418ec183234beb3965d04fe437449c4b354 Author: Thomas Graves Date: Wed May 16 14:08:08 2012 +0000 MAPREDUCE-4102. job counters not available in Jobhistory webui for killed jobs (Bhallamudi Venkata Siva Kamesh via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339174 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 848902b7002e6311b1644d82e6533f157590c1ce) commit 380dfc82fbf6b28d30fa8b6372b9128d925f2705 Author: Thomas Graves Date: Mon May 21 01:55:44 2012 +0000 MAPREDUCE-4269. documentation: Gridmix has javadoc warnings in StressJobFactory (Jonathon Eagles via tgraves). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340880 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e8c8b92c76ebca950f9a88d4d2d6d1121fc791af) commit af8214f0756a56e9866b909dd6edfda115cc7eff Author: Amar Kamat Date: Thu Feb 23 10:41:07 2012 +0000 MAPREDUCE-3787. [Gridmix] Optimize job monitoring and STRESS mode for faster job submission. (amarrk) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1292736 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 30ad1c4a4443d12c0534e4d341f906f8e82549b7) commit ac87bbec26158a5d1a8e069cda224fa054653985 Author: Thomas Graves Date: Thu May 17 15:06:33 2012 +0000 MAPREDUCE-3543. Mavenize Gridmix. (tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339629 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit ab69ce95ea10fa70a01eb68c0401404f4a10ede6) commit f7c43e7c2d6e052d2ae5c9e541bf573bfbf04b9b Author: Thomas White Date: Fri May 11 15:00:48 2012 +0000 MAPREDUCE-4148. MapReduce should not have a compile-time dependency on HDFS. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337199 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e6119e8a733db1aac8b1a34555c476ea33d7452a) commit 0ee4a7bf2c649df4f3ce153982cb0248bc9b63db Author: Suresh Srinivas Date: Wed May 9 23:18:15 2012 +0000 HADOOP-8372. NetUtils.normalizeHostName() incorrectly handles hostname starting with a numeric character. Contributed by Junping Du. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336446 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 97b0458f4f7df24dc9cb4e9b029cdcfc37dd623c) commit 4727391880a237526874285e36286532701e0a04 Author: Robert Joseph Evans Date: Wed May 9 17:06:27 2012 +0000 HADOOP-8373. Port RPC.getServerAddress to 0.23 (Daryn Sharp via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336299 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 539b3d914174fcbc2ee75d617ad94b6b7dac47ca) commit 73f183b4dc524f2fff58ffb9efd8f68bab2c9d6c Author: Eli Collins Date: Tue May 15 17:25:49 2012 +0000 HADOOP-8398. Cleanup BlockLocation. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338806 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 402deb267249e379a6b4d4e137a7bd3cec5796ed) commit 5792baeb05091c60affe92f8704643e090483fbd Author: Eli Collins Date: Thu May 10 23:48:12 2012 +0000 HADOOP-8388. Remove unused BlockLocation serialization. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336966 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 084258e96b18e53f42e1f5b960291e2a5e748ec7) commit 08f2b4246b36b78790314b86e739bf6cc2ef02e3 Author: Thomas Graves Date: Fri May 18 02:50:48 2012 +0000 MAPREDUCE-4197. Include the hsqldb jar in the hadoop-mapreduce tar file (Ravi Prakash via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339957 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3214d79f03348ddfbbc94e71366ec02900f9ba1a) commit 682ab33e92b95285b42525ab049a029cd50cceed Author: Alejandro Abdelnur Date: Thu Jun 28 17:42:44 2012 +0000 HADOOP-8168. empty-string owners or groups causes {{MissingFormatWidthException}} in o.a.h.fs.shell.Ls.ProcessPath() (ekoontz via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1355085 13f79535-47bb-0310-9956-ffa450edef68 commit ebca44e0764e061a396717a8607c78cd7d8e896c Author: Eli Collins Date: Thu Jun 28 17:57:05 2012 +0000 HDFS-3475. Make the replication monitor multipliers configurable. Contributed by Harsh J Chouraria git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1355090 13f79535-47bb-0310-9956-ffa450edef68 commit c717b6bb40c31c474c23e2be62dbc720d4f81945 Author: Tsz-wo Sze Date: Thu Jun 14 20:17:54 2012 +0000 HDFS-3524. Update TestFileLengthOnClusterRestart for HDFS-3522. Contributed by Brandon Li git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350384 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b2a8cf3759646524426ca9f9c11974f14986a0a0) commit b1f41063f905495c6d1e36302b628821a46177f1 Author: Robert Joseph Evans Date: Tue Jun 19 19:40:44 2012 +0000 MAPREDUCE-4267. mavenize pipes (tgraves via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351818 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 92c1005d35c3618ce3894e471df1f1751c7d7c34) commit 60376734daa682efe0da94c11cb750634fdb9535 Author: Eli Collins Date: Tue Jun 26 18:18:19 2012 +0000 HDFS-3535. Audit logging should log denied accesses. Contributed by Andy Isaacson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1354147 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4ff76ce8e67d96d73fa735c6fcc31f759e506e73) commit 472583545b5b61c8ab0e08016568e2356cd2cb53 Author: Tsz-wo Sze Date: Tue Jun 12 01:59:24 2012 +0000 svn merge -c 1349088 from trunk for HDFS-3522. If a namenode is in safemode, it should throw SafeModeException when getBlockLocations has zero locations. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1349090 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7611c500190d887e4b6912507efe8a161d9984a) commit 109772d285a6e42360c59b3fe13f14125bf89dab Author: Todd Lipcon Date: Thu Jun 7 21:06:13 2012 +0000 Revert HDFS-3492 from r1347192: patch broke TestShortCircuitLocalRead git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347796 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0b658968a062a1f43e2ab01a11678dc8e9928ec6) commit 99c3bb94d2cff0b6841659379b6a7438efb83e5d Author: Thomas Graves Date: Tue Jun 19 16:17:21 2012 +0000 MAPREDUCE-4341. add types to capacity scheduler properties documentation (Karthik Kambatla via tgraves). git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351762 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit cfa26ceff3fabceb8a9c1b199e098af07d9886b6) commit 32a0974f58f62a3233de899ff7317635a2811d9c Author: Thomas Graves Date: Tue Jun 19 13:06:51 2012 +0000 MAPREDUCE-4311. Capacity scheduler.xml does not accept decimal values for capacity and maximum-capacity settings (Karthik Kambatla via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351700 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f2d9df5580af822c488a3206ef4623d5095c929c) commit 65cdab111d073d4ba85cfdae5ba5aada020975b3 Author: Alejandro Abdelnur Date: Sat Jun 2 02:34:38 2012 +0000 HADOOP-8368. Use CMake rather than autotools to build native code (cmccabe via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345421 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5b0fc81b3898d4a6cfe9aba1be27ca80a0fef3bb) commit 8de2c2bf462ec7527db2b005039c74007ca40998 Author: Eli Collins Date: Wed Jun 13 03:31:47 2012 +0000 HDFS-3372. offlineEditsViewer should be able to read a binary edits file with recovery mode. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349628 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a73b8b244251c0e8f757fe2ab12b34e9cee9b602) commit dff05676403ed444fa1a5add55cb76694a7c4f6e Author: Eli Collins Date: Tue Jun 12 22:10:12 2012 +0000 HADOOP-8507. Avoid OOM while deserializing DelegationTokenIdentifer. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349561 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 15f7bc3dd634d82ee845f57a29d1ecb91fe044b8) commit 39819f4657b2905ad1627c299f2e7ab3b24dabfa Author: Eli Collins Date: Mon Jun 11 21:20:28 2012 +0000 HADOOP-8491. Check for short writes when using FileChannel#write and related methods. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349019 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a92b49c6143b7d5b23e21ce117a9413435662754) commit 9f743f077c72de80a84dc112f5cab250dabad640 Author: Eli Collins Date: Mon Jun 11 18:01:38 2012 +0000 HDFS-2797. Fix misuses of InputStream#skip in the edit log code. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348945 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5d80662ebba51f8d6d7fb9c563043a1e17dfe5c6) commit 71ddec4da4328d753b61f647153e509f0f8b40b5 Author: Eli Collins Date: Fri Jun 8 00:44:39 2012 +0000 HADOOP-8488. test-patch.sh gives +1 even if the native build fails. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347846 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a98e01a5b4a62e3d55cc23e1587b8445b305a6f7) commit dde305cf29bd1ebe8c03cb1a4967ad50d4bc5287 Author: Todd Lipcon Date: Wed Jun 6 22:48:48 2012 +0000 HDFS-3492. Fix some misuses of InputStream#skip. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347192 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3983fdd6fc01e32f8e2b65de1fe1441a1877986c) commit da63793aac611465dfefb411ac0b9090ab55be87 Author: Alejandro Abdelnur Date: Mon Jun 18 16:28:52 2012 +0000 HADOOP-8512. AuthenticatedURL should reset the Token when the server returns other than OK on authentication (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1351408 13f79535-47bb-0310-9956-ffa450edef68 commit e89aef3f8e02397e5e090d0f474b74dcd1881b74 Author: Alejandro Abdelnur Date: Wed Jun 13 20:47:51 2012 +0000 HADOOP-8509. JarFinder duplicate entry: META-INF/MANIFEST.MF exception (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1350008 13f79535-47bb-0310-9956-ffa450edef68 commit efce70e5626a5d45fd418d4922aa6599b84c6bf1 Author: Thomas Graves Date: Fri Jun 8 15:47:50 2012 +0000 MAPREDUCE-3842. Stop webpages from automatic refreshing (tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348123 13f79535-47bb-0310-9956-ffa450edef68 commit 0e40f36469a86650069be765122bc3364a8ec8b3 Author: Eli Collins Date: Mon Jun 11 20:52:45 2012 +0000 HDFS-3517. TestStartup should bind ephemeral ports. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1349004 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit fa4052fd302e5328735f37988e9fe25476ac951b) commit f489e28c0c534548b06a296c5b753fccbe86fa97 Author: Aaron Twining Myers Date: Fri Jun 8 19:50:24 2012 +0000 HDFS-3514. Add missing TestParallelLocalRead. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1348207 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 01f20f17e07369eb227b65e7df7854ffe7056619) commit 90b0130deec154dfd415c8d6d422c6e6140f8bf1 Author: Todd Lipcon Date: Tue Apr 10 22:31:18 2012 +0000 HDFS-3243. TestParallelRead timing out on jenkins. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1312029 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 152ca47a787c969c4ffb3c96ebca0be4da76bbc8) commit e14fa537e62e63ddf4a90ab5486c76719181797a Author: Todd Lipcon Date: Fri Apr 6 06:31:10 2012 +0000 HDFS-3110. Use directRead API to reduce the number of buffer copies in libhdfs. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1310185 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 467acd14b821cc28529f854c062ad3472a0e17dd) commit cb472c12f45b9d7160ebbfe66a79b19bd4e96aba Author: Aaron Twining Myers Date: Wed Apr 4 23:36:29 2012 +0000 HADOOP-8244. Improve comments on ByteBufferReadable.read. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1309625 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4418682a55665634db17ad11a84f9f9c73d043f4) commit 3da2ca93fccacbd6c2cc054e537891cd38c2bff8 Author: Todd Lipcon Date: Wed Mar 21 17:30:37 2012 +0000 HDFS-2834. Add a ByteBuffer-based read API to DFSInputStream. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1303474 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c66f9824ce7e306859a6157bb0f54435caba83a7) commit 6403e57f11d442bab0b2fd637aebf961878ee979 Author: Aaron Twining Myers Date: Sat Mar 3 02:02:23 2012 +0000 HADOOP-8135. Add ByteBufferReadable interface to FSDataInputStream. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296556 13f79535-47bb-0310-9956-ffa450edef68 (cherry-picked from commit 6e51b33573ad8324a0a01c0c680544cd6387280e) commit 596f899b87bea0317f0143215ac4426903a9e29f Author: Aaron Twining Myers Date: Thu Mar 15 20:26:29 2012 +0000 HDFS-3067. NPE in DFSInputStream.readBuffer if read is repeated on corrupted block. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1301182 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f36bac8b7873d4e45fda6dfebedff04456d667b2) commit 8466b01541bb1b40a790c51f33dab0b600f80083 Author: Aaron Twining Myers Date: Tue Apr 10 02:25:40 2012 +0000 HDFS-3235. MiniDFSClusterManager doesn't correctly support -format option. Contributed by Henry Robinson. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1311556 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 21dfa6aa0a56d0e6991bb99d3e55b6393155c66e) commit cfd77c2eb59caa86a811a4950b3c67946c69975f Author: Eli Collins Date: Wed Jun 6 20:56:26 2012 +0000 HDFS-3505. DirectoryScanner does not join all threads in shutdown. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347117 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7073ff222e58448536e1df716a783bde95ea52fd) commit 8a26e770b0b43151523a15439e91e39abd63ea7a Author: Eli Collins Date: Wed Jun 6 21:14:15 2012 +0000 HADOOP-8485. Don't hardcode "Apache Hadoop 0.23" in the docs. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1347133 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3d543848c2d545d925c4cf39be0930606281706a) commit 897cf13223a7656626450490a0551e768644c514 Author: Eli Collins Date: Sun Jun 3 22:14:16 2012 +0000 HADOOP-8450. Remove src/test/system. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345794 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 81d4db0fae62a631ed9295c8ad8c56534137e27e) commit 2dad664979fb8324f16e7f7673bd2d9ec6df8e70 Author: Karthik Kambatla Date: Mon Jun 4 17:49:21 2012 -0700 MAPREDUCE-4301. Dedupe some strings in MRAM for memory savings (bobby via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346002 13f79535-47bb-0310-9956-ffa450edef68 commit 6601d13d70bb0d9dc08f9ec4d39a47c990df1a67 Author: Karthik Kambatla Date: Mon Jun 4 16:28:36 2012 -0700 MAPREDUCE-4262. NM gives wrong log message saying Connected to ResourceManager before trying to connect. (Devaraj K via tgraves) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341972 13f79535-47bb-0310-9956-ffa450edef68 commit bf835e8560c32a7700ed8df6ee93b557be20dc37 Author: Eli Collins Date: Mon Jun 4 19:37:56 2012 +0000 HDFS-3501. Checkpointing with security enabled will stop working after ticket lifetime expires. Contributed by Aaron T. Myers git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1346106 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d79ebd2f2d0144fa908fd23df43fafdda2d31095) commit b3099a5b6b68207ab16f6ee0e2e0f9b574072f67 Author: Ahmed Radwan Date: Mon Jun 4 02:15:50 2012 -0700 MAPREDUCE-4307. TeraInputFormat calls FileSystem.getDefaultBlockSize() without a Path - Failure when using ViewFileSystem. Contributed by Ahmed Radwan git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345546 13f79535-47bb-0310-9956-ffa450edef68 commit 411121ed0464d29b9ea9dd71159f63c2310e52f7 Author: Alejandro Abdelnur Date: Fri Jun 1 21:41:51 2012 +0000 HADOOP-8466. hadoop-client POM incorrectly excludes avro. (bmahe via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1345358 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9736ef79a21aaf293b2695a09c0d38260ae0c333) commit 1abf654814ac7cd2e8f7ec585595458b58e8bb20 Author: Jenkins slave Date: Thu May 31 12:12:55 2012 -0700 Preparing for 4.1.0 development commit efa1606f3ee3486af7b4745b635129b6ca736927 Author: Eli Collins Date: Fri Jun 1 02:37:09 2012 +0000 HDFS-3487. offlineimageviewer should give byte offset information when it encounters an exception. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344972 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 1cec5c9ebc9fa4234ad80504ccb8d3ee8d7950db) commit 244f994b0a998de885416eecdb56a7dfdddb980f Author: Eli Collins Date: Fri Jun 1 02:31:29 2012 +0000 HDFS-3486. offlineimageviewer can't read fsimage files that contain persistent delegation tokens. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344970 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c3aeaf327ef1752f9ff04854e04591006ee22937) commit b0e321a31606318c958b8035d3c51452c25abf31 Author: Eli Collins Date: Thu May 31 21:02:08 2012 +0000 HDFS-3484. hdfs fsck doesn't work if NN HTTP address is set to 0.0.0.0 even if NN RPC address is configured. Contributed by Aaron T. Myers git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344908 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a5d1ecbf87c2b8cc5881914ff92f57af7dd363f1) commit 0505373bb214faeafc66788d8207e00d10ac481f Author: Robert Joseph Evans Date: Thu May 31 14:10:16 2012 +0000 HADOOP-8452. DN logs backtrace when running under jsvc and /jmx is loaded (Andy Isaacson via bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1344733 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d1d80231592ae89133b48e343b25f7ea70ae25ec) commit f80dc3b854248546d3e6bee459202038f88622c4 Author: Alejandro Abdelnur Date: Wed May 16 18:19:36 2012 +0000 HADOOP-8400. All commands warn 'Kerberos krb5 configuration not found' when security is not enabled. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339298 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f38c833d37d1c1105d14a61d62d92d860a89c90f) commit db2745f79fb91768798b570ace26cefdaad17bfb Author: Eli Collins Date: Fri May 25 04:10:15 2012 +0000 HADOOP-8422. Deprecate FileSystem#getDefault* and getServerDefault methods that don't take a Path argument. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342495 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f8511836c7dba7ad89ea14d6dbdad6648980bccb) commit c5a49cdee577e92cab6d546ca775f54fb7c41a6f Author: Alejandro Abdelnur Date: Thu May 24 16:51:04 2012 +0000 HDFS-3460. HttpFS proxyuser validation with Kerberos ON uses full principal name. (tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342334 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e616aa9d2835466ac15018f19bc0a8597a919167) commit ee421b90019cff6b006918fd4a32c7e6f1768923 Author: Aaron Twining Myers Date: Wed May 16 16:24:38 2012 +0000 HDFS-3413. TestFailureToReadEdits timing out. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339250 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7dbac0502d0528d902cf75d368802b9c909828e) commit 21484a6d4a0064f7611eda27739382030fa02bfa Author: Todd Lipcon Date: Wed May 23 20:42:48 2012 +0000 HDFS-2982. Startup performance suffers when there are many edit log segments. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1342042 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 5e11f5247bb38530675657c1af44d57ffcec75a1) commit afa475115795242e901dd986206be0bc7e94dc72 Author: Todd Lipcon Date: Fri May 18 05:28:18 2012 +0000 HDFS-3440. More effectively limit stream memory consumption when reading corrupt edit logs. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339978 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit abcf6c2544f0b8a63b963cd7f00e541f8b7fc037) commit 0d9b3b15ba26115d427c7824e3a6564624d7154b Author: Eli Collins Date: Wed May 23 15:56:59 2012 +0000 HDFS-3454. Balancer unconditionally logs InterruptedException at INFO level on shutdown if security is enabled. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341916 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 4507294356199c591992c1c54ba793651ed4aae7) commit 26ece2309e4962116c88499e1757c2eee411dd67 Author: Todd Lipcon Date: Thu May 10 00:30:53 2012 +0000 HDFS-3341, HADOOP-8340. SNAPSHOT build versions should compare as less than their eventual release. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336459 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 66329d64a68527f195043c83199194a9614e7791) commit e91367d4791f6d0ec9dbb4e73ad724e35892cd05 Author: Aaron Twining Myers Date: Tue May 22 07:50:00 2012 +0000 Amend HADOOP-8408 per Daryn's post-commit feedback. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1341338 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0bfd8de94883acbde299a15351703b0d86a2ebf6) commit d8e6f39392664fcc2d3a4daefb14e6069b65746c Author: Todd Lipcon Date: Mon May 21 09:55:12 2012 -0700 HDFS-3438. BootstrapStandby should not require a rollEdits on active node. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340343 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit be031272816764176bbbd5fbc3befdf3767b657f) (cherry picked from commit cc4790f7915d774798c3fc783aaa5feebee8009e) commit db3fdbaa7a5aa8592553ae2f0b46863e64b8a4ef Author: Eli Collins Date: Sun May 20 21:13:17 2012 +0000 HDFS-2885. Remove "federation" from the nameservice config options. Contributed by Tsz Wo (Nicholas), SZE git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340841 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7f57d56de2fb97534461ec5aa7a7149a38837c50) commit 6f04866910d83595f0f6d582b1f498429a9aa5f6 Author: Eli Collins Date: Fri May 18 21:43:02 2012 +0000 HADOOP-8329. Build fails with Java 7. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340268 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e4c89c70f068bac5f0697f900214eafd52dc7cec) commit c65d8637210da178924d949bd9d8945c3cebf3fc Author: Aaron Twining Myers Date: Fri May 18 21:25:21 2012 +0000 HDFS-3444. hdfs groups command doesn't work with security enabled. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1340260 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f9ecb31f168a2fbd4a4b0574116eea3a4ef04865) commit b155bd8e15026d22eea280599fa980616ffb30f8 Author: Andrew Bayer Date: Thu May 17 13:02:15 2012 -0700 CDH-5864. Fixing Zookeeper version in HDFS. (cherry picked from commit 92f7ab3ffd74470319b381edc4e53419ebae217d) commit 78438a3884848ee4a28d22842b3f0493d99d0d54 Author: Eli Collins Date: Fri May 18 04:20:28 2012 +0000 HADOOP-8408. MR doesn't work with a non-default ViewFS mount table and security enabled. Contributed by Aaron T. Myers git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339970 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 63226de5e51c2e7ebbef7b0b39b50070d5bf5de7) commit 5055b37e1ffe2e00497ae22ebb7fe044702ee448 Author: Eli Collins Date: Thu May 17 22:47:41 2012 +0000 HADOOP-8287. etc/hadoop is missing hadoop-env.sh. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339906 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 54be655791a1e0bfc0640aa8f16cb5fb03cf742f) commit 097d2ed2580bd3d08bdbb3e4379d3380a8c0f22e Author: Todd Lipcon Date: Thu May 17 11:42:46 2012 -0700 HDFS-2800. Fix cancellation of checkpoints in the standby node to be more reliable. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339744 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 11d04c8aae2be7046c46ac58b9d643a28b30b325) commit de08398340055cbed84e536e29c5bf19420dd1c0 Author: Todd Lipcon Date: Thu May 17 11:59:01 2012 -0700 HADOOP-8406. CompressionCodecFactory.CODEC_PROVIDERS iteration is thread-unsafe. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339475 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b2a272f0527bce08527f6800152d8cf4884f95ca) commit e3bd9c3796842a475345fcff98db7cdbff86cef2 Author: Eli Collins Date: Thu May 17 17:01:13 2012 +0000 HDFS-3434. InvalidProtocolBufferException when visiting DN browseDirectory.jsp. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339712 13f79535-47bb-0310-9956-ffa450edef68 commit a37c49a308f25ae576e8a8fc6bc85a0d8d1dde0c Author: Aaron T. Myers Date: Thu May 17 03:37:21 2012 -0700 HDFS-3433. GetImageServlet should allow administrative requestors when security is enabled. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1339543 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f448a430ccc5695d1a60a3d0fd1cbfeeffe0d2f4) commit abbb44f60e8d31d7e6323c677cb7334da96ad060 Author: Todd Lipcon Date: Wed May 16 19:54:47 2012 -0700 HADOOP-8405. ZKFC tests leak ZK instances. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339435 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3f8885c559a3c3435ed362ec3346dc4e050ab308) commit f6c18ec2389d5c0c46a6c1e889649d60b0ff38b4 Author: Todd Lipcon Date: Wed May 16 19:54:26 2012 -0700 HDFS-3432. TestDFSZKFailoverController tries to fail over too early. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1339434 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d95a9cbfa6b5ecf2e5552e73ad605dde2c4b9859) commit 44404d5b802d4b214cc56b6507856ab984f8c386 Author: Todd Lipcon Date: Wed May 16 19:49:06 2012 -0700 HDFS-3422. TestStandbyIsHot timeouts too aggressive. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339452 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0f74e697aa85d66acc6938bd6c11d8de25fc44d2) commit 9f7f57773eddd3223fb926aaa435a89abb8f3e92 Author: Eli Collins Date: Wed May 16 22:57:18 2012 +0000 HDFS-860. fuse-dfs truncate behavior causes issues with scp. Contributed by Brian Bockelman git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339413 13f79535-47bb-0310-9956-ffa450edef68 commit f0a4936da6163c246a4a40f407fcf3fc6e04986c Author: Eli Collins Date: Thu May 10 23:13:02 2012 +0000 HDFS-3134. harden edit log loader against malformed or malicious input. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336943 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 32ddd1b6485412870485114c13d4f5c55db4548a) commit a48259b0da425c38aa6811be696b72b832b1a058 Author: Eli Collins Date: Thu May 10 23:15:53 2012 +0000 HADOOP-8361. Avoid out-of-memory problems when deserializing strings. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336945 13f79535-47bb-0310-9956-ffa450edef68 (cherry-picked from 4c2e45fd7a505bee2b8696a396fbe906937f8918) commit 3069e2192ed04768e6c829f4e6038e817ad1583e Author: Todd Lipcon Date: Tue May 15 21:53:01 2012 -0700 HDFS-3335. check for edit log corruption at the end of the log. Contributed by Colin Patrick McCabe. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338492 13f79535-47bb-0310-9956-ffa450edef68 (cherry-picked from bc4755e5d2d2fe0531bd7b4a5ba593c076c20fc5) commit 10ef937723a02e4e898878068c0351764a26dc68 Author: Alejandro Abdelnur Date: Wed May 16 04:15:02 2012 +0000 MAPREDUCE-4250. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1339000 13f79535-47bb-0310-9956-ffa450edef68 commit b676ab2ce47a873bf3d1109be73bdcba4ce307bd Author: Alejandro Abdelnur Date: Wed May 16 04:12:46 2012 +0000 HADOOP-8393. hadoop-config.sh missing variable exports, causes Yarn jobs to fail with ClassNotFoundException MRAppMaster. (phunt via tucu) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1338998 13f79535-47bb-0310-9956-ffa450edef68 commit f171ab1f5579b1f95a92152f00bf9834af4d1a49 Author: Robert Joseph Evans Date: Wed May 9 21:08:53 2012 +0000 MAPREDUCE-4237. TestNodeStatusUpdater can fail if localhost has a domain associated with it (bobby) git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336399 13f79535-47bb-0310-9956-ffa450edef68 commit 09755fa82db27c6bb63a88a06b78e69ff1bfbfc4 Author: Tom White Date: Tue May 15 15:52:42 2012 -0600 CLOUDERA-BUILD. Update to use Jetty 6.1.26.cloudera.1. commit 8c68fd7abbf8929185eb761754b0052eb2993b8d Author: Aaron T. Myers Date: Tue May 15 14:48:07 2012 -0700 HDFS-2759. Pre-allocate HDFS edit log files after writing version number. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338489 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b902f6c554b8468d808a60382408aa0ea7d70a2c) commit 0694157bd690925eaef5dfe8ed04e2f12dcf3e65 Author: Todd Lipcon Date: Mon May 14 20:57:59 2012 -0700 svn merge -c 1337430 from branch-2 for HADOOP-8366 Use ProtoBuf for RpcResponseHeader git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.0.0-alpha@1338348 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f2e8cfdfa0a592a4d6de70efd25fef5d9c253053) commit 53f636e530f92aca757887cb375ead411d365492 Author: Todd Lipcon Date: Mon May 14 20:57:38 2012 -0700 Merge r1337428 and r1337433 from branch-2 for HADOOP-8285 Use ProtoBuf for RpcPayLoadHeader git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.0.0-alpha@1338344 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a1ec19ac40e9474260783e7646619892b5feabbe) commit e08dedf8eec9f13b11904946f2c8906fcfcdcbfc Author: Todd Lipcon Date: Mon May 14 20:56:12 2012 -0700 Revert HDFS-3157 Error in deleting block is keep on coming from DN even after the block report and directory scanning has happened. This patch broke some tests and had potential for data loss. It is also reverted upstream. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2.0.0-alpha@1338309 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e7d5ce23ddc27b489f34ca7493e999787a22b575) commit e9ade756cd3ae27888a49c2b556f41d13b8e43d8 Author: Todd Lipcon Date: Mon May 14 19:38:12 2012 -0700 HDFS-3031. Fix complete() and getAdditionalBlock() RPCs to be idempotent. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338467 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 7964c411def1d96cd6c777323b6e1943796c1576) commit 7895dd0ca9863470e41ae2d57f7c76d324cbc1cc Author: Aaron Twining Myers Date: Thu May 10 13:53:30 2012 +0000 HDFS-3395. NN doesn't start with HA+security enabled and HTTP address set to 0.0.0.0. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336693 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 651c860a3a6a652860e0b1211c5ad937691c960a) commit 953a806dd8561ee09c7f2f1c2497bf60c2cb93d3 Author: Aaron T. Myers Date: Mon May 14 10:44:43 2012 -0700 HDFS-3414. Balancer does not find NameNode if rpc-address or servicerpc-address are not set in client configs. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1338277 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit dc14846c837ac8c49cd42afd6255cd965dd440e6) commit 704b7472d2265984d9ab7a5ade602a724e95f031 Author: Aaron T. Myers Date: Sat May 12 23:06:16 2012 -0400 HDFS-3404. Make putImage in GetImageServlet infer remote address to fetch from request. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337756 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit df22c19124db4bc7c963936cbc300e59a5eea01e) commit e894fcfe513b31210c584b424e0ffc654351c471 Author: Eli Collins Date: Fri May 11 19:25:07 2012 +0000 HADOOP-8224. Don't hardcode hdfs.audit.logger in the scripts. Contributed by Tomohiko Kinebuchi git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337339 13f79535-47bb-0310-9956-ffa450edef68 commit c11151420802f082c8f9ea7efe01b789eb4d5e95 Author: Eli Collins Date: Fri May 11 19:21:57 2012 +0000 HADOOP-8316. Audit logging should be disabled by default. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337334 13f79535-47bb-0310-9956-ffa450edef68 commit e69918a9840fed32a798aacafe6373599de898c4 Author: Aaron Twining Myers Date: Fri May 11 16:16:55 2012 +0000 HADOOP-8353. hadoop-daemon.sh and yarn-daemon.sh can be misleading on stop. Contributed by Roman Shaposhnik. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337252 13f79535-47bb-0310-9956-ffa450edef68 commit e3c5bc25611c6a41c6b7a08710b4d13c8e1a3911 Author: Eli Collins Date: Fri May 11 16:45:59 2012 +0000 HADOOP-8276. Auto-HA: add config for java options to pass to zkfc daemon. Contributed by Todd Lipcon git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1337276 13f79535-47bb-0310-9956-ffa450edef68 commit f9f7cae05125e6a75683c5faea31a9a34bb55fca Author: Aaron T. Myers Date: Fri May 11 02:09:09 2012 -0400 HDFS-3026. HA: Handle failure during HA state transition. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1337031 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit a447ccb61cc78dafe6a6a23ca251fc9943ca10e0) commit dd67aa451fde31181d6681bbb88abc963caa428c Author: Eli Collins Date: Thu May 10 20:18:06 2012 -0700 HDFS-3400. DNs should be able start with jsvc even if security is disabled. Contributed by Aaron T. Myers git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1337017 13f79535-47bb-0310-9956-ffa450edef68 commit 4e255917830c55400c6a634e67cbf4537e98a4fc Author: Eli Collins Date: Thu May 10 06:28:56 2012 +0000 HDFS-3396. FUSE build fails on Ubuntu 12.04. Contributed by Colin Patrick McCabe git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336495 13f79535-47bb-0310-9956-ffa450edef68 commit 4455b9c4e747e206a44383acd3e78d03990415b1 Author: Eli Collins Date: Thu May 10 06:16:01 2012 +0000 HADOOP-7868. Hadoop native fails to compile when default linker option is -Wl,--as-needed. Contributed by Trevor Robinson git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336491 13f79535-47bb-0310-9956-ffa450edef68 commit 31643d0eccc2186611fcfb6574f54a83973ac0ff Author: Eli Collins Date: Thu May 10 04:52:46 2012 +0000 HDFS-3328. NPE in DataNode.getIpcPort. Contributed by Eli Collins git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1336480 13f79535-47bb-0310-9956-ffa450edef68 commit 58ac4b200fddb12c86db10e92130361b7ac9aebb Author: Aaron T. Myers Date: Wed May 9 14:37:25 2012 -0400 HDFS-3390. DFSAdmin should print full stack traces of errors when DEBUG logging is enabled. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/branch-2@1336327 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit b8e655f02c3a0385791b477af026d43096ae407d) commit a21099cc89281538980a542fad14ee7b279d06c5 Author: Todd Lipcon Date: Wed May 2 19:41:57 2012 -0700 HADOOP-8279. Allow manual failover to be invoked when auto-failover is enabled. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1333288 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 93bdab468ba7677112a3d977077c982de8c1c844) commit 51e13be7d9860510f75dbf6001b4f42cd53237c3 Author: Todd Lipcon Date: Wed May 2 19:41:18 2012 -0700 HADOOP-8306. ZKFC: improve error message when ZK is not running. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1329960 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 66f98228e048dc20bbfe0891697c5fe70598ddd6) commit aa83687e2ec82365aaf2dd859cb43b48bccab4c4 Author: Todd Lipcon Date: Mon May 7 15:41:43 2012 -0700 Revert "svn merge -c 1328018 from trunk. FIXES: HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash via bobby)" This reverts commit f0351b62a72aa361df887531d606999308415e70. Reason: these are still used by the MR1 implementation in CDH4 Ref: CDH-5630 commit 9e41e78629c4e073f4cb2f702f48f75806774fa9 Author: Todd Lipcon Date: Thu Apr 12 14:57:06 2012 -0700 HDFS-3159. Document NN auto-failover setup and configuration. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325539 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3b33ca50ea3cffd7451193a83adaa4e66753a082) commit e87892aa26ae50f391ab656785e526a13c80f0db Author: Todd Lipcon Date: Thu Apr 12 00:07:15 2012 -0700 HDFS-3261. TestHASafeMode fails on HDFS-3042 branch. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1325140 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit e829424c50d483d6a00d4d0f1d157615feb48268) commit aad5c9ca90825e91af1924e06b27ffb0d6e63f87 Author: Aaron Twining Myers Date: Fri Mar 2 01:26:54 2012 +0000 HDFS-3037. TestMulitipleNNDataBlockScanner#testBlockScannerAfterRestart is racy. Contributed by Aaron T. Myers. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1296016 13f79535-47bb-0310-9956-ffa450edef68 commit 025d0277de6e961ce7769b10a6ec3052af0f1e34 Author: Todd Lipcon Date: Wed Apr 11 05:52:31 2012 +0000 Resolve trivial compilation error after previous merge git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324570 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit f77b1069c598e3fa6fa7b194b2a7a02311774395) commit 2bf923b7825c5b56664190f6ff14261da4e22867 Author: Todd Lipcon Date: Tue Apr 10 23:00:26 2012 -0700 HADOOP-8247. Add a config to enable auto-HA, which disables manual FailoverController. Contributed by Todd Lipcon. Modified from upstream: - addressed merge conflicts as done in upstream merge r1327724 to linearize history git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1324566 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 9d4778a571f5ddfcb0526465d8b1c61f22a94abc) commit e3b8f0fa3be4bce0670210be9065a8e9700dbc69 Author: Todd Lipcon Date: Sat Apr 7 17:16:05 2012 -0700 HADOOP-8246. Auto-HA: automatically scope znode by nameservice ID. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310919 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 986e287106f1e3b2a40276db85da8b06421b57bf) commit 0172753001d196ee8149336307b1525cb9b53b7f Author: Todd Lipcon Date: Sat Apr 7 17:15:37 2012 -0700 HDFS-3223. add zkfc to hadoop-daemon.sh script. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310620 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit c5dfc47903c37c8e9c909d83fd7152749e96149c) commit 2fc2abf2f6eedf20eddd737defd55fb7e8897ac1 Author: Todd Lipcon Date: Sat Apr 7 17:14:59 2012 -0700 HADOOP-8260. Replace ClientBaseWithFixes with our own modified copy of the class. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310888 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 3e83726b3f1542873b8dca6f526995d7eb3e574b) commit e4df9d4fe9b7eece47e43947282e4c090c1d969f Author: Todd Lipcon Date: Fri Apr 6 15:25:55 2012 -0700 HADOOP-8257. TestZKFailoverControllerStress occasionally fails with Mockito error. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310616 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit d979e6e0edcaa98840e11bceae4b759076e7ee08) commit ad7d0d593a4e2d15d48bf89345a6c139e4ca7961 Author: Todd Lipcon Date: Thu Apr 5 22:10:13 2012 -0700 HDFS-3200. Scope all ZKFC configurations by nameservice. Contributed by Todd Lipcon. Modified from upstream: - addressed merge conflicts same as upstream merge r1310174 in order to linearize the history git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1310165 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 08e16cda5c415eccadfbb6c8e5f513712e341068) commit 9b01236ee8b594d5e5c8fed4295840f013816fd4 Author: Todd Lipcon Date: Wed Apr 4 12:49:10 2012 -0700 HADOOP-8245. Fix flakiness in TestZKFailoverController. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309554 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 49f0df9ec41839ab7efe6c6df05ffab889c3379c) commit ab61e106bc254d8fb507bd91e8bcb7892e99f731 Author: Todd Lipcon Date: Tue Apr 3 16:54:47 2012 -0700 HADOOP-8215. Security support for ZK Failover controller. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1309185 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0882e1bc4d49e4705cb1fd99558f0a7c2f0ab9f1) commit 7d8d3aec41742d664c49fccb21049a9ae3fb845a Author: Todd Lipcon Date: Tue Apr 3 00:59:02 2012 +0000 HDFS-2185. HDFS portion of ZK-based FailoverController. Contributed by Todd Lipcon. Modified from upstream: - Resolved NNHAServiceTarget as was done upstream in merge at r1309576 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1308637 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 35ec7fb7229ae175a9dd9fc29e5dcaf16b87d636) commit 97dd9428c9d262950be148eed55cfe4450132f69 Author: Todd Lipcon Date: Tue Apr 3 16:52:26 2012 -0700 HADOOP-8228. Auto HA: Refactor tests and add stress tests. Contributed by Todd Lipcon. Modified from upstream: - In CDH, HADOOP-8077 was committed first, so needed to modify DummyHAService to reflect the new API for NodeFencer.create. Upstream this was resolved in a later merge commit r1310174 git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307599 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 62ddccfcf1cabd1cdc305deedb84574201398c9b) commit ba777a94c91ce817f6f9b19404b06ce8fc1f8800 Author: Todd Lipcon Date: Fri Mar 30 20:23:59 2012 +0000 HADOOP-8220. ZKFailoverController doesn't handle failure to become active correctly. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307596 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 06eb2c5522ce6cecc94fa687acd715edc3a5ed40) commit 808e3369da7532fc9675facd0a1ff92ef3bf5e07 Author: Todd Lipcon Date: Thu Mar 29 21:49:37 2012 +0000 Amend HADOOP-8212 (Improve ActiveStandbyElector's behavior when session expires) Amendment patch incorporates following feedback from Bikas Saha: - adds a new functional test for session expiration while in the standby state - adds a safety check in the StatCallback for session expiration - improves some comments git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/branches/HDFS-3042@1307128 13f79535-47bb-0310-9956-ffa450edef68 (cherry picked from commit 0400fb66b26d92664e26a3175c64d2759db1e576) commit a649d0272f9dbd603def5f12fe1e841087cc61cf Author: Eli Collins Date: Tue Apr 3 15:05:59 2012 -0700 HDFS-2976 corrected the previous wrong commit for this issue. git-svn-id: https://svn.apache.org/repos/asf/hadoop/common/trunk@1298507 13f79535-47bb-0310-9956-ffa450edef68 commit 00dfb076f85ed604ca298f968f854a8d2771208b Author: Andrew Bayer Date: Mon Apr 2 16:08:40 2012 -0700 CDH-5014. Fixing bad behavior when cloudera/build.properties doesn't exist. commit 97de8c326c5560acace092a5003e0d206cd6a2d3 Author: Andrew Bayer Date: Mon Apr 2 10:16:26 2012 -0700 CDH-5014. Use cloudera/build.properties to get git hash for saveVersion.sh call. commit 12f9000ab157c8d52bf34516156af82522d767e6 Author: Alejandro Abdelnur Date: Fri Apr 27 16:48:37 2012 -0700 CLOUDERA-BUILD. Removing explict exclusion of TestStreaming, using flaky exclusion setup now commit 09bb5da7ebaf04861172deacac90bcd389aafaed Author: Roman Shaposhnik Date: Thu Mar 29 19:24:01 2012 -0700 CLOUDERA-BUILD. add pipes (and other c++ libs) to the cdh4 build (CDH-5075) commit f746767fc11adac11240104403e289c4d93a60a4 Author: Andrew Bayer Date: Fri Mar 16 09:47:07 2012 -0700 CLOUDERA-BUILD. Ensure ZooKeeper SNAPSHOT dependency appears in dist as -SNAPSHOT.jar, not unique timestamp. commit 364d5dc6a37b77fdab4c74e15c78a6ada173f4b0 Author: Andrew Bayer Date: Thu Mar 15 11:26:48 2012 -0700 CLOUDERA-BUILD. Skip deploy of hadoop-dist by default. commit 5e98bf2ed3ce851ac553de10566384a8f1315406 Author: Andrew Bayer Date: Tue Mar 13 08:45:41 2012 -0700 CDH-4642. Ensure CDH4 Hadoop uses same Avro version as other components. commit 82713f59b907042eee057281d836f0bff9b89d80 Author: Patrick Hunt Date: Wed Apr 11 17:02:33 2012 -0700 CLOUDERA-BUILD. Removed clover as a runtime dependency. commit 66b0b0b05cc49bf0a15aa85204775d83aa99078a Author: Andrew Bayer Date: Mon Mar 12 15:31:21 2012 -0700 CLODUERA-BUILD. Make modules/*.jar in tarball have proper versions. This fixes the jar names in the modules directory of the dist when they're SNAPSHOTs, by forcing the use of project.version in their name, rather than module.version - module.version ends up with the unique snapshot identifier, which causes a lot of problems. commit 543afcc51b71977ab7bde22734fc424d894bac2f Author: Andrew Bayer Date: Mon Mar 12 11:54:08 2012 -0700 CLOUDERA-BUILD. Removing distributionManagement from hadoop-yarn POM, as that breaks deploys of CDH. commit 471017c7a217c8b3b200ef4322be986727be7526 Author: Eli Collins Date: Sun Mar 11 15:14:52 2012 -0700 CLOUDERA-BUILD. Add the ability to deploy binary and src tarballs. commit d062213b79068400df732f89ca9de5662bc347f4 Author: Eli Collins Date: Sun Mar 11 12:16:53 2012 -0700 CLOUDERA-BUILD. Updating for 4.0.0 development.