commit f0eddea626eacec5632438e729344b93d1d1d3fd Author: Aaron Kimball Date: Thu Aug 13 16:20:41 2009 -0700 Updated Sqoop documentation for MAPREDUCE-816, MAPREDUCE-789 commit d52f1630acb6b2c56528448ccb464a3ca88f47ef Author: Aaron Kimball Date: Thu Aug 13 15:44:36 2009 -0700 MAPREDUCE-789: Oracle support for Sqoop commit 562940a86cfaee351e8cb23da5c3a855e1ff2f75 Author: Aaron Kimball Date: Thu Aug 13 15:40:16 2009 -0700 MAPREDUCE-840: DBInputFormat leaves open transaction commit 0d5be1ec60ac19feea4948407b802d31d8a3bffe Author: Aaron Kimball Date: Thu Aug 13 15:38:21 2009 -0700 MAPREDUCE-816: Rename "local" mysql import to "direct" commit f140c84fff35987291de813e049576f1081bf3f9 Author: Aaron Kimball Date: Thu Aug 13 15:37:25 2009 -0700 MAPREDUCE-716: org.apache.hadoop.mapred.lib.db.DBInputformat not working with oracle Applied MAPREDUCE-716.4.branch20.patch commit 5b026fda8924f52cdafe67fe7dcc54ba59265828 Author: Todd Lipcon Date: Wed Aug 12 17:59:45 2009 -0700 MAPREDUCE-18: Under load the shuffle sometimes gets incorrect data Applied MR-18-0.20.patch - adds validation to the shuffle data after fetching map output commit 345cd2a1cd569344c275b2421a8cfe0da300f632 Author: Philip Zeyliger Date: Mon Jun 15 18:37:24 2009 -0700 Example hadoop-metrics.properties works with /metrics (HADOOP-5469). commit 6b6192bf177bcb7cadb0ce502b884d5a20f093e4 Author: Philip Zeyliger Date: Mon Jun 15 18:03:03 2009 -0700 HADOOP-5469. Add /metrics servlet to daemons, providing metrics over HTTP as either text or JSON. Contributed by Philip Zeyliger. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@762987 13f79535-47bb-0310-9956-ffa450edef68 commit af4e22ce84cdc1e1cef888cd2114f864763c667c Author: Todd Lipcon Date: Mon Aug 3 12:26:26 2009 -0700 Added Sqoop documentation to installation script commit 3713a4a11eda74aa330d11817897c0c9e3ea4b1b Author: Matt Massie Date: Fri Jul 31 19:09:46 2009 -0700 Fix the hadoop/sqoop wrapper scripts commit bde7ed77aacbd5a13880f975053398fc18718833 Author: Matt Massie Date: Fri Jul 31 18:45:00 2009 -0700 Fix a bug in the hadoop/sqoop wrapper generation commit e482d789f411b7e76eab89542039762c26436cb2 Author: Matt Massie Date: Fri Jul 31 17:44:43 2009 -0700 Update the install hadoop script commit e05a3de05e5b57221a3e401be9be473bf88ba35d Author: Matt Massie Date: Fri Jul 31 17:39:50 2009 -0700 Rename the hadoop man page to be hadoop-0.20 commit 4e020ce276b317279062b431ca0e13f077ff2e9a Author: Todd Lipcon Date: Thu Jul 30 13:38:25 2009 -0700 Fix error in HADOOP-5882 backport commit f913c504fdaf6aeac4e73667376df8348c50ff5f Author: Todd Lipcon Date: Wed Jul 29 15:47:53 2009 -0700 HADOOP-5349. Fixes a problem in LocalDirAllocator to check for the return path value that is returned for the case where the file we want to write is of an unknown size. Contributed by Vinod Kumar Vavilapalli. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@772876 13f79535-47bb-0310-9956-ffa450edef68 commit 42c1d1fc1809f526b8cabf626797b0d4f99fef04 Author: Todd Lipcon Date: Wed Jul 29 15:37:33 2009 -0700 HADOOP-5921. Fixes a problem in the JobTracker where it sometimes never used to come up due to a system file creation on JobTracker's system-dir failing.This problem would sometimes show up only when the FS for the system-dir (usually HDFS) is started at nearly the same time as the JobTracker. Contributed by Amar Kamat. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@784661 13f79535-47bb-0310-9956-ffa450edef68 commit 93890913d4d6e8f38d30d64c76884c5b4acc44e0 Author: Todd Lipcon Date: Wed Jul 29 15:34:18 2009 -0700 HADOOP-5882. Fixes a reducer progress update problem for new mapreduce api. Contributed by Amareshwari Sriramadasu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@781275 13f79535-47bb-0310-9956-ffa450edef68 commit d71705150443c8f2dcf748a199cf5ce5ea9e3aaf Author: Todd Lipcon Date: Wed Jul 29 15:33:05 2009 -0700 HADOOP-5210. Solves a problem in the progress report of the reduce task. Contributed by Ravi Gummadi. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@758180 13f79535-47bb-0310-9956-ffa450edef68 commit 933de29f1735972287f9508afbf701c545150c3e Author: Todd Lipcon Date: Mon Jul 20 23:09:13 2009 -0700 Backport MAPREDUCE-551 (Fair Scheduler Preemption) Differences from original patch: - Incorporates HADOOP-4788 (changes the assignmultiple default to true) - Backports use of some constructors that changed due to capacity scheduler in trunk commit 2aeee05037509bf9659d4a57d473f6b3557b95f0 Author: Todd Lipcon Date: Mon Jul 20 18:10:24 2009 -0700 HADOOP-5745. Allow setting the default value of maxRunningJobs for all pools. Contributed by Dhruba Borthakur. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@771570 13f79535-47bb-0310-9956-ffa450edef68 commit c237c3623c6a0003c163ad6142a3fd8757766562 Author: Aaron Kimball Date: Sat Jul 25 16:52:32 2009 -0700 Update Sqoop documentation with user guide and manpage. commit 2385c2e99abb444c7ec986d378203c9613533c35 Author: Aaron Kimball Date: Thu Jul 23 16:45:29 2009 -0700 Added MySQL Connector/J library for Sqoop. commit 15616206357d7892c0d67acaf85b7860b99e4c6a Author: Aaron Kimball Date: Thu Jul 23 16:25:04 2009 -0700 MAPREDUCE-705: User-configurable quote and delimiter characters for Sqoop records and record reparsing commit f64ec2b4ed3d511c60e84baef3c987db708eb315 Author: Aaron Kimball Date: Thu Jul 23 16:24:06 2009 -0700 MAPREDUCE-710: Sqoop should read and transmit passwords in a more secure manner commit 222771463265b1d1ece438d7a9d9d899a37e9739 Author: Aaron Kimball Date: Thu Jul 23 16:23:01 2009 -0700 MAPREDUCE-713: Sqoop has some superfluous imports commit b7296a9a07ba1d0d6cf351fbb4ce6b8666b4c7b9 Author: Aaron Kimball Date: Thu Jul 23 16:21:51 2009 -0700 MAPREDUCE-685: Sqoop will fail with OutOfMemory on large tables using mysql commit 8484fb041dc6a84eff0e634da6d910e0b03fca37 Author: Aaron Kimball Date: Thu Jul 23 16:20:39 2009 -0700 MAPREDUCE-674: Sqoop should allow a "where" clause to avoid having to export entire tables commit 170ef828fcdc7eb31abcd0d76766dc29c07f84a0 Author: Aaron Kimball Date: Thu Jul 23 16:18:51 2009 -0700 MAPREDUCE-675: Sqoop should allow user-defined class and package names commit bfd69bdc0cfe2102ff752a3572607e8803613e58 Author: Aaron Kimball Date: Thu Jul 23 16:16:30 2009 -0700 MAPREDUCE-703: Sqoop requires dependency on hsqldb in ivy commit 7298ba0d83fae675c33e1a52635b76b642b6e2c2 Author: Aaron Kimball Date: Thu Jul 23 16:12:20 2009 -0700 MAPREDUCE-692: Make Hudson run Sqoop unit tests commit 64d216f018d7acb9edbba102b18a07efbc673ba3 Author: Aaron Kimball Date: Thu Jul 23 16:10:59 2009 -0700 HADOOP-5968: Sqoop should only print a warning about mysql import speed once commit ce8e1a9957412a3e9c02ff1c2f77b868962dbe7a Author: Aaron Kimball Date: Thu Jul 23 16:10:21 2009 -0700 HADOOP-5967: Sqoop should only use a single map task commit 68a8b6ffd75c7aef094d6418376d3f9fabbcc571 Author: Aaron Kimball Date: Thu Jul 23 16:09:30 2009 -0700 HADOOP-5887: Sqoop should create tables in Hive metastore after importing to HDFS commit 74db64e3ed10ac48f16c5f56de6afbc98ca74ac9 Author: Todd Lipcon Date: Tue Jul 21 16:18:18 2009 -0700 Address issue where docs were not properly copied through to release tarball This was caused by some cleanup in build.xml early on in the CDH 0.20 branch commit e6287e9b1434799fb491394e16b2f9f89f8cf6e0 Author: Todd Lipcon Date: Tue Jul 21 15:42:23 2009 -0700 Decrease build time by only rebuilding the native code for each platform commit 2721407f06c04dc61be21ed665f1bd9358fff13b Author: Todd Lipcon Date: Tue Jul 21 14:36:22 2009 -0700 Run jdiff against vanilla Hadoop during Cloudera release build commit 9b952a6bf367c6bbcf1e478d4bf41885a0b48234 Author: Aaron Kimball Date: Tue Jul 21 17:43:45 2009 -0700 MAPREDUCE-415: JobControl.Job always has an unassigned name commit 29e24139146655051a7b464a1d74d4899b98b12d Author: Thomas White Date: Thu May 28 16:43:30 2009 +0000 HADOOP-5805. problem using top level s3 buckets as input/output directories. Contributed by Ian Nowland. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@779656 13f79535-47bb-0310-9956-ffa450edef68 commit e0ad5a4b81ae84fa481c300a9c62bf00e02d3817 Author: Thomas White Date: Fri May 1 13:43:10 2009 +0000 HADOOP-5656. Counter for S3N Read Bytes does not work. Contributed by Ian Nowland. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@770681 13f79535-47bb-0310-9956-ffa450edef68 commit 07e75dc3d4ac04d1a4adba3321bbb3af13e3e179 Author: Todd Lipcon Date: Thu Jul 16 16:21:59 2009 -0700 HADOOP-5613. Change S3Exception to checked exception. Contributed by Andrew Hitchcock. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@770685 13f79535-47bb-0310-9956-ffa450edef68 commit b4cf354fbd53d5afcb4e94e56e8d119d21ac4ae1 Author: Konstantin Shvachko Date: Thu Apr 2 20:08:21 2009 +0000 HADOOP-5528. Add a configurable hash partitioner operating on ranges of BinaryComparable keys. Contributed by Klaas Bosteels. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@761407 13f79535-47bb-0310-9956-ffa450edef68 commit d09b026b7663f68459b4bae94094fe5ac253a72c Author: Todd Lipcon Date: Thu Jul 16 16:20:28 2009 -0700 HADOOP-5450. Add application-specific data types to streaming's typed bytes interface. (Klaas Bosteels via omalley) commit 6c3a37552525160ea80bf00545b9c3b5ad1ece1c Author: Douglass Cutting Date: Mon Feb 23 22:30:34 2009 +0000 HADOOP-5240. Skip re-building javadoc when it is already up-to-date. Contributed by Aaron Kimball. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@747169 13f79535-47bb-0310-9956-ffa450edef68 commit f2e5d7dba4a9da9fc456efc7e4d2831073c4d577 Author: Thomas White Date: Wed May 27 11:00:11 2009 +0000 HADOOP-5175. Don't unpack libjars on classpath. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@779106 13f79535-47bb-0310-9956-ffa450edef68 commit c19831ec375a20416e38ec8a9f42d607171fa360 Author: Todd Lipcon Date: Thu Jul 16 16:15:53 2009 -0700 HADOOP-5170. Allows jobs to set max maps/reduces per-node and per-cluster. Contributed by Matei Zaharia. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@781683 13f79535-47bb-0310-9956-ffa450edef68 Conflicts: CHANGES.txt src/mapred/mapred-default.xml src/mapred/org/apache/hadoop/mapred/JobConf.java commit 9253eea2e3995fc50e58a3a3367bc7dae96d13bf Author: Todd Lipcon Date: Thu Jul 16 15:15:18 2009 -0700 Fix scribe-log4j's ivy.xml to properly get log4j on the compile classpath commit cfb56a7380eeff07d0f2173cbc17aba4aece51f3 Author: Thomas White Date: Thu May 21 15:22:47 2009 +0000 HADOOP-4829. Allow FileSystem shutdown hook to be disabled. Contributed by Todd Lipcon. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@777152 13f79535-47bb-0310-9956-ffa450edef68 commit 1741d338b6002fb531c66f82232927087514193e Author: Devaraj Das Date: Thu Feb 5 05:35:09 2009 +0000 HADOOP-3327. Improves handling of READ_TIMEOUT during map output copying. Contributed by Amareshwari Sriramadasu. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@741009 13f79535-47bb-0310-9956-ffa450edef68 commit 50cd25601b2a547bf1ed6b685b159a53d02915ad Author: Devaraj Das Date: Fri Feb 13 04:12:11 2009 +0000 HADOOP-1722. Adds support for TypedBytes and RawBytes in Streaming. Contributed by Klaas Bosteels. git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk@743975 13f79535-47bb-0310-9956-ffa450edef68 commit f0ff2f21277ce1bbebd6db6f44b99fd7d249a297 Author: Aaron Kimball Date: Wed Jul 15 10:40:47 2009 -0700 MAPREDUCE-680. Reuse of Writable objects is improperly handled by MRUnit. commit ffafe0cfc70d485692ea935a0c3778542f919fed Author: Aaron Kimball Date: Wed Jul 15 10:40:15 2009 -0700 HADOOP-5518. MRUnit test library. commit 8f74fd8ae4597ff5849080216d09583b8c6de40e Author: Todd Lipcon Date: Tue Jun 2 20:55:17 2009 -0700 Add sqoop wrapper to bin/ commit 0506aa0c0c35ddb8a069032b3f7b1e6746ef89c5 Author: Todd Lipcon Date: Tue Jun 2 20:06:18 2009 -0700 HADOOP-5844: Use mysqldump when connecting to local mysql instance in Sqoop Patch: mysqldump.patch 2009-5-14 commit c28aab9c692a1c3d8c9ed3ff6cbad1eeefd83bf9 Author: Todd Lipcon Date: Tue Jun 2 20:05:10 2009 -0700 HADOOP-5815: Sqoop: A database import tool for Hadoop Patch added: HADOOP-5815.2.patch 2009-05-13 version commit 61f1e092efd4c5eecc677a0e1984ced80e3e4363 Author: Todd Lipcon Date: Mon Jul 6 19:36:11 2009 -0700 MAPREDUCE-714: Fix JobConf.findContainingJars to work with jars with + in the name commit 26217a99e03244181949f497f12a0f2b06c6b5bc Author: Todd Lipcon Date: Mon May 11 14:35:00 2009 -0700 Add libs commit 8c96bb10aac189e1afe287b2a5c424eafbf42ae3 Author: Todd Lipcon Date: Mon May 11 14:32:38 2009 -0700 scribe_hadoop_trunk.patch Also, add empty ivy infrastructure for scribe-log4j commit 9cfd4402757112273d6c8482c3f421925cc0f658 Author: Todd Lipcon Date: Wed Jul 15 15:30:14 2009 -0700 Use cloudera's versioning info from cloudera.hash in saveVersion.sh This should make the "hadoop version" output far more useful for determing exactly what code is running. The cloudera.hash property is set by cloudera/build.properties which is generated during the build process. commit 4dfd646e8dbddfdb56c072e6e052993bf7f8e8e9 Author: Todd Lipcon Date: Tue Jun 30 11:12:55 2009 -0700 Move saveVersion.sh in build.xml to ensure build This error is due to ant 1.7.1 not compiling package-info.java if the timestamp of the output class directory is newer than the package-info file itself. Since other compiles were happening after package-info.java was generated, the build dir was newer and compilation was being skipped. Fixes CLOUDERA-436 (hadoop version printing rUNKNOWN) Move cloudera hooks inside the package task of build.xml Fixes an issue where the fair scheduler jar was not built before the hooks were run, and therefore was not included in the target lib/ directory. commit a529e9f5d1cb6d69751725654d25d7eceee4aed0 Author: Todd Lipcon Date: Wed Jul 15 14:23:13 2009 -0700 New versions of cloudera scripts commit 0758a356c9397b9697b87019a92fae89a37177a5 Author: Todd Lipcon Date: Fri Jun 5 17:21:14 2009 -0700 Change paths to point to hadoop-0.20 where necessary commit d1213910a9884ec88d6eb73077e80fd28ec88c4b Author: Todd Lipcon Date: Fri Jun 5 16:47:56 2009 -0700 Add manpage to 20 repo commit 565d4fff7f31c88c2b6f0dc29ccac74dfd89b3e0 Author: Todd Lipcon Date: Fri Jun 5 16:46:46 2009 -0700 Move install_hadoop.sh into hadoop repo commit 5e00c233042040e920807136c678351dbf2596a4 Author: Todd Lipcon Date: Wed Jun 3 12:11:53 2009 -0700 Add example-confs directory for storing configuration of conf.pseudo commit 3994891fa1f79195227d8400f4bde1bad3abbc76 Author: Todd Lipcon Date: Tue Jun 2 21:12:45 2009 -0700 Replace hadoop-config.sh with Cloudera version commit 76b02cbddf1766d5fe47af2dcd1f17177bef7db5 Author: Todd Lipcon Date: Tue Jun 2 19:34:56 2009 -0700 Remove redundant code in build.xml between package and bin-package commit 566760cf6ac5303796822927869097af785247b0 Author: Todd Lipcon Date: Mon May 11 14:32:42 2009 -0700 HADOOP-5611-Add-some-missing-includes-to-c-code-t.patch commit 6fce2d42325d5d1d68a38b295b5c9020c2bbaf57 Author: Todd Lipcon Date: Tue Jun 2 17:57:09 2009 -0700 Hook build.xml to enable contrib modules commit 35d09899f1e0297f6452b1e7d48f1271e1a5b515 Author: Todd Lipcon Date: Tue Jun 2 14:50:56 2009 -0700 HADOOP-5612: Add chmod rules to build.xml