CDH 3 Release Notes

Changes Not In Sqoop 1.3.0

Sqoop

Bug

• [SQOOP-503] - --columns argument support for export
• [SQOOP-489] - Cannot define partition keys for Hive tables created through Sqoop
• [SQOOP-468] - Oracle free form queries fail.
• [SQOOP-473] - Sqoop import-all-tables fails with MySQL connector
• [SQOOP-448] - boolean fields get nullified during postgres direct import into hive.
• [SQOOP-352] - Export of avro data imported from database table (using sqoop import) fails on year
• [SQOOP-425] - Sqoop invokes ResultSet.isLast() which causes Sybase JDBC driver to hang
• [SQOOP-428] - AvroOutputFormat doesn't support compression even though documentation claims it does
• [SQOOP-341] - Sqoop doesn't handle unsigned ints at least with MySQL
• [SQOOP-358] - Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile
• [SQOOP-364] - Default getCurTimestampQuery() in SqlManager is not working for PostgreSQL
• [SQOOP-359] - Import fails with Unknown SQL datatype exception
• [SQOOP-346] - Sqoop needs to be using java version 1.6 for its source
• [SQOOP-349] - A bunch of the fields are wrong in pom.xml
• [SQOOP-339] - Use of non-portable mknod utility causes build problems on Mac OS X
• [SQOOP-329] - SQOOP doesn't work with the DB2 JCC driver
• [SQOOP-340] - Rise exception when both --direct and --as--sequencefile or --as-avrodatafile are given
• [SQOOP-325] - Sqoop doesn't build on intellij
• [SQOOP-336] - Avro import does not support varbinary types
• [SQOOP-332] - Cannot use --as-avrodatafile with --query
• [SQOOP-323] - Support for the NVARCHAR datatype
• [SQOOP-330] - Free form query import with column transformation failed without obvious error message
• [SQOOP-319] - The --hive-drop-import-delims option should accept a replacement string
• [SQOOP-314] - Basic export hangs when target database does not support INSERT syntax with multiple rows of values
• [SQOOP-317] - OracleManager should allow working with tables owned by other users.
• [SQOOP-308] - Generated Avro Schema cannot handle nullable fields

Improvement

• [SQOOP-483] - Allow target dir to be set to a different name than table name for hive import
• [SQOOP-443] - Calling sqoop with hive import is not working multiple times due to kept output directory
• [SQOOP-459] - Remove redundant steps in compatibility tests: verifyReadback() method
• [SQOOP-470] - Create tests for blob support for Avro import
• [SQOOP-465] - BLOB support for Avro import
• [SQOOP-353] - Cleanup the if/else statement in HiveTypes
• [SQOOP-366] - Sqoop User Guide's troubleshooting section should include MySQL setup instructions
• [SQOOP-361] - [Docs] $CONDITIONS must be escaped to not allow shells to replace it.
• [SQOOP-357] - To make debugging easier, Sqoop should print out all the exceptions
• [SQOOP-355] - improve SQOOP documentation of Avro data file support
• [SQOOP-351] - Sqoop User Guide's troubleshooting section should include Case-Sensitive Catalog Query Errors
• [SQOOP-315] - Update Avro version to 1.5.2
• [SQOOP-326] - Updgrade Avro dependency to version 1.5.3
• [SQOOP-321] - Support date/time columns for "--incremental append" option
• [SQOOP-318] - Add support for splittable lzo files with Hive
• [SQOOP-320] - Use Information Schema for SQLServerManager
• [SQOOP-316] - Sqoop user guide should have a troubleshooting section.
• [SQOOP-303] - Use Catalog Tables for PostgresqlManager

New Feature

• [SQOOP-362] - Allow user to override mapping when doing import to AVRO format
• [SQOOP-342] - Allow user to override sqoop type mapping
• [SQOOP-313] - Multiple column names to be included in --update-key argument with SQOOP export (update)
• [SQOOP-331] - Support boundary query on the command line
• [SQOOP-327] - Mixed update/insert export support for OracleManager
• [SQOOP-305] - Support export from Avro Data Files

Task

• [SQOOP-310] - Review license headers
• [SQOOP-309] - Update Sqoop dependency versions