CDH 5.13.1 Release Notes

Changes Not In Avro 1.7.6

Avro

Bug

• [AVRO-1985] - Unreleased resources
• [AVRO-1921] - Slow build time because of unreachable codehaus website
• [AVRO-1943] - Flaky test: TestNettyServerWithCompression.testConnectionsCount
• [AVRO-1877] - AVRO-1847 accidentally breaks javaUnbox method in SpecificCompiler
• [AVRO-1869] - Decimal conversion from ByteBuffer ignores buffer position and limit
• [AVRO-1642] - JVM Spec Violation 255 Parameter Limit Exceeded
• [AVRO-1799] - java: GenericData.toString() mutates underlying ByteBuffer backed data
• [AVRO-1584] - Json output doesn't generate base64 for byte arrays
• [AVRO-1781] - Schema.parse is not thread safe
• [AVRO-1713] - Typo - Extra character in pom
• [AVRO-1576] - TestSchemaCompatibility is platform dependant
• [AVRO-1655] - RecordSchema#fieldsToJson can throw NullPointerException
• [AVRO-1652] - Java - Schema.Field prints out System.err [WARNING] even though validateDefaults is set to false.
• [AVRO-1630] - Creating Builder from instance loses data
• [AVRO-1623] - GenericData#validate() of enum: IndexOutOfBoundsException
• [AVRO-1592] - Java keyword as an enum constant in Avro schema file causes deserialization to fail.
• [AVRO-1622] - Add missing license headers
• [AVRO-1604] - ReflectData.AllowNull fails to generate schemas when @Nullable is present.
• [AVRO-1407] - NettyTransceiver can cause a infinite loop when slow to connect
• [AVRO-1596] - Cannot read past corrupted block in Avro data file
• [AVRO-1602] - FAILURE! - in org.apache.avro.ipc.trace.TestFileSpanStorage
• [AVRO-1598] - TestFileSpanStorage tests are flaky
• [AVRO-1489] - Avro fails to build with OpenJDK 8
• [AVRO-1590] - [java] AllowNull causes unexpected resolution failure
• [AVRO-1544] - Union of enum and null can result in NPE on validate if null is not first
• [AVRO-1553] - MapReduce never uses MapOutputValueSchema
• [AVRO-1546] - Make GenericData.Record.toString consistent
• [AVRO-1448] - Python3 setup.py is broken
• [AVRO-1368] - String schema accepts any Java object, and converts it with toString()
• [AVRO-1498] - Custom Encoding with @AvroEncode does not work when FieldAccessReflect is used
• [AVRO-1499] - Ruby 2+ Writes Invalid avro files using the avro gem
• [AVRO-1352] - Schema for fixed types corrupted when writing out in JSON format
• [AVRO-1474] - C++ resolvind decoder doesn't work when reader schema has more fields than writer schema
• [AVRO-1525] - Java: ReflectData cannot resolve union with fixed
• [AVRO-1470] - Perl API boolean type misencoded
• [AVRO-1462] - Non-ASCII decimal characters cause warning from Perl API serializer
• [AVRO-1500] - Unknown datum type exception during union type resolution (no short to int conversion).
• [AVRO-1522] - SortedKeyValueFile Writer should support compression codecs
• [AVRO-1442] - Case "FIXED" not handled in ResolvingGrammarGenerator
• [AVRO-1512] - Error serializing TUnion with avro-thrift
• [AVRO-1457] - ReadOnly ByteBuffer serialization state changes after writing
• [AVRO-1459] - 'gem install avro' does not work for version 1.7.6
• [AVRO-1465] - Lack of information on error in GenericData#getSchemaName
• [AVRO-1473] - Nested schema reference with empty namespace cannot be parsed
• [AVRO-1454] - AvroAsTextInput format creates invalid JSON for NaN values
• [AVRO-1455] - Deep copy does not need to create new instances for primitives
• [AVRO-1458] - Setting char record field via reflection affects other fields
• [AVRO-1447] - File Object Is Unused In Example
• [AVRO-1441] - Avro Class Files Output Directory
• [AVRO-1436] - SpecificTests fails on repeated runs
• [AVRO-1445] - avro from protobuf write fails on enum with default
• [AVRO-1446] - System errors not supported in RPC

Improvement

• [AVRO-1973] - Upgrade netty to the latest 3.x release
• [AVRO-1895] - DeepCopy does not work with logical types
• [AVRO-1672] - Add logical types and conversions for date, time, and timestamp.
• [AVRO-1681] - Improve generated JavaDocs
• [AVRO-1683] - Add microsecond-precision time and timestamp logical type specs
• [AVRO-1685] - Allow specifying sync in DataFileWriter.create
• [AVRO-1628] - Add Schema.createUnion(Schema... type)
• [AVRO-1539] - Add FileSystem-based FsInput Constructor
• [AVRO-1619] - Generate better JavaDoc
• [AVRO-1551] - SpecificCompilerTool should have outputEncoding option
• [AVRO-1583] - Add stdin support to tojson
• [AVRO-843] - Provide support for .NET 3.5
• [AVRO-1536] - Remove monkeypatching of Enumerable
• [AVRO-1535] - permit aliases to null namespace
• [AVRO-1513] - Remove test plans from unit test files
• [AVRO-1482] - in specification, put "null" first in unions
• [AVRO-1471] - avro-maven-plugin schema generation should use project.build.sourceEncoding for generated files
• [AVRO-1472] - Usage of Parser is Wrong in Getting Started Guide
• [AVRO-1449] - Check default value's type matches union at schema parse time

New Feature

• [AVRO-1847] - IDL compiler should use BigDecimal to represent decimal logical type.
• [AVRO-1684] - Add date, time, and timestamp to specific object model classes
• [AVRO-1497] - Add LogicalType support to Java
• [AVRO-1614] - Always getting a value...
• [AVRO-834] - Data File corruption recovery tool
• [AVRO-739] - Add Date/Time data types
• [AVRO-1373] - Add A XZ Codec
• [AVRO-1315] - Java: Schema Validation utilities
• [AVRO-1533] - permit promotions between string and bytes
• [AVRO-1402] - Support for DECIMAL type
• [AVRO-1439] - MultipleInputs equivalent for Avro MR
• [AVRO-974] - Add Perl implementation to Avro

Task

• [AVRO-1692] - Allow more than one logical type for a Java class
• [AVRO-1585] - Deprecate Jackson classes in public API
• [AVRO-1476] - Make position field of org.apache.avro.Schema not transient.