4.8.2 Lakehouse Limitations for the Avro Format Files

• Avro file headers must be less than 1MB.

• The data in an Avro block must be no larger than 64MiB before applying any compression.

• Lakehouse only supports uncompressed Avro blocks, or Avro blocks compressed with Snappy or Deflate algorithms. Lakehouse does not support other compression algorithms.

• Lakehouse does not support these data types in Avro files: Array, Map, and nested records. Lakehouse marks columns with these data types as NOT SECONDARY, and does not load them.

• Lakehouse only supports an Avro union between one supported data type and NULL.

• The Avro DECIMAL data type is limited to the scale and precision supported by MySQL.

• Avro data with FIXED values or values in BYTES are only supported with the Avro DECIMAL data type.