5.1 Overview

5.1.1 External Tables

5.1.2 Lakehouse Engine

5.1.3 Data Storage

The Lakehouse feature of HeatWave enables query processing on data resident in Object Storage. The source data is read from Object Storage, transformed to the memory optimized HeatWave format, stored in the HeatWave persistence storage layer in Object Storage, and then loaded to HeatWave cluster memory.

• Provides in-memory query processing on data resident in Object Storage.

• Data is not loaded into the MySQL InnoDB storage layer.

• Supports structured and semi-structured relational data in the following file formats:

  • Avro.

  • CSV.

  • JSON.

    As of MySQL 8.4.0, Lakehouse supports Newline Delimited JSON.

  • Parquet.

    See: Section 5.7.1, “Parquet Data Type Conversions”.

With this feature, users can now analyse data in both InnoDB and an object store using familiar SQL syntax in the same query.

As of MySQL 9.1.0, Lakehouse supports zone maps, see: Zone Maps.

To use Lakehouse with HeatWave AutoML, see: Section 3.12, “HeatWave AutoML and Lakehouse”.