4.3 Loading Data Manually

4.3.1 Lakehouse External Table Syntax

4.3.2 Manually Loading Data from External Storage

1. Choose whether to use a pre-authenticated request or a resource principal, see: Section 4.3.2, “Manually Loading Data from External Storage”.

2. Use the Lakehouse ENGINE_ATTRIBUTE with CREATE TABLE statements, see: Section 4.3.1, “Lakehouse External Table Syntax”.

3. Review these steps: Section 2.2.2, “Loading Data Manually”.

As of MySQL 8.3.0-u2, Lakehouse extends Guided Load for external tables, see: Section 2.2.2, “Loading Data Manually”. This employs Autopilot to perform a series of pre-load validation checks, and includes the following:

• Detects any errors with ENGINE_ATTRIBUTE and reports them.

• Infers the schema and performs similar schema adjustments to those performed by Autopilot during Lakehouse Auto Parallel Load. If the inferred schema is not compatible with the defined schema, then Guided Load aborts the load. See: Section 4.4.1, “Lakehouse Auto Parallel Load Schema Inference”.

• Predicts the amount of memory required, and checks that this is available. If the required memory is not available, Guided Load aborts the load.

To monitor any issues encountered during this pre-load validation process, run the SHOW WARNINGS statement after the load command has finished.