Chapter 4 Load and Manage Data

Table of Contents

4.1 Load Data into DB System

4.1.1 Import Data

4.1.2 Bulk Ingest Data

4.2 Load Data from DB System into MySQL HeatWave Cluster

4.2.1 Supported Data Types for MySQL HeatWave

4.2.2 Prepare to Load Data

4.2.3 Enable or Disable Data Compression

4.2.4 About Auto Parallel Load

4.2.5 Load Data Using Auto Parallel Load

4.2.6 Load Data Manually

4.2.7 About Change Propagation

4.2.8 Reload Tables

4.3 Load Data from Object Storage into MySQL HeatWave Cluster

4.3.1 About MySQL HeatWave Lakehouse

4.3.2 Additional MySQL HeatWave Lakehouse Requirements

4.3.3 MySQL HeatWave Lakehouse Privileges

4.3.4 Supported File Formats and Data Types

4.3.5 Access Object Storage

4.3.6 Lakehouse External Table Syntax

4.3.7 About Lakehouse Auto Parallel Load

4.3.8 Load Structured Data Using Lakehouse Auto Parallel Load

4.3.9 Load Structured Data Manually

4.3.10 Load Unstructured Data

4.3.11 Update Tables

4.4 Unload Data from MySQL HeatWave Cluster

4.4.1 Unload Data Automatically

4.4.2 Unload Data Manually

4.5 Retrieve MySQL HeatWave Metadata

4.5.1 View Secondary Engine Definitions

4.5.2 List Excluded Columns

4.6 Export Query Results to Object Storage

4.6.1 About Exporting Query Results

4.6.2 Requirements to Export Query Results

4.6.3 Export Query Results to CSV Files

4.6.4 Export Query Results to Parquet Files

4.6.5 Export Query Results to ND-JSON Files

4.6.6 Redacted PAR URLs in Exported Log Files

4.6.7 File Name Format for Exported Query Result Files

4.7 Recover DB System Data

4.8 Monitor Data Loading

4.8.1 MySQL HeatWave Node Status Monitoring

4.8.2 MySQL HeatWave Memory Usage Monitoring

4.8.3 Data Load Progress and Status Monitoring

4.8.4 Change Propagation Monitoring

The sections in this chapter describe how to load and manage data in MySQL HeatWave.