This topic describes how to estimate the optimal HeatWave Cluster size for your data.
A cluster size estimate is generated using MySQL Autopilot machine learning techniques. MySQL Autopilot analyzes the data on your MySQL DB System and recommends a cluster size. If you have not loaded data into your DB System, and you want to estimate the optimal HeatWave Cluster size, load data into the DB System before you create a HeatWave Cluster. See Chapter 6, Importing Data.
The data you intend to load into the HeatWave Cluster must be available on the DB System.
Optionally, log into your DB System and run
ANALYZE TABLEon tables you intend to load into the HeatWave Cluster. Estimates should generally be valid without running
ANALYZE TABLE, but running
ANALYZE TABLEensures that estimates are as accurate as possible.
To estimate a cluster size:
The Estimate Cluster Size with Autopilot dialog is displayed.
Select the schemas and tables you want to include in the estimate. Schemas are displayed in the Schemas pane. Tables belonging to the selected schema appear in the Tables from selected schemas pane.
When schemas and tables are selected, the Summary details are adjusted automatically.
The Schemas pane provides the following information:
Name: The schema name.
HeatWave Cluster Memory Usage (GiB): The estimated amount of HeatWave Cluster memory used by the schema.
Tables Selected: The number of tables selected expressed as a fraction of the total number of tables.
Warnings: The number of table warnings.
The Tables from selected schemas pane provides the following information:
Name: The table name.
Warnings: The number of table warnings. For a description of table warnings, see Cluster Size Estimate Table Warnings.
Memory Size Estimate (GiB): The estimated amount of HeatWave Cluster memory required for the table.
Rows Estimate: The estimated number of table rows.
Review the Summary details, which include memory required by the schemas and tables selected, memory provided per node, HeatWave Cluster nodes required, and memory provided by the cluster.
To apply the cluster size estimate, click.
You are returned to the Create HeatWave Cluster dialog where the estimate is applied to the Cluster Size field.
This topic describes table warnings that may appear in the Tables from selected schemas pane, in the Estimate Cluster Size with MySQL Autopilot dialog.
Table 4.1 Cluster Size Table Warnings
|Table Status Issue||Description|
||The table has too many columns. The column limit is 1017.|
||There are no columns to load. All table columns are defined as
||A VARLEN column exceeds the 65532 byte limit. For more information on
||The estimate could not be calculated. For example, a table estimate may
not be available if statistics for
||A table must be defined with a primary key before it can be loaded into HeatWave.|