HeatWave Release Notes
After an initial data load, the data can become stale, and the external tables require a refresh. Subsequent calls to Auto Parallel Load will refresh the data. As of MySQL 9.0.0, you can use Lakehouse Incremental Load, to modify the loaded data .
Lakehouse Incremental Load uses the existing ENGINE_ATTRIBUTE,
see: Section 5.2.2, “Lakehouse External Table Syntax”. It is
not possible to change file parameters, file names, file
patterns or file prefixes. However, it is possible to add or
remove individual files if they still match the defined file
pattern or file prefix.
Note
As of MySQL version 9.1.2, you can change the file
parameters, file names, patterns or file prefixes by editing
the engine_attribute using ALTER_TABLE
command. For more information, refer to
Section 5.4.2, “Editing Loaded Data Using ALTER TABLE and Engine Attribute”.
After the initial data load, a subsequent call to Auto Parallel Load with
the refresh_external_tables option set to
true will refresh the data, see:
Section 2.2.3.2, “Auto Parallel Load Syntax”.
If a subsequent call to Auto Parallel Load includes tables that have not yet been loaded to Lakehouse, then Auto Parallel Load will load them for the first time.
A call to Auto Parallel Load might contain both loaded and unloaded tables. Those that are unloaded will be loaded, and those that are already loaded will be refreshed.