Chapter 6 Management of NDB Cluster

Table of Contents

6.1 Commands in the NDB Cluster Management Client

6.2 NDB Cluster Log Messages

6.2.1 NDB Cluster: Messages in the Cluster Log

6.2.2 NDB Cluster Log Startup Messages

6.2.3 Event Buffer Reporting in the Cluster Log

6.2.4 NDB Cluster: NDB Transporter Errors

6.3 Event Reports Generated in NDB Cluster

6.3.1 NDB Cluster Logging Management Commands

6.3.2 NDB Cluster Log Events

6.3.3 Using CLUSTERLOG STATISTICS in the NDB Cluster Management Client

6.4 Summary of NDB Cluster Start Phases

6.5 Performing a Rolling Restart of an NDB Cluster

6.6 NDB Cluster Single User Mode

6.7 Adding NDB Cluster Data Nodes Online

6.7.1 Adding NDB Cluster Data Nodes Online: General Issues

6.7.2 Adding NDB Cluster Data Nodes Online: Basic procedure

6.7.3 Adding NDB Cluster Data Nodes Online: Detailed Example

6.8 Online Backup of NDB Cluster

6.8.1 NDB Cluster Backup Concepts

6.8.2 Using The NDB Cluster Management Client to Create a Backup

6.8.3 Configuration for NDB Cluster Backups

6.8.4 NDB Cluster Backup Troubleshooting

6.8.5 Taking an NDB Backup with Parallel Data Nodes

6.9 Importing Data Into MySQL Cluster

6.10 MySQL Server Usage for NDB Cluster

6.11 NDB Cluster Disk Data Tables

6.11.1 NDB Cluster Disk Data Objects

6.11.2 NDB Cluster Disk Data Storage Requirements

6.12 Online Operations with ALTER TABLE in NDB Cluster

6.13 Privilege Synchronization and NDB_STORED_USER

6.14 File System Encryption for NDB Cluster

6.14.1 NDB File System Encryption Setup and Usage

6.14.2 NDB File System Encryption Implementation

6.14.3 NDB File System Encryption Limitations

6.15 NDB API Statistics Counters and Variables

6.16 ndbinfo: The NDB Cluster Information Database

6.16.1 The ndbinfo arbitrator_validity_detail Table

6.16.2 The ndbinfo arbitrator_validity_summary Table

6.16.3 The ndbinfo backup_id Table

6.16.4 The ndbinfo blobs Table

6.16.5 The ndbinfo blocks Table

6.16.6 The ndbinfo cluster_locks Table

6.16.7 The ndbinfo cluster_operations Table

6.16.8 The ndbinfo cluster_transactions Table

6.16.9 The ndbinfo config_nodes Table

6.16.10 The ndbinfo config_params Table

6.16.11 The ndbinfo config_values Table

6.16.12 The ndbinfo counters Table

6.16.13 The ndbinfo cpudata Table

6.16.14 The ndbinfo cpudata_1sec Table

6.16.15 The ndbinfo cpudata_20sec Table

6.16.16 The ndbinfo cpudata_50ms Table

6.16.17 The ndbinfo cpuinfo Table

6.16.18 The ndbinfo cpustat Table

6.16.19 The ndbinfo cpustat_50ms Table

6.16.20 The ndbinfo cpustat_1sec Table

6.16.21 The ndbinfo cpustat_20sec Table

6.16.22 The ndbinfo dictionary_columns Table

6.16.23 The ndbinfo dictionary_tables Table

6.16.24 The ndbinfo dict_obj_info Table

6.16.25 The ndbinfo dict_obj_tree Table

6.16.26 The ndbinfo dict_obj_types Table

6.16.27 The ndbinfo disk_write_speed_base Table

6.16.28 The ndbinfo disk_write_speed_aggregate Table

6.16.29 The ndbinfo disk_write_speed_aggregate_node Table

6.16.30 The ndbinfo diskpagebuffer Table

6.16.31 The ndbinfo diskstat Table

6.16.32 The ndbinfo diskstats_1sec Table

6.16.33 The ndbinfo error_messages Table

6.16.34 The ndbinfo events Table

6.16.35 The ndbinfo files Table

6.16.36 The ndbinfo foreign_keys Table

6.16.37 The ndbinfo hash_maps Table

6.16.38 The ndbinfo hwinfo Table

6.16.39 The ndbinfo index_columns Table

6.16.40 The ndbinfo index_stats Table

6.16.41 The ndbinfo locks_per_fragment Table

6.16.42 The ndbinfo logbuffers Table

6.16.43 The ndbinfo logspaces Table

6.16.44 The ndbinfo membership Table

6.16.45 The ndbinfo memoryusage Table

6.16.46 The ndbinfo memory_per_fragment Table

6.16.47 The ndbinfo nodes Table

6.16.48 The ndbinfo operations_per_fragment Table

6.16.49 The ndbinfo pgman_time_track_stats Table

6.16.50 The ndbinfo processes Table

6.16.51 The ndbinfo resources Table

6.16.52 The ndbinfo restart_info Table

6.16.53 The ndbinfo server_locks Table

6.16.54 The ndbinfo server_operations Table

6.16.55 The ndbinfo server_transactions Table

6.16.56 The ndbinfo table_distribution_status Table

6.16.57 The ndbinfo table_fragments Table

6.16.58 The ndbinfo table_info Table

6.16.59 The ndbinfo table_replicas Table

6.16.60 The ndbinfo tc_time_track_stats Table

6.16.61 The ndbinfo threadblocks Table

6.16.62 The ndbinfo threads Table

6.16.63 The ndbinfo threadstat Table

6.16.64 The ndbinfo transporter_details Table

6.16.65 The ndbinfo transporters Table

6.17 INFORMATION_SCHEMA Tables for NDB Cluster

6.18 NDB Cluster and the Performance Schema

6.19 Quick Reference: NDB Cluster SQL Statements

6.20 NDB Cluster Security Issues

6.20.1 NDB Cluster Security and Networking Issues

6.20.2 NDB Cluster and MySQL Privileges

6.20.3 NDB Cluster and MySQL Security Procedures

Managing an NDB Cluster involves a number of tasks, the first of which is to configure and start NDB Cluster. This is covered in Chapter 4, Configuration of NDB Cluster, and Chapter 5, NDB Cluster Programs.

The next few sections cover the management of a running NDB Cluster.

For information about security issues relating to management and deployment of an NDB Cluster, see Section 6.20, “NDB Cluster Security Issues”.

There are essentially two methods of actively managing a running NDB Cluster. The first of these is through the use of commands entered into the management client whereby cluster status can be checked, log levels changed, backups started and stopped, and nodes stopped and started. The second method involves studying the contents of the cluster log ndb_node_id_cluster.log; this is usually found in the management server's DataDir directory, but this location can be overridden using the LogDestination option. (Recall that node_id represents the unique identifier of the node whose activity is being logged.) The cluster log contains event reports generated by ndbd. It is also possible to send cluster log entries to a Unix system log.

Some aspects of the cluster's operation can be also be monitored from an SQL node using the SHOW ENGINE NDB STATUS statement.

More detailed information about NDB Cluster operations is available in real time through an SQL interface using the ndbinfo database. For more information, see Section 6.16, “ndbinfo: The NDB Cluster Information Database”.

NDB statistics counters provide improved monitoring using the mysql client. These counters, implemented in the NDB kernel, relate to operations performed by or affecting Ndb objects, such as starting, closing, and aborting transactions; primary key and unique key operations; table, range, and pruned scans; blocked threads waiting for various operations to complete; and data and events sent and received by NDB Cluster. The counters are incremented by the NDB kernel whenever NDB API calls are made or data is sent to or received by the data nodes.

mysqld exposes the NDB API statistics counters as system status variables, which can be identified from the prefix common to all of their names (Ndb_api_). The values of these variables can be read in the mysql client from the output of a SHOW STATUS statement, or by querying either the Performance Schema session_status or global_status table. By comparing the values of the status variables before and after the execution of an SQL statement that acts on NDB tables, you can observe the actions taken on the NDB API level that correspond to this statement, which can be beneficial for monitoring and performance tuning of NDB Cluster.

MySQL Cluster Manager provides an advanced command-line interface that simplifies many otherwise complex NDB Cluster management tasks, such as starting, stopping, or restarting an NDB Cluster with a large number of nodes. The MySQL Cluster Manager client also supports commands for getting and setting the values of most node configuration parameters as well as mysqld server options and variables relating to NDB Cluster. MySQL Cluster Manager 8.0 provides support for NDB 8.0. See MySQL Cluster Manager 8.0.40 User Manual, for more information.