In this tutorial, we are going to guide you through the whole process of configuring Debian based distributions for InnoDB cluster usage; the most popular being Ubuntu. We will address the steps from the initial configurations, to the cluster creation, and finally the MySQL Router configuration to map the data traffic.
A real world setup
In a real world setup (as opposed to one using sandboxes), one would use actual server hosts, however for explanatory purposes we will use Virtual machines to simulate a real server farm as described in the previous tutorial.
Prerequisites
sudo
To properly configure the hosts for InnoDB cluster we need sudo
to execute commands with super-user privileges.
To install it run the following commands
1
2
|
$ su $ apt-get install sudo |
To configure it, open the sudoers file and add your user and set the required permissions:
1 |
$ sudo nano /etc/sudoers |
Press ctrl+o and then enter to save the file. Press ctrl+x to close the file.
Python
Python is required to use MySQL Shell, please open a terminal and install it.
1 |
$ sudo apt-get install python |
Hostname mapping
For this tutorial, we assume that the hostname mapping is already done. If not, then please consider configuring the host file before continuing. Hostname mapping is required in order to map a valid hostname to an IP.
Ubuntu’s default hostname looks like the following:
1
2
3
|
127.0.0.1 localhost 127.0.1.1 myHostname |
To configure the host mapping, edit the hosts file:
1 |
$ sudo nano /etc/hosts |
Add the IP(s) of your host(s) and the name(s). Press ctrl+o and then enter to save the file. Press ctrl+x to close the file.
The file should have the following entrances:
1
2
3
4
|
192.168.1.145 ic-1 192.168.1.146 ic-2 192.168.1.147 ic-3 |
Note: Ubuntu will configure a loopback interface (127.0.1.1) for the hostname by default. Make sure to remove the loopback interface entry as it can’t be used to connect from other hosts.
In case you don’t have the sudo package installed in Debian, please install it and configure it properly.
Install the MySQL APT repository
Open a terminal and use wget to download the official APT repository and then install the package:
1
2
|
$ sudo wget http://dev.mysql.com/get/mysql-apt-config_0.8.4-1_all.deb $ sudo dpkg -i ./mysql-apt-config_0.8.4-1_all.deb |
Once the installation of the APT repository completes, update the repositories:
1 |
$ sudo apt-get update |
Install MySQL Server and MySQL Shell
Type the following command in the terminal to install MySQL Server and MySQL Shell:
1 |
$ sudo apt-get install mysql-server mysql-shell |
During the installation, you need to set a password for MySQL root user.
Ubuntu screenshot
When the installation finish start MySQL Shell using root user, type the password for root when asked for it:
1 |
$ sudo -i mysqlsh |
Configure the local instance calling the following function, and type the password for the user when prompted:
1 |
mysql-js> dba.configureLocalInstance(); |
MySQL Shell will find the default configuration file and ask you if it is ok to modify it, type “Y”. Since root cannot do remote logins, you have three options to continue with the configuration: enable the remote connections for root, create a new user or not enable remote connections for root neither create a new user.
Ubuntu screenshot
In this tutorial, we choose to create a new user.
You will see a report with the changes made by MySQL Shell and a message saying that you need to restart the MySQL service to apply them.
Ubuntu screenshot
Quit MySQL Shell:
mysql-js> \q
Then restart the MySQL Service
1 |
$ sudo systemctl restart mysql.service |
At this point, the host is ready to be part of an InnoDB cluster.
Install MySQL Router
The next step is to install MySQL Router, which provides you the ability to hide your network configuration behind a proxy and map the data requests to the cluster.
Normally, MySQL Router is installed in the client machine. However, for this tutorial we will install it on one of the machines.
In a terminal run the following command:
1 |
$ sudo apt-get install mysql-router |
Once the installation of MySQL Router finish, it’s time to create a cluster.
SSL and IP White List
Before continuing, we need to pause to mention some important aspects regarding security.
If you’re using MySQL Server Community edition you may not have SSL enabled on your Server. You can verify it by running the following command in a terminal:
1 |
$ mysql -u root -p --execute="show variables like '%have%ssl%'" |
You shall verify the value of the variables “have_openssl” and “have_ssl”, if the value is “YES” you have SSL enabled, if not then you don’t. In the case that you don’t have SSL enabled and want to have it enabled on your server you can use the mysql_ssl_rsa_setup tool. The mysl_ssl_rsa_setup tool generates the SSL certificate and key files as well as the RSA key-pair files required to support secure connections using SSL, the only requirement to use it is to have the openssl binary in the path environment. You can use the tool by executing the following command:
1 |
$ mysql_ssl_rsa_setup --datadir=mydir |
Where the value given to the “–datadir” option is the place where the certificate shall be created, which should be the MySQL data directory. If that option is not given, mysql_ssl_rsa_setup uses by default the MySQL compiled data directory when MySQL Server was installed or the specified in the mysqld.cnf file.
Create and manage InnoDB Cluster using SSL
If you have decided to enable SSL, when creating the cluster and adding instances to it you must provide the ipWhitelist option parameter to specify the range of IPs that are going to be permitted to connect to the cluster. The ipWhiteList variable value is set to “AUTOMATIC” by default, which permits connections just from private subnetworks on the host where the cluster is created.
Also you can specify the SSL mode that is going to be used to configure the members of a cluster using the memberSslMode parameter. You have the following options:
- REQUIRED: if used, SSL (encryption) will be enabled for the instances to communicate with other members of the cluster.
- DISABLED: if used, SSL (encryption) will be disabled.
- AUTO: if used, SSL (encryption) will be enabled if supported by the instance, otherwise disabled.
By default ‘AUTO’ it’s used even if it’s not specified.
Create an InnoDB cluster
Open a terminal and start MySQL Shell:
1 |
$ mysqlsh |
Then create a classic session to the host using the user created in the configuration step and the hostname of the host:
1 |
mysql-js> shell.connect('ic@ic-1:3306'); |
Ubuntu screenshot
Now create a cluster assigning the return value to a variable for later usage:
Remember to use the ipWhitelist option in case you have SSL enabled
1 |
mysql-js> var cluster = dba.createCluster('myCluster'); |
You will see a couple of messages with information about the cluster creation and the function required to add instances to it:
Ubuntu screenshot
Using SSL
In the following example a cluster is created using the ipWhiteList option and setting SSL as required for all the members of the cluster:
1 |
mysql-js> dba.createCluster('myCluster', { memberSslMode: 'REQUIRED', ipWhitelist:'10.196.0.0/16,127.0.0.1/8'}); |
The first address is the range of the IP’s of our host, the second IP is the localhost. You can add multiple IP ranges separating them by a comma. The number after the slash is the number of network bits when using CIDR values.
The following command is an example of the usage of the ipWhiteList and memberSslMode options to add a new instance to a cluster:
1 |
mysql-js> cluster.addInstance('user@host:3306', { memberSslMode: 'REQUIRED', ipWhitelist:'10.196.0.0/16,127.0.0.1/8'}); |
Remember to set the same memberSslMode value set in the cluster creation if it’s not ‘AUTO’, when you try to add a new instance to the cluster.
Once the cluster creation is complete, you can see the status of the cluster calling the following function:
1 |
mysql-js> cluster.status(); |
Ubuntu screenshot
To add new instances use the following command, be sure to use a valid user and ip of an already configured host:
Remember to use the ipWhitelist option in case you have SSL enabled
1 |
mysql-js> cluster.addInstance('ic@ic-2:3306'); |
Type the password for the user when prompted. Add as many hosts as you want in your cluster, and take in mind that at least three are required to have tolerance to one failure.
Here you can see that all the instances in the cluster are online:
Persist cluster configuration
In order to persist the cluster configuration of each instance, so if a restart happens the instances automatically rejoin the cluster, we must use the dba.configureLocalInstance() again on each instance. The command will update the my.cnf files with the parameters necessary for the automatic rejoin on the cluster on startup.
Run the following commands, locally on each instance:
1 |
mysql-js> dba.configureLocalInstance('ic@ic1-:3306'); |
1 |
mysql-js> dba.configureLocalInstance('ic@ic-2:3306'); |
1 |
mysql-js> dba.configureLocalInstance('ic@ic-3:3306'); |
Using MySQL Router
Now, it’s time to bootstrap our Router. Open a new terminal and type the following command, and type the password for the user when requested:
1 |
$ mysqlrouter --bootstrap ic@ic-1:3306 --directory myrouter |
With the previous command the following it’s done:
- A specific configuration for the cluster “myCluster” it’s created, MySQL Router got connected to the cluster and extracted the metadata to run by itself
- A directory named “myrouter” is created in “home” and it contains the configuration required by MySQL Router to run
- Four TCP ports are generated to get connected to the cluster: rean only and read-write for classic protocol and X ptrotocol.
To start MySQL Router run the following command:
1 |
$ myrouter/start.sh |
To stop MySQL Router, in a terminal run the stop script generated:
1 |
$ myrouter/stop.sh |
Remote Connection
Now we can get connected to the cluster using the IP generated by MySQL Router. The following screenshot is from a Windows host that is connected to the cluster using the read/write port:
1 |
$ mysqlsh ic@ic-1:6446 |
And the following screenshot is from a windows host that it’s connected to the cluster using the read-only port:
1
2
|
$ mysqlsh ic@ic-1:6447 |
Remember that to be able to connect to a remote host using its name, you should configure the host mapping in Windows as well. The file to edit it’s in the directory “C:\Windows\System32\drivers\etc\hosts”, once you configure the host mapping the file should looks like:
Conclusion
You’ve acquired the knowledge to configure hosts for cluster usage, as well as create cluster and add instances to it. Also, you have learned the basics to bootstrap a cluster and to create a proxy for remote connections to map the data traffic using MySQL Router. The environment can be tested as described in a previous tutorial.
You’ve certainly realized how simple and easy to use is the collection of products provided by MySQL to create a high availability environment.
See you in the next blog post!