{"id":62,"date":"2014-08-06T14:31:00","date_gmt":"2014-08-06T12:31:00","guid":{"rendered":"https:\/\/www.cubeos.org\/blog\/2014\/08\/running-a-mysql-galera-cluster-on-microsoft-azure-2\/"},"modified":"2014-08-06T14:31:00","modified_gmt":"2014-08-06T12:31:00","slug":"running-a-mysql-galera-cluster-on-microsoft-azure-2","status":"publish","type":"post","link":"https:\/\/www.cubeos.org\/blog\/2014\/08\/running-a-mysql-galera-cluster-on-microsoft-azure-2\/","title":{"rendered":"Running a MySQL Galera cluster on Microsoft Azure"},"content":{"rendered":"

 <\/p>\n

A few weeks ago, I was looking into running a MySQL Galera Cluster for a customer with a large Linux IAAS deployment on Azure.<\/p>\n

Why that? There’s ClearDB, a Microsoft Partner that offers MySQL on Azure as SaaS (Software as a service), so you can go to https:\/\/www.cleardb.com\/store\/azure<\/a> and pick your size. Or, if you want to run it on your own, you can pick a Ubuntu Linux Gallery image and type “apt-get install mysql-server” and that’s it, right? Well, not so fast…<\/p>\n

ClearDB is a great offering for most customers that need a MySQL backend, but in this case, even the largest ClearDB offer was not sufficient.<\/p>\n

So the customer followed the second path down, he created an IAAS VM (actually several VMs which each run an independent database server for different purposes) and configured his services to use these databases via the internal IP addresses of these servers. But there’s one problem with this approach: Occasionally, Azure needs to deploy patches to the host systems running these VMs. And occasionally, the Linux VMs also need patches that require a restart of the database server or a reboot of the machines. Whenever this happened, the customer site would be down for a few minutes. <\/p>\n

To avoid this occasional downtime, I teamed up with Oli Sennhauser, CTO at FromDual<\/a> and my colleague Christian Geuer-Pollmann to set up a MySQL Galera Cluster on Azure.<\/p>\n

Such a cluster consists of three MySQL VMs. Database connections can be handled by all three machines, so the DB (read) load is distributed as well. As long as two machines are up, the database service is available. Galera achieves this by implementing the replication of database write transactions. More information can be found on http:\/\/galeracluster.com\/<\/a> and on https:\/\/launchpad.net\/galera\/<\/a> <\/p>\n

So, here’s the tl;dr version of what we did:<\/p>\n

– Set up three Ubuntu 14.04 LTS IAAS VMs with fixed internal IP addresses
– Set up an Azure internal load balancer so that database clients have a single IP they connect to
– Installed mysql-server-wsrep-5.6.16-25.5 and galera-25.3.5 plus a few dependencies
– Configured galera on these three machines
– Added a bit of iptables magic, courtesy of FromDual, to the VMs to block access to the MySQL port while a database server is recovering. The internal load balancer then moves the clients to the other servers of the cluster in case one is down.
– And in order to keep this all neat and clean, we used Powershell to automate the Azure setup part.<\/p>\n

0. Prerequisites<\/p>\n

The fixed internal IP and the internal load balancer make use of features that were only added to the Azure virtual network quite recently. Chances are that if you configured an Azure virtual network a while ago, these function may not be available. So just configure a new virtual network for this.<\/p>\n

Currently, some of these features can only be configured via Powershell. So you need a (windows) machine to run powershell on, if you don’t have one handy, just create a small (A1) Windows server machine in the Azure portal and use RDP to connect to it. Then install the Azure Powershell, see here<\/a>.<\/p>\n

And you should do a bit of planning ahead for your new virtual network. It should have sufficient IP addresses to host all your database clients, the three servers of the cluster and the additional IP input address of the load balancer. In this case, we used the 10.0.0.0\/8 default setting but placed all the database servers in the 10.11.0.0\/16 subnet.<\/p>\n

1. Creating the machines and the internal load balancer<\/p>\n

As said before, we scripted all this in powershell. And in order to keep the configuration apart from the actual commands, we set a bunch of variables in the header of our script that contain the actual settings. So when you see $servicename in the examples below, that is something we’re setting in this header.<\/p>\n

The Load balancer is created by this powershell command:<\/p>\n

Add-AzureInternalLoadBalancer -ServiceName $servicename -InternalLoadBalancerName $loadBalancerName –SubnetName $subnetname –StaticVNetIPAddress $loadBalancerIP<\/p>\n

When running this command, we found that the service needs to be deployed before running this command. So in order to ensure this, we just created a small toy IAAS VM, then created the loadbalancer and the database VMs and then removed the toy VM again.<\/p>\n

To configure a VM to use the internal load balancer, we add an endpoint to the VM configuration:<\/p>\n

Add-AzureEndpoint `
            -Name mysql `
            -LocalPort 3306 `
            -PublicPort 3306 `
            -InternalLoadBalancerName $loadBalancerName `
            -Protocol tcp `
            -ProbePort 3306 `
            -ProbeProtocol “tcp” `
            -ProbeIntervalInSeconds 5 `
            -ProbeTimeoutInSeconds 11 `
            -LBSetName mysql<\/p>\n

Since we have multiple Linux VMs in the same cloud service, we need to remove the standard SSH endpoint and create an individual SSH endpoint for each machine:<\/p>\n

Remove-AzureEndpoint `
            -Name SSH `
            | `
Add-AzureEndpoint `
            -Name SSH `
            -LocalPort 22 `
            -PublicPort $externalSshPortNumber `
            -Protocol tcp `
            |`<\/p>\n

And we want to use a static internal IP for each machine since we need to specifiy these IP adresses in the galera configuration:<\/p>\n

Set-AzureSubnet -SubnetNames $subnetname `
            | `
Set-AzureStaticVNetIP -IPAddress $machineIpAddress `
            | `<\/p>\n

We wrapped all this into a configuration function called GetCustomVM. So here’s the complete script:<\/p>\n

\n
\n
 1:<\/span> #<\/pre>\n
<\/p>\n
 2:<\/span> # Set up three VMs for<\/span> a Galera Cluster<\/pre>\n
<\/p>\n
 3:<\/span> #<\/pre>\n
<\/p>\n
 4:<\/span>  <\/pre>\n
<\/p>\n
 5:<\/span>  <\/pre>\n
<\/p>\n
 6:<\/span> # Azure Cmdlet Reference<\/pre>\n
<\/p>\n
 7:<\/span> # http:\/\/msdn.microsoft.com\/library\/azure\/jj554330.aspx<\/pre>\n
<\/p>\n
 8:<\/span>  <\/pre>\n
<\/p>\n
 9:<\/span> $subscriptionId     = \"<your subscription ID here>\"<\/span><\/pre>\n
<\/p>\n
 10:<\/span> $imageLabel         = \"Ubuntu Server 14.04 LTS\"<\/span>       # One from Get-AzureVMImage | select<\/span> Label<\/pre>\n
<\/p>\n
 11:<\/span> $datacenter         = \"West Europe\"<\/span> # change this to<\/span> your preferred data center, your VNET and storage account have to<\/span> be set up there as well<\/pre>\n
<\/p>\n
 12:<\/span> $adminuser          = \"<your linux user name here>\"<\/span><\/pre>\n
<\/p>\n
 13:<\/span> $adminpass          = \"<a linux password>\"<\/span><\/pre>\n
<\/p>\n
 14:<\/span> $instanceSize       = \"ExtraSmall\"<\/span> # ExtraSmall,Small,Medium,Large,ExtraLarge,A5,A6,A7,A8,A9,Basic_A0,Basic_A1,Basic_A2,Basic_A3,Basic_A4<\/pre>\n
<\/p>\n
 15:<\/span> $storageAccountName = \"<the storage account name for the vm harddisk files>\"<\/span><\/pre>\n
<\/p>\n
 16:<\/span> $vnetname           = \"<the name of your vnet>\"<\/span><\/pre>\n
<\/p>\n
 17:<\/span> $subnetname         = \"<the name of the subnet for the database servers>\"<\/span><\/pre>\n
<\/p>\n
 18:<\/span>  <\/pre>\n
<\/p>\n
 19:<\/span> $loadBalancerName   = \"galera-ilb\"<\/span> # should be changed if<\/span> there are multiple galera clusters  <\/pre>\n
<\/p>\n
 20:<\/span> $loadBalancerIP     = \"10.11.0.10\"<\/span><\/pre>\n
<\/p>\n
 21:<\/span>  <\/pre>\n
<\/p>\n
 22:<\/span> $servicename        = \"<your service name>\"<\/span> # all machines will be created in<\/span> this service<\/pre>\n
<\/p>\n
 23:<\/span> $availabilityset    = \"galera-as\"<\/span> # should be changed if<\/span> there are multiple galera clusters  <\/pre>\n
<\/p>\n
 24:<\/span>  <\/pre>\n
<\/p>\n
 25:<\/span> #<\/pre>\n
<\/p>\n
 26:<\/span> # Calculate a bunch of properties<\/pre>\n
<\/p>\n
 27:<\/span> #<\/pre>\n
<\/p>\n
 28:<\/span> $subscriptionName = (Get-AzureSubscription | `<\/pre>\n
<\/p>\n
 29:<\/span>     select<\/span> SubscriptionName, SubscriptionId | `<\/pre>\n
<\/p>\n
 30:<\/span>     Where-Object SubscriptionId -eq $subscriptionId | `<\/pre>\n
<\/p>\n
 31:<\/span>     Select<\/span>-Object SubscriptionName)[0].SubscriptionName<\/pre>\n
<\/p>\n
 32:<\/span>  <\/pre>\n
<\/p>\n
 33:<\/span> Select<\/span>-AzureSubscription -SubscriptionName $subscriptionName -Current<\/pre>\n
<\/p>\n
 34:<\/span>  <\/pre>\n
<\/p>\n
 35:<\/span> $imageName = (Get-AzureVMImage | Where Label -eq $imageLabel | Sort-Object -Descending PublishedDate)[0].ImageName<\/pre>\n
<\/p>\n
 36:<\/span>    <\/pre>\n
<\/p>\n
 37:<\/span> $storageAccountKey = (Get-AzureStorageKey -StorageAccountName $storageAccountName).Primary<\/pre>\n
<\/p>\n
 38:<\/span>  <\/pre>\n
<\/p>\n
 39:<\/span> $storageContext = New-AzureStorageContext -StorageAccountName $storageAccountName -StorageAccountKey $storageAccountKey<\/pre>\n
<\/p>\n
 40:<\/span>  <\/pre>\n
<\/p>\n
 41:<\/span> #<\/pre>\n
<\/p>\n
 42:<\/span> # Fix the local<\/span> subscription object<\/pre>\n
<\/p>\n
 43:<\/span> #<\/pre>\n
<\/p>\n
 44:<\/span> Set-AzureSubscription -SubscriptionName $subscriptionName -CurrentStorageAccount $storageAccountName <\/pre>\n
<\/p>\n
 45:<\/span>  <\/pre>\n
<\/p>\n
 46:<\/span>  <\/pre>\n
<\/p>\n
 47:<\/span> #<\/pre>\n
<\/p>\n
 48:<\/span> # This function encapsulates the configuration generation of a single new Galera VM<\/pre>\n
<\/p>\n
 49:<\/span> #<\/pre>\n
<\/p>\n
 50:<\/span> Function Get-CustomVM<\/pre>\n
<\/p>\n
 51:<\/span> {<\/pre>\n
<\/p>\n
 52:<\/span>     Param (<\/pre>\n
<\/p>\n
 53:<\/span>         [string]$customVmName, <\/pre>\n
<\/p>\n
 54:<\/span>         [string]$machineIpAddress, <\/pre>\n
<\/p>\n
 55:<\/span>         [int]$externalSshPortNumber,<\/pre>\n
<\/p>\n
 56:<\/span>         [string] $storageAccountName = $storageContext.StorageAccountName<\/pre>\n
<\/p>\n
 57:<\/span>         )<\/pre>\n
<\/p>\n
 58:<\/span>  <\/pre>\n
<\/p>\n
 59:<\/span>     # <\/pre>\n
<\/p>\n
 60:<\/span>     # configure the VM object<\/pre>\n
<\/p>\n
 61:<\/span>     #<\/pre>\n
<\/p>\n
 62:<\/span>     $vm = New-AzureVMConfig `<\/pre>\n
<\/p>\n
 63:<\/span>             -Name $customVmName `<\/pre>\n
<\/p>\n
 64:<\/span>             -InstanceSize $instanceSize `<\/pre>\n
<\/p>\n
 65:<\/span>             -ImageName $imageName `<\/pre>\n
<\/p>\n
 66:<\/span>             -AvailabilitySetName $availabilityset `<\/pre>\n
<\/p>\n
 67:<\/span>             -MediaLocation \"https:\/\/$storageAccountName.blob.core.windows.net\/vhds\/$customVmName-OSDisk.vhd\"<\/span> `<\/pre>\n
<\/p>\n
 68:<\/span>             -HostCaching \"ReadOnly\"<\/span> `<\/pre>\n
<\/p>\n
 69:<\/span>             | `<\/pre>\n
<\/p>\n
 70:<\/span>         Add-AzureProvisioningConfig `<\/pre>\n
<\/p>\n
 71:<\/span>             -Linux `<\/pre>\n
<\/p>\n
 72:<\/span>             -LinuxUser $adminuser `<\/pre>\n
<\/p>\n
 73:<\/span>             -Password $adminpass `<\/pre>\n
<\/p>\n
 74:<\/span>             | `<\/pre>\n
<\/p>\n
 75:<\/span>         Set-AzureSubnet -SubnetNames $subnetname `<\/pre>\n
<\/p>\n
 76:<\/span>             | `<\/pre>\n
<\/p>\n
 77:<\/span>         Set-AzureStaticVNetIP -IPAddress $machineIpAddress `<\/pre>\n
<\/p>\n
 78:<\/span>             | `<\/pre>\n
<\/p>\n
 79:<\/span>         Remove-AzureEndpoint `<\/pre>\n
<\/p>\n
 80:<\/span>             -Name SSH `<\/pre>\n
<\/p>\n
 81:<\/span>             | `<\/pre>\n
<\/p>\n
 82:<\/span>         Add-AzureEndpoint `<\/pre>\n
<\/p>\n
 83:<\/span>             -Name SSH `<\/pre>\n
<\/p>\n
 84:<\/span>             -LocalPort 22 `<\/pre>\n
<\/p>\n
 85:<\/span>             -PublicPort $externalSshPortNumber `<\/pre>\n
<\/p>\n
 86:<\/span>             -Protocol tcp `<\/pre>\n
<\/p>\n
 87:<\/span>             |`<\/pre>\n
<\/p>\n
 88:<\/span>         Add-AzureEndpoint `<\/pre>\n
<\/p>\n
 89:<\/span>             -Name mysql `<\/pre>\n
<\/p>\n
 90:<\/span>             -LocalPort 3306 `<\/pre>\n
<\/p>\n
 91:<\/span>             -PublicPort 3306 `<\/pre>\n
<\/p>\n
 92:<\/span>             -InternalLoadBalancerName $loadBalancerName `<\/pre>\n
<\/p>\n
 93:<\/span>             -Protocol tcp `<\/pre>\n
<\/p>\n
 94:<\/span>             -ProbePort 3306 `<\/pre>\n
<\/p>\n
 95:<\/span>             -ProbeProtocol \"tcp\"<\/span> `<\/pre>\n
<\/p>\n
 96:<\/span>             -ProbeIntervalInSeconds 5 `<\/pre>\n
<\/p>\n
 97:<\/span>             -ProbeTimeoutInSeconds 11 `<\/pre>\n
<\/p>\n
 98:<\/span>             -LBSetName mysql<\/pre>\n
<\/p>\n
 99:<\/span>  <\/pre>\n
<\/p>\n
 100:<\/span>     $vm<\/pre>\n
<\/p>\n
 101:<\/span> }<\/pre>\n
<\/p>\n
 102:<\/span>  <\/pre>\n
<\/p>\n
 103:<\/span> #<\/pre>\n
<\/p>\n
 104:<\/span> # 0. Create cloud service before instantiating internal load balancer<\/pre>\n
<\/p>\n
 105:<\/span> #<\/pre>\n
<\/p>\n
 106:<\/span> if<\/span> ((Get-AzureService | where ServiceName -eq $servicename) -eq $null) {<\/pre>\n
<\/p>\n
 107:<\/span>     Write-Host \"Create cloud service\"<\/span><\/pre>\n
<\/p>\n
 108:<\/span>     New-AzureService -ServiceName $servicename -Location $datacenter<\/pre>\n
<\/p>\n
 109:<\/span> }<\/pre>\n
<\/p>\n
 110:<\/span>  <\/pre>\n
<\/p>\n
 111:<\/span> #<\/pre>\n
<\/p>\n
 112:<\/span> # 1. Create a dummyVM with<\/span> an external endpoint so that the internal load balancer (which is in<\/span> preview) is willing to<\/span> be created<\/pre>\n
<\/p>\n
 113:<\/span> #<\/pre>\n
<\/p>\n
 114:<\/span> $dummyVM = New-AzureVMConfig -Name \"placeholder\"<\/span> -InstanceSize ExtraSmall -ImageName $imageName `<\/pre>\n
<\/p>\n
 115:<\/span>     -MediaLocation \"https:\/\/$storageAccountName.blob.core.windows.net\/vhds\/dummy-OSDisk.vhd\"<\/span> -HostCaching \"ReadWrite\"<\/span> `<\/pre>\n
<\/p>\n
 116:<\/span>     | Add-AzureProvisioningConfig -Linux -LinuxUser $adminuser -Password $adminpass `<\/pre>\n
<\/p>\n
 117:<\/span>     | Set-AzureSubnet -SubnetNames $subnetname `<\/pre>\n
<\/p>\n
 118:<\/span>     | Set-AzureStaticVNetIP -IPAddress \"10.0.1.200\"<\/span> <\/pre>\n
<\/p>\n
 119:<\/span>  <\/pre>\n
<\/p>\n
 120:<\/span> New-AzureVM -ServiceName $servicename -VNetName $vnetname -VMs $dummyVM <\/pre>\n
<\/p>\n
 121:<\/span>  <\/pre>\n
<\/p>\n
 122:<\/span> #<\/pre>\n
<\/p>\n
 123:<\/span> # 2. Create the internal load balancer (no endpoints yet)<\/pre>\n
<\/p>\n
 124:<\/span> #<\/pre>\n
<\/p>\n
 125:<\/span> Add-AzureInternalLoadBalancer -ServiceName $servicename -InternalLoadBalancerName $loadBalancerName –SubnetName $subnetname –StaticVNetIPAddress $loadBalancerIP<\/pre>\n
<\/p>\n
 126:<\/span> if<\/span> ((Get-AzureInternalLoadBalancer -ServiceName $servicename) -ne $null) {<\/pre>\n
<\/p>\n
 127:<\/span>     Write-Host \"Created load balancer\"<\/span><\/pre>\n
<\/p>\n
 128:<\/span> }<\/pre>\n
<\/p>\n
 129:<\/span>  <\/pre>\n
<\/p>\n
 130:<\/span> #<\/pre>\n
<\/p>\n
 131:<\/span> # 3. Create the cluster machines and hook them up to<\/span> the ILB (without mentioning \"-Location $datacenter -VNetName $vnetname \"<\/span>, because the $dummyVM pinned these already<\/pre>\n
<\/p>\n
 132:<\/span> #<\/pre>\n
<\/p>\n
 133:<\/span> $vm1 = Get-CustomVM -customVmName \"galera-a\"<\/span> -machineIpAddress \"10.11.0.11\"<\/span> -externalSshPortNumber 40011<\/pre>\n
<\/p>\n
 134:<\/span> $vm2 = Get-CustomVM -customVmName \"galera-b\"<\/span> -machineIpAddress \"10.11.0.12\"<\/span> -externalSshPortNumber 40012<\/pre>\n
<\/p>\n
 135:<\/span> $vm3 = Get-CustomVM -customVmName \"galera-c\"<\/span> -machineIpAddress \"10.11.0.13\"<\/span> -externalSshPortNumber 40013<\/pre>\n
<\/p>\n
 136:<\/span> New-AzureVM -ServiceName $servicename -VMs $vm1,$vm2,$vm3<\/pre>\n
<\/p>\n
 137:<\/span>  <\/pre>\n
<\/p>\n
 138:<\/span> #<\/pre>\n
<\/p>\n
 139:<\/span> # 4. Delete the dummyVM<\/pre>\n
<\/p>\n
 140:<\/span> #<\/pre>\n
<\/p>\n
 141:<\/span> Remove-AzureVM -ServiceName $servicename -Name $dummyVM.RoleName -DeleteVHD<\/pre>\n
<\/p>\n
 142:<\/span>  <\/pre>\n
<\/div>\n<\/div>\n
 <\/p>\n
 <\/p>\n
 <\/p>\n
 <\/p>\n
 <\/p>\n
Now the load balancer and the three VMs are created.<\/p>\n
2. Install and configure Galera on the three VMs<\/p>\n
We took the galera .deb packages from lounchpad.net:<\/p>\n
https:\/\/launchpad.net\/codership-mysql\/5.6\/5.6.16-25.5\/+download\/mysql-server-wsrep-5.6.16-25.5-amd64.deb<\/a> and https:\/\/launchpad.net\/galera\/3.x\/25.3.5\/+download\/galera-25.3.5-amd64.deb<\/a> <\/p>\n
In these packages, we found a few minor glitches that collided with the Ubuntu 14.04 LTS we installed them on. The first glitch was that mysql-server-wsrep-5.6.16-25.5-amd64.deb has a configured dependency on mysql-client. And Ubuntu sees this satisfied with the mysql-client-5.5 package it uses as default, but this creates a version conflict. So I downloaded the .deb and modified its dependency to point to mysql-client-5.6 by following http:\/\/ubuntuincident.wordpress.com\/2010\/10\/27\/modify-dependencies-of-a-deb-file\/<\/a>. The second glitch was the fact that the default my.cnf contains the path \/var\/log\/mysql\/error.log which does not exist on Ubuntu. This created the strange situation that the server process would not start but just create two mysterious entries in syslog. Running strace on the server process showed the path it was trying to access, and once I created it everything worked fine. Another glitch in the package was that is was missing an upstart script for mysql, instead it had just a classic \/etc\/init.d shell script which confused upstart.  So I took one from a standard mysql-server-5.6 package and everything worked out well.<\/p>\n
The steps to set up Galera were:<\/p>\n
$ apt-get install mysql-client-5.6 
$ apt-get install libssl0.9.8 
$ dpkg -i galera-25.3.5-amd64.deb 
$ dpkg –force-depends -i mysql-server-wsrep-5.6.16-25.5-amd64.modified.deb 
$ mkdir \/var\/log\/mysql 
$ chown mysql \/var\/log\/mysql<\/p>\n
and put the standard upstart script from mysql-server-5.6 into the upstart config directory.<\/p>\n
The next part was to configure the galera cluster function. As you can see in the script above, we have created three machines with the internal IP addresses 10.11.0.11, 10.11.0.12 and 10.11.0.13. For this, we need to set a few things in the default my.cnf<\/p>\n
Binlog_format=row 
Default_storage_engine=InnoDB 
Innodb_autoinc_lock_mode=2 
Query_cache_type=0 
Query_cache_size=0 
Innodb_flush_log_at_trx_commit=0 
Bind_address=0.0.0.0 
wsrep_provider=\/usr\/lib\/galera\/libgalera_smm.so 
wsrep_cluster_name=”<your cluster name here>” 
Wsrep_sst_method=rsync<\/p>\n
These settings are the same in all three machines. On each of the machines, we can now set a human readable node name, eg.g<\/p>\n
wsrep_node_name=’Node A’ <\/p>\n
In the next step, we configured the actual clustering, i.e., we told each machine where to find the replication partners.<\/p>\n
On machine 10.11.0.11, we set the following line in my.cnf:<\/p>\n
wsrep_cluster_address=”gcomm:\/\/”<\/p>\n
This allows this database node to come up even if there is no replication partner.<\/p>\n
Then we started the server on 10.11.0.11.<\/p>\n
Then we set the following line in my.cnf on 10.11.0.12:<\/p>\n
wsrep_cluster_address=”gcomm:\/\/10.11.0.11,10.11.0.13″<\/p>\n
and started the server on 10.11.0.12<\/p>\n
Then we set the following line in my.cnf on 10.11.0.13:<\/p>\n
wsrep_cluster_address=”gcomm:\/\/10.11.0.11,10.11.0.12″<\/p>\n
and started the server on 10.11.0.12.<\/p>\n
Now we went back to 10.11.0.11 and changed the line to:<\/p>\n
wsrep_cluster_address=”gcomm:\/\/10.11.0.12,10.11.0.13″<\/p>\n
and restarted the server. Now the galera cluster was configured.<\/p>\n
Instead of changing the configuration of the initial node twice, one can also directly start the server process and add the configuration setting to the command line, e.g. mysqld_safe wsrep_cluster_address=”gcomm:\/\/”. This is a good workaround if for whatever reason the cluster was fully shut down and needs to be brought up manually again.<\/p>\n
Since the internal load balancer was already configured before, we can now use the ILB input IP address to connect to the cluster. So the clients use 10.11.0.10:3306 to connect to the cluster. And with each new TCP connection, the load balancer chooses one of the running nodes and connects the client to it.<\/p>\n
There is one additional issue that may confuse clients in one specific situation. Imagine that one of the nodes just failed and is about to start up again. In this state, the database server can be accessed but does not yet have data replicated from the other nodes. In this state, although the clients can connect, all database commands will fail. If clients aren’t prepared to handle this situation, this may show up as database errors in applications. But there’s a solution: FromDual has implemented a small shell script that uses the Linux iptables firewall to deny access to the server while it is in this state. The load balancer then finds it cannot access the TCP port and reroutes the request to another running cluster node.<\/p>\n
To run the script whenever a replication state change occurs, another line is added to my.cnf:<\/p>\n
wsrep_notify_cmd = \/usr\/local\/bin\/block_galera_node.sh<\/p>\n
The script and the instructions for setting this up can be found here:  http:\/\/fromdual.com\/galera-cluster-for-mysql-and-hardware-load-balancer\/<\/a> Don’t be alarmed by the fact that it talks about hardware load balancers, it works the same with the (software-based) Azure internal load balancer.<\/p>\n
Hope this helps,<\/p>\n
H.<\/p>\n
<\/div>\n

\nSource: msdn<\/p>\n","protected":false},"excerpt":{"rendered":"
  A few weeks ago, I was looking into running a MySQL Galera Cluster for a customer with a large Linux IAAS deployment on Azure. Why that? There’s ClearDB, a Microsoft Partner that offers MySQL on Azure as SaaS (Software … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30],"tags":[],"class_list":["post-62","post","type-post","status-publish","format-standard","hentry","category-microsoft"],"_links":{"self":[{"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/posts\/62","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/comments?post=62"}],"version-history":[{"count":0,"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/posts\/62\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/media?parent=62"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/categories?post=62"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.cubeos.org\/blog\/wp-json\/wp\/v2\/tags?post=62"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}