Setup a regular rsync/lsyncd between Azure Pages and GCP Pages
Syncing Pages Between Azure and GCP
-
Cookbook for lsyncd installation -
Recipe for lsyncd configuration file to rsyncssh between Azure and GCP -
Recipe for sysctl modification on Pages servers for inotify/max_queued_events
-
Recipe to run lsyncd as a service with the configuration file generated above -
Open up Firewall access for SSH (tcp/22) between Azure & GCP Pages Storage Servers -
Deployment of Solution
History
Spawned from #388 (closed)
@nick.thomas wrote:
Ideally, we'd be performing regular, automated rsyncs to keep the diff as low as possible. Setting up something like lsyncd would allow us to make this as reactive as possible. It complicates our one-off case slightly, but would mean that we have the fewest possible changes to transmit during the outage window, with a high degree of automation.
@ahanselka wrote:
Do you have any thoughts on how we would automate the rsync? Right now we have no quick and simple way to do that, as it has previously required sharing of an SSH key and enabling root login via ssh for a short time (for the initial connection). We could definitely just set up something like
lsyncd
manually for this particular case. This chef-cookbook is the only one I could find that is relatively recent that would set it up for us.
Once this is done, we could migrate the Primary IP to GCP. This will introduce a small lag but will reduce risk. Let's leave that discussion for another issue, however.