Sync between storage nodes to slow

[Mikael]

What can we do about slow or interrupted image sync?

We have one master node and four storage node out on slow WAN-links. They are all sharing the same base image that is synced over VPN.
The problem is that it is not working. I think it’s because it is using FTP to sync? When I restart the FOGReplicator service all looks good for a while but after many hours it is not still finished.

Can we utilize RSYNC instead?

FOG 1.2 on Ubuntu 14.04
Location Plugin
One Master Storage node and four nodes. All on same storage group, sharing same images.

[Wayne Workman]

What speeds can your WAN support?

Can you run an iPerf test between the master and one of the nodes?

Are all of your storage nodes on the same version of FOG that the master is on?

Are the servers virtualized?

Can you write down all of your location plugin settings - then remove the plugin, and then re-install the plugin and reset the settings?

[Tom Elliott]

FTP vs RSYNC, should not matter from a transferring data standpoint. The amount of time you’re going to spend initially transferring the files is going to be long regardless of the approach you take to try to accomplish the task.

That said, you can use Rsync if you feel it necessary. Just stop the FOGImageReplicator (FOGReplicator) service then run your rsync commands.

[Mikael]

When I run rsync manually with --progress it says about 200kB/s.
All servers are on 1.2, virtualized in vmware ESXi 5.5.

The big advantage with rsync is that is does not copy the whole file, only the changed bits, right? So that would be huge different when syncing big image files.

Ok, then I will try and schedule rsync in crontab for my drivers and images.
How can I then disable the service FOGReplicator alltogether? I do not want it to delete files and try to copy before rsync has finished.

[Wayne Workman]

@Mikael said:

How can I then disable the service FOGReplicator alltogether? I do not want it to delete files and try to copy before rsync has finished.

In Ubuntu, it should be something similar to this perhaps… but I’m not sure so if it doesn’t work, don’t blame me lol… I wear a Red-Hat

service FOGImageReplicator disable

[Mikael]

OK, I will try this. Thanks!