Image not syncing between nodes

msi · Jan 31, 2018, 1:13 PM

I just crated two new image but its not syncing between the nodes. getting below error:

Found Image to transfer to 7 nodes
| Image Name: Win_10.1709
Not syncing Image between nodes
| File or path cannot be reached.

Please help.*

Wayne Workman · Feb 1, 2018, 2:47 AM

@msi said in Image not syncing between nodes:

I just don’t understand why suddenly it stopped working.

There’s no telling. Probably to get this going though, you need to manually transfer the image with rsync from the storage node to the master node. Then this should be fixed.

If you run this command from your Master Node, it will prompt you for the storage node’s local fog user’s password. You can find that in that node’s storage management area or from this file on it: /opt/fog/.fogsettings

rsync <options> <source> <destination>

rsync -r --bwlimit=6250 fog@10.134.200.230:/images/Laptop2.1 /images
rsync -r --bwlimit=6250 fog@10.134.200.230:/images/Laptop /images

The 6250 is supposed to be 6250Kbps, or 50Mbps. If you want slower, you can do the math to figure out what you need with the calculator I reference below.

scp is another option if the rsync commands don’t work out. Something like this from the master node and again you’d be prompted for the remote node’s fog password.

scp -r fog@10.134.200.230:/images/Laptop2.1 /images
scp -r fog@10.134.200.230:/images/Laptop /images

References:
https://www.cyberciti.biz/tips/linux-use-rsync-transfer-mirror-files-directories.html
https://linux.die.net/man/1/rsync
https://www.checkyourmath.com/convert/data_rates/per_second/megabits_kilobytes_per_second.php

Wayne Workman · Jan 31, 2018, 1:25 PM

@msi said in Image not syncing between nodes:

File or path cannot be reached.

What is the output of this command on the master node:
ls -laht /images/Win_10.1709

What is the output of this command on the non-master node:
ls -laht /images

Please remove any sensitive information from the output before posting your reply.

Also, you might want to look over this article as replication is affected by these things:
https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_FTP
Try to test FTP to your storage nodes.

Also look over this, try to test the MySQL connection to the storage nodes:
https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_MySQL#Easy_.26_quick_MySQL_test

Also, we should have a little more of the replication log from the master node - again please remove any sensitive information before posting.

msi · Jan 31, 2018, 7:34 PM

@wayne-workman Hi
Created the image from branch node, It hasn’t been transferred to Master yet (Win_10.1709 and Laptop2.1). I think thats the problem.
output for ls -laht /images is:

george1421 · Jan 31, 2018, 7:50 PM

@msi I’m not sure if we have the terminology correct here, but you can only capture to a master node in any single storage group. Images only replicate from master nodes to slave nodes.

If you captured an image at a remote branch, that is only possible if the remote branch has a full fog server. Are you expecting that image to replicate somewhere maybe back to HQ?

msi · Jan 31, 2018, 8:37 PM

@george1421 yes, that is correct.

@george1421 said in Image not syncing between nodes:

@msi I’m not sure if we have the terminology correct here, but you can only capture to a master node in any single storage group. Images only replicate from master nodes to slave nodes.

I have 7 node storage that are running fog 1.4.4. One master with the same fog version. I have created two other images (Win_10.1703 and Laptop) from a branch that has one of those 7 nodes. And those got transferred to Master fog server but the latest two aren’t transferring there.

If you captured an image at a remote branch, that is only possible if the remote branch has a full fog server. Are you expecting that image to replicate somewhere maybe back to HQ?

Yes, that what I am trying to accomplish.

george1421 · Jan 31, 2018, 8:39 PM

@msi Where is your master fog server? HQ or the branch?

Did you capture the image created at the branch onto a storage node at a branch? I think I’m missing something when reading your post.

msi · Jan 31, 2018, 8:53 PM

@george1421 Yes, I captured it at a branch; which located at NJ. Master is located at CA

Wayne Workman · Jan 31, 2018, 2:59 PM

@msi do you have a multi-master fog system setup? Perhaps both nodes are configured as masters in their very own storage groups and you have setup image sharing between the groups?

msi · Jan 31, 2018, 8:59 PM

@wayne-workman no, I have only one master and 7 storage node

Wayne Workman · Jan 31, 2018, 9:00 PM

@msi said in Image not syncing between nodes:

no, I have only one master and 7 storage node

Captures have always and only gone to Master nodes during capture. So capturing to a non-master is not possible.
Please share with us a screenshot from your web gui -> Storage Management page.

msi · Jan 31, 2018, 9:03 PM

@wayne-workman

Wayne Workman · Jan 31, 2018, 3:05 PM

@msi Ok, now verify that the image captured properly on the master node. I don’t know your image’s name, but you would check by changing into it’s directory like this:
cd /images/<image name here>/
and then running this command:
ls -laht

msi · Jan 31, 2018, 9:34 PM

@wayne-workman the two images doesn’t exist on master. I can see those on NJED45; the place where I created those two images.
Below picture is from NJED45

Below picture is from Master

Wayne Workman · Jan 31, 2018, 3:39 PM

@msi Then I would ask you to ensure the IP addresses for your nodes are correct in the Storage Management area. Also check the IP addresses set on the nodes via CLI with this command: ip addr