@Raymond-Bell @Tom-Elliott You had me update to the working-1.6 branch and it fixed the issue in that it would go the next node even if it says there is a non-match file on the first node. The issue of it constantly thinking image files (usually the largest .img) don’t match still has not been fixed. I have been too busy with other issues in our school district to continue testing at the moment though and have been manually updating images using rsync if we ever upload a new version, seeing as how it doesn’t seem to delete non-matching files and /or thinks matching files don’t match. I am able to replicate the issue on VM’s at home and with multiple test machines and our servers at work. However until the work orders slow down I am unable to keep digging into the issue and the rsync has been working as a temporary solution.

@wayne-workman Thanks Wayne. Is it possible that the block is timing out then if the file is taking too long on the remote server to create the md5sum and that is why it keeps trying to replace the same file each time there is a replication cycle? Is there a place I can change the time it takes to timeout to try as a troubleshooting technique (or I might go with George’s technique and try and echo out the two variables to a log during that pass to check and see if it is truly grabbing the $hashRem

@jgallo @Tom-Elliott
In another thread I was looking into the code a bit and Tom verified that the following code compares the files with one being hashed on one server and the other being hashed on the other.

private static function _filesAreEqual($size_a, $size_b, $file_a, $file_b, $avail) {
        if ($size_a != $size_b) {
            return false;
        }
        if (false === $avail) {
            if ($size_a < 1047685760) {
                $remhash = md5_file($file_b);
                $lochash = md5_file($file_a);
                return ($remhash == $lochash);
            }
            return file_exists($file_b) && file_exists($file_a);
        }
        $hashLoc = self::getHash($file_a);
        $hashRem = $file_b;
        $hashCom = ($hashLoc == $hashRem);
        return $hashCom;

Tom, is it possible that the function is checking for the $hashRem variable before the other server finishes it’s md5hash and therefore comes up with a mismatch? Still doesn’t explain why it won’t delete the file and replace though…

@hanz @Tom-Elliott I updated this morning and can confirm that my server will now check other nodes after the first one in line has files to replace. However, I believe it is still having the issue of the files saying they are different even though the md5sum is the same (and not deleting said file when it says it will and transfer to log)

[07-09-18 7:04:19 am] 
==================================
=== ==== ===== ====
=== ========= == === == ===
=== ======== ==== == ==== ===
=== ======== ==== == =========
=== ==== ==== == =========
=== ======== ==== == === ===
=== ======== ==== == ==== ===
=== ========= == === == ===
=== ========== ===== ====
==================================
===== Free Opensource Ghost ======
==================================
============ Credits =============
= https://fogproject.org/Credits =
==================================
== Released under GPL Version 3 ==
==================================


[07-09-18 7:04:19 am] Interface Ready with IP Address: 10.59.10.12
[07-09-18 7:04:19 am] Interface Ready with IP Address: 127.0.0.1
[07-09-18 7:04:19 am] Interface Ready with IP Address: 127.0.1.1
[07-09-18 7:04:19 am] Interface Ready with IP Address: 192.168.122.1
[07-09-18 7:04:19 am] Interface Ready with IP Address: do-isdir-01.tsd.tsdnet.turlock.k12.ca.us
[07-09-18 7:04:19 am] Interface Ready with IP Address: fog-master-tsd-tsdnet-turlock-k12-ca-us
[07-09-18 7:04:19 am] * Starting ImageReplicator Service
[07-09-18 7:04:19 am] * Checking for new items every 900 seconds
[07-09-18 7:04:19 am] * Starting service loop
[07-09-18 7:04:19 am] * Starting Image Replication.
[07-09-18 7:04:19 am] * We are group ID: 1. We are group name: default
[07-09-18 7:04:19 am] * We are node ID: 1. We are node name: DO-FOG-MASTER
[07-09-18 7:04:19 am] * Attempting to perform Group -> Group image replication.
[07-09-18 7:04:19 am] | Replicating postdownloadscripts
[07-09-18 7:04:20 am] * Found Image to transfer to 2 s
[07-09-18 7:04:20 am] | File Name: postdownloadscripts
[07-09-18 7:04:29 am] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[07-09-18 7:04:29 am] | postdownloadscripts: No need to sync fog.drivers file to OC-FOG-NODE
[07-09-18 7:04:29 am] | postdownloadscripts: No need to sync fog.postdownload file to OC-FOG-NODE
[07-09-18 7:04:29 am] * All files synced for this item.
[07-09-18 7:04:48 am] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[07-09-18 7:04:48 am] | Files do not match on server: PH-FOG-NODE
[07-09-18 7:04:48 am] | Deleting remote file: /images/postdownloadscripts/fog.drivers
[07-09-18 7:04:48 am] | Files do not match on server: PH-FOG-NODE
[07-09-18 7:04:48 am] | Deleting remote file: /images/postdownloadscripts/fog.postdownload
[07-09-18 7:04:48 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator..transfer.PH-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/postdownloadscripts" "/images/postdownloadscripts"; exit' -u fog,[Protected] 10.60.219.12
[07-09-18 7:04:48 am] * Started sync for Image postdownloadscripts
[07-09-18 7:04:48 am] | Replicating postinitscripts
[07-09-18 7:04:48 am] * Found Image to transfer to 2 s
[07-09-18 7:04:48 am] | File Name: dev/postinitscripts
[07-09-18 7:04:57 am] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[07-09-18 7:04:57 am] * All files synced for this item.
[07-09-18 7:05:06 am] | dev/postinitscripts: No need to sync fog.postinit file to PH-FOG-NODE
[07-09-18 7:05:06 am] * All files synced for this item.
[07-09-18 7:05:06 am] * Not syncing Image between s
[07-09-18 7:05:06 am] | Image Name: Win10BaseVM
[07-09-18 7:05:06 am] | There are no other members to sync to.
[07-09-18 7:05:06 am] * Not syncing Image between s
[07-09-18 7:05:06 am] | Image Name: Win7BaseVM
[07-09-18 7:05:06 am] | There are no other members to sync to.
[07-09-18 7:05:06 am] * Attempting to perform Group -> Nodes image replication.
[07-09-18 7:05:07 am] * Found Image to transfer to 2 s
[07-09-18 7:05:07 am] | Image Name: Win10BaseVM
[07-09-18 7:05:16 am] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[07-09-18 7:05:17 am] | Win10BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[07-09-18 7:05:17 am] | Win10BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[07-09-18 7:05:17 am] | Win10BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[07-09-18 7:05:17 am] | Win10BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[07-09-18 7:05:18 am] | Win10BaseVM: No need to sync d1.original.uuids file to OC-FOG-NODE
[07-09-18 7:05:18 am] | Win10BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[07-09-18 7:05:18 am] | Win10BaseVM: No need to sync d1p1.img file to OC-FOG-NODE
[07-09-18 7:05:19 am] | Win10BaseVM: No need to sync d1p2.img file to OC-FOG-NODE
[07-09-18 7:05:19 am] | Win10BaseVM: No need to sync d1p3.img file to OC-FOG-NODE
[07-09-18 7:07:17 am] | Files do not match on server: OC-FOG-NODE
[07-09-18 7:07:17 am] | Deleting remote file: /images/Win10BaseVM/d1p4.img
[07-09-18 7:07:17 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win10BaseVM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win10BaseVM" "/images/Win10BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[07-09-18 7:07:17 am] * Started sync for Image Win10BaseVM
[07-09-18 7:07:26 am] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[07-09-18 7:07:26 am] | Win10BaseVM: No need to sync d1.mbr file to PH-FOG-NODE
[07-09-18 7:07:27 am] | Win10BaseVM: No need to sync d1.minimum.partitions file to PH-FOG-NODE
[07-09-18 7:07:27 am] | Win10BaseVM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[07-09-18 7:07:27 am] | Win10BaseVM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[07-09-18 7:07:27 am] | Win10BaseVM: No need to sync d1.original.uuids file to PH-FOG-NODE
[07-09-18 7:07:28 am] | Win10BaseVM: No need to sync d1.partitions file to PH-FOG-NODE
[07-09-18 7:07:28 am] | Win10BaseVM: No need to sync d1p1.img file to PH-FOG-NODE
[07-09-18 7:07:28 am] | Win10BaseVM: No need to sync d1p2.img file to PH-FOG-NODE
[07-09-18 7:07:29 am] | Win10BaseVM: No need to sync d1p3.img file to PH-FOG-NODE
[07-09-18 7:09:28 am] | Win10BaseVM: No need to sync d1p4.img file to PH-FOG-NODE
[07-09-18 7:09:28 am] * All files synced for this item.
[07-09-18 7:09:28 am] * Found Image to transfer to 2 s
[07-09-18 7:09:28 am] | Image Name: Win7BaseVM
[07-09-18 7:09:37 am] | Win7BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[07-09-18 7:09:37 am] | Win7BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[07-09-18 7:09:37 am] | Win7BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[07-09-18 7:09:38 am] | Win7BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[07-09-18 7:09:38 am] | Win7BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[07-09-18 7:09:38 am] | Win7BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[07-09-18 7:11:56 am] | Win7BaseVM: No need to sync d1p1.img file to OC-FOG-NODE
[07-09-18 7:11:56 am] * All files synced for this item.
[07-09-18 7:12:05 am] | Win7BaseVM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[07-09-18 7:12:05 am] | Win7BaseVM: No need to sync d1.mbr file to PH-FOG-NODE
[07-09-18 7:12:05 am] | Win7BaseVM: No need to sync d1.minimum.partitions file to PH-FOG-NODE
[07-09-18 7:12:06 am] | Win7BaseVM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[07-09-18 7:12:06 am] | Win7BaseVM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[07-09-18 7:12:06 am] | Win7BaseVM: No need to sync d1.partitions file to PH-FOG-NODE
[07-09-18 7:14:21 am] | Win7BaseVM: No need to sync d1p1.img file to PH-FOG-NODE
[07-09-18 7:14:21 am] * All files synced for this item.
[07-09-18 7:29:21 am] * Starting Image Replication.
[07-09-18 7:29:21 am] * We are group ID: 1. We are group name: default
[07-09-18 7:29:21 am] * We are node ID: 1. We are node name: DO-FOG-MASTER
[07-09-18 7:29:21 am] * Attempting to perform Group -> Group image replication.
[07-09-18 7:29:21 am] | Replicating postdownloadscripts
[07-09-18 7:29:21 am] * Found Image to transfer to 2 s
[07-09-18 7:29:21 am] | File Name: postdownloadscripts
[07-09-18 7:29:30 am] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[07-09-18 7:29:31 am] | postdownloadscripts: No need to sync fog.drivers file to OC-FOG-NODE
[07-09-18 7:29:31 am] | postdownloadscripts: No need to sync fog.postdownload file to OC-FOG-NODE
[07-09-18 7:29:31 am] * All files synced for this item.
[07-09-18 7:29:40 am] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[07-09-18 7:29:41 am] | postdownloadscripts: No need to sync fog.drivers file to PH-FOG-NODE
[07-09-18 7:29:41 am] | postdownloadscripts: No need to sync fog.postdownload file to PH-FOG-NODE
[07-09-18 7:29:41 am] * All files synced for this item.
[07-09-18 7:29:41 am] | Replicating postinitscripts
[07-09-18 7:29:41 am] * Found Image to transfer to 2 s
[07-09-18 7:29:41 am] | File Name: dev/postinitscripts
[07-09-18 7:29:51 am] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[07-09-18 7:29:51 am] * All files synced for this item.
[07-09-18 7:30:00 am] | dev/postinitscripts: No need to sync fog.postinit file to PH-FOG-NODE
[07-09-18 7:30:00 am] * All files synced for this item.
[07-09-18 7:30:00 am] * Not syncing Image between s
[07-09-18 7:30:00 am] | Image Name: Win10BaseVM
[07-09-18 7:30:00 am] | There are no other members to sync to.
[07-09-18 7:30:00 am] * Not syncing Image between s
[07-09-18 7:30:00 am] | Image Name: Win7BaseVM
[07-09-18 7:30:00 am] | There are no other members to sync to.
[07-09-18 7:30:00 am] * Attempting to perform Group -> Nodes image replication.
[07-09-18 7:30:00 am] * Found Image to transfer to 2 s
[07-09-18 7:30:00 am] | Image Name: Win10BaseVM
[07-09-18 7:30:10 am] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[07-09-18 7:30:10 am] | Win10BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[07-09-18 7:30:10 am] | Win10BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[07-09-18 7:30:11 am] | Win10BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[07-09-18 7:30:11 am] | Win10BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[07-09-18 7:30:11 am] | Win10BaseVM: No need to sync d1.original.uuids file to OC-FOG-NODE
[07-09-18 7:30:11 am] | Win10BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[07-09-18 7:30:12 am] | Win10BaseVM: No need to sync d1p1.img file to OC-FOG-NODE
[07-09-18 7:30:12 am] | Win10BaseVM: No need to sync d1p2.img file to OC-FOG-NODE
[07-09-18 7:30:13 am] | Win10BaseVM: No need to sync d1p3.img file to OC-FOG-NODE
[07-09-18 7:32:18 am] | Files do not match on server: OC-FOG-NODE
[07-09-18 7:32:18 am] | Deleting remote file: /images/Win10BaseVM/d1p4.img
[07-09-18 7:32:18 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win10BaseVM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win10BaseVM" "/images/Win10BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[07-09-18 7:32:18 am] * Started sync for Image Win10BaseVM
[07-09-18 7:32:28 am] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[07-09-18 7:32:28 am] | Win10BaseVM: No need to sync d1.mbr file to PH-FOG-NODE
[07-09-18 7:32:28 am] | Win10BaseVM: No need to sync d1.minimum.partitions file to PH-FOG-NODE
[07-09-18 7:32:29 am] | Win10BaseVM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[07-09-18 7:32:29 am] | Win10BaseVM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[07-09-18 7:32:29 am] | Win10BaseVM: No need to sync d1.original.uuids file to PH-FOG-NODE
[07-09-18 7:32:29 am] | Win10BaseVM: No need to sync d1.partitions file to PH-FOG-NODE
[07-09-18 7:32:30 am] | Win10BaseVM: No need to sync d1p1.img file to PH-FOG-NODE
[07-09-18 7:32:30 am] | Win10BaseVM: No need to sync d1p2.img file to PH-FOG-NODE
[07-09-18 7:32:31 am] | Win10BaseVM: No need to sync d1p3.img file to PH-FOG-NODE```

@tom-elliott Based off my last reply to you on this thread:
https://forums.fogproject.org/topic/12037/replication-only-working-on-1-5-nodes

I have noticed that it has not been deleting the files when it says it will in the log. I can manually delete them via ftp and the fog username / password. Also, the snapins will update on the nodes just fine when I re-upload a snapin, so it just seems to be an issue with the images. I think what they are referring to is that since they have multiple nodes, as do I, the image never replicates to the other nodes because it keeps finding a fault and never updating the one of the first one in line.

@george1421 Dear god I hope you’re right. I haven’t had a chance to upgrade to working branch 1.5.5 yet… been busy with other summer work. Oddly enough, I found my snapins update just fine when it comes to replication… it is just the images that never deleted the old files that didn’t match. I will try this soon as I get a chance.

@george1421 Sorry for the long delay, I’ve been gone on vacation for the last week. I just tried using the fog credentials stored for one of the nodes and was able to FTP in from my Windows workstation using clonezilla. I was able to delete the file manually. So now the question is:
Why isn’t the PHP command to do the FTP deletion for the replicator service working?

@george1421 I have had to disable secure boot to PXE boot at all with FOG, but I think you can re-enabled it after the image deploys but before it starts the OOBE experience (meaning you will need to have it shut down after imaging or catch it on reboot). One of the more experienced guys might prove me wrong though.
You will have to leave it disabled if you want to PXE boot in the future though.

@dholland When we started rolling out the 7050 and the lattitude e5580 we were forced to go Windows 10 thanks to Intel not supporting updates in Win7 with their latest chipsets, so I had to figure out making a golden image for Win10, using UEFI and Legacy on same network… all sorts of fun.

@dholland Hey, I think for UEFI booting you have to boot with ipxe.efi for option 67. Also, I would give this wiki page a read… I just set it up last month and it’s amazing!
https://wiki.fogproject.org/wiki/index.php?title=BIOS_and_UEFI_Co-Existence