Posts made by jflippen

jflippen

@dburk Hey, sounds like you’re having a similar issue to me. I’ve been posting on this thread here:
https://forums.fogproject.org/topic/11856/fog-storage-node-ftp-error-in-image-replicator-log-files-do-not-match/9

From what I’ve found so far, it seems that FOG is able to create the initial upload just fine, but is not deleting files that need to be changed after making updates to an image. In relation to your specific issue, I have also noticed during my troubleshooting that FOG will only try to update one node at a time per image. Since it keeps failing to properly delete and transfer the new file versions of your image to CHS-FOG, it is stuck in a loop and keeps trying to update the files over and over again to the same node.

Is the image being replicated for the first time or is this an update to an image that has already transferred once? If it is the later and you are looking for a quick fix, you could delete the image from your /images folder in each node and let the replication service send over a fresh copy of the image. This has worked for me until I can figure out why the replication service won’t update existing images on nodes. I am also toying around with rsync commands to manually replicate my images out to each node, since I do that anyways for my drivers folder used to driver injection based off this post:
https://forums.fogproject.org/topic/11126/using-fog-postinstall-scripts-for-windows-driver-injection-2017-ed

I am going to keep following your post to see what other people say, as I think it is related to the problem I am having as well.

jflippen

@vince-villarreal is your setup still having replication issues as well?

jflippen

@tom-elliott Okay, so after some more testing and starting over my OC-FOG-NODE from scratch, I am finding a pattern. It seems the initial transfer of the image goes without any hitches. However, when I update an image, the largest .img file (or any file in which the md5sum changes possibly) seems to never gets updated when the lftp command goes out.

I also noticed that new images have root set for both the owner and group (on the master), even though the /images directory is set to fog:root. permissions are all 777 still though. On the nodes however, the owner and group is fog, but with only execute and read permissions?

I feel that the master node is not able to delete the non-matching .img file from the node before replicating, or isn’t writing over…not sure on the actual process.

Here is Master images folder:

and here is OC node:

This is log before uploading new version of image:

[06-05-18 11:20:00 am] * starting Image Replication.
[06-05-18 11:20:00 am] * We are group ID: 1. We are group name: default
[06-05-18 11:20:00 am] * We are node ID: 1. We are node name: DO-FOG-MASTER
[06-05-18 11:20:00 am] * Attempting to perform Group -> Group image replication.
[06-05-18 11:20:00 am] | Replicating postdownloadscripts
[06-05-18 11:20:00 am] * Found Image to transfer to 2 s
[06-05-18 11:20:00 am] | File Name: postdownloadscripts
[06-05-18 11:20:09 am] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[06-05-18 11:20:09 am] | postdownloadscripts: No need to sync fog.drivers file to OC-FOG-NODE
[06-05-18 11:20:10 am] | postdownloadscripts: No need to sync fog.postdownload file to OC-FOG-NODE
[06-05-18 11:20:10 am] * All files synced for this item.
[06-05-18 11:20:19 am] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[06-05-18 11:20:19 am] | postdownloadscripts: No need to sync fog.drivers file to PH-FOG-NODE
[06-05-18 11:20:20 am] | postdownloadscripts: No need to sync fog.postdownload file to PH-FOG-NODE
[06-05-18 11:20:20 am] * All files synced for this item.
[06-05-18 11:20:20 am] | Replicating postinitscripts
[06-05-18 11:20:20 am] * Found Image to transfer to 2 s
[06-05-18 11:20:20 am] | File Name: dev/postinitscripts
[06-05-18 11:20:28 am] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[06-05-18 11:20:28 am] * All files synced for this item.
[06-05-18 11:20:37 am] | dev/postinitscripts: No need to sync fog.postinit file to PH-FOG-NODE
[06-05-18 11:20:37 am] * All files synced for this item.
[06-05-18 11:20:38 am] * Not syncing Image between s
[06-05-18 11:20:38 am] | Image Name: Win10BaseVM
[06-05-18 11:20:38 am] | There are no other members to sync to.
[06-05-18 11:20:38 am] * Not syncing Image between s
[06-05-18 11:20:38 am] | Image Name: Win7BaseVM
[06-05-18 11:20:38 am] | There are no other members to sync to.
[06-05-18 11:20:38 am] * Attempting to perform Group -> Nodes image replication.
[06-05-18 11:20:38 am] * Found Image to transfer to 2 s
[06-05-18 11:20:38 am] | Image Name: Win10BaseVM
[06-05-18 11:20:47 am] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[06-05-18 11:20:48 am] | Win10BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[06-05-18 11:20:48 am] | Win10BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[06-05-18 11:20:48 am] | Win10BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[06-05-18 11:20:49 am] | Win10BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[06-05-18 11:20:49 am] | Win10BaseVM: No need to sync d1.original.uuids file to OC-FOG-NODE
[06-05-18 11:20:49 am] | Win10BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[06-05-18 11:20:49 am] | Win10BaseVM: No need to sync d1p1.img file to OC-FOG-NODE
[06-05-18 11:20:50 am] | Win10BaseVM: No need to sync d1p2.img file to OC-FOG-NODE
[06-05-18 11:20:50 am] | Win10BaseVM: No need to sync d1p3.img file to OC-FOG-NODE
[06-05-18 11:22:51 am] | Win10BaseVM: No need to sync d1p4.img file to OC-FOG-NODE
[06-05-18 11:22:51 am] * All files synced for this item.
[06-05-18 11:23:00 am] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[06-05-18 11:23:01 am] | Win10BaseVM: No need to sync d1.mbr file to PH-FOG-NODE
[06-05-18 11:23:01 am] | Win10BaseVM: No need to sync d1.minimum.partitions file to PH-FOG-NODE
[06-05-18 11:23:01 am] | Win10BaseVM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[06-05-18 11:23:02 am] | Win10BaseVM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[06-05-18 11:23:02 am] | Win10BaseVM: No need to sync d1.original.uuids file to PH-FOG-NODE
[06-05-18 11:23:02 am] | Win10BaseVM: No need to sync d1.partitions file to PH-FOG-NODE
[06-05-18 11:23:02 am] | Win10BaseVM: No need to sync d1p1.img file to PH-FOG-NODE
[06-05-18 11:23:03 am] | Win10BaseVM: No need to sync d1p2.img file to PH-FOG-NODE
[06-05-18 11:23:03 am] | Win10BaseVM: No need to sync d1p3.img file to PH-FOG-NODE
[06-05-18 11:25:03 am] | Win10BaseVM: No need to sync d1p4.img file to PH-FOG-NODE
[06-05-18 11:25:03 am] * All files synced for this item.
[06-05-18 11:25:03 am] * Found Image to transfer to 2 s
[06-05-18 11:25:03 am] | Image Name: Win7BaseVM
[06-05-18 11:25:13 am] | Win7BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[06-05-18 11:25:14 am] | Win7BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[06-05-18 11:25:14 am] | Win7BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[06-05-18 11:25:14 am] | Win7BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[06-05-18 11:25:14 am] | Win7BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[06-05-18 11:25:15 am] | Win7BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[06-05-18 11:27:12 am] | Win7BaseVM: No need to sync d1p1.img file to OC-FOG-NODE
[06-05-18 11:27:12 am] * All files synced for this item.
[06-05-18 11:27:21 am] | Win7BaseVM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[06-05-18 11:27:21 am] | Win7BaseVM: No need to sync d1.mbr file to PH-FOG-NODE
[06-05-18 11:27:22 am] | Win7BaseVM: No need to sync d1.minimum.partitions file to PH-FOG-NODE
[06-05-18 11:27:22 am] | Win7BaseVM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[06-05-18 11:27:22 am] | Win7BaseVM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[06-05-18 11:27:22 am] | Win7BaseVM: No need to sync d1.partitions file to PH-FOG-NODE
[06-05-18 11:29:15 am] | Win7BaseVM: No need to sync d1p1.img file to PH-FOG-NODE
[06-05-18 11:29:15 am] * All files synced for this item.

And this is after uploading my Win7 VM:

[06-05-18 3:20:00 pm] * Starting Image Replication.
[06-05-18 3:20:00 pm] * We are group ID: 1. We are group name: default
[06-05-18 3:20:00 pm] * We are node ID: 1. We are node name: DO-FOG-MASTER
[06-05-18 3:20:00 pm] * Attempting to perform Group -> Group image replication.
[06-05-18 3:20:00 pm] | Replicating postdownloadscripts
[06-05-18 3:20:00 pm] * Found Image to transfer to 2 s
[06-05-18 3:20:00 pm] | File Name: postdownloadscripts
[06-05-18 3:20:09 pm] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[06-05-18 3:20:09 pm] | postdownloadscripts: No need to sync fog.drivers file to OC-FOG-NODE
[06-05-18 3:20:10 pm] | postdownloadscripts: No need to sync fog.postdownload file to OC-FOG-NODE
[06-05-18 3:20:10 pm] * All files synced for this item.
[06-05-18 3:20:19 pm] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[06-05-18 3:20:19 pm] | postdownloadscripts: No need to sync fog.drivers file to PH-FOG-NODE
[06-05-18 3:20:20 pm] | postdownloadscripts: No need to sync fog.postdownload file to PH-FOG-NODE
[06-05-18 3:20:20 pm] * All files synced for this item.
[06-05-18 3:20:20 pm] | Replicating postinitscripts
[06-05-18 3:20:20 pm] * Found Image to transfer to 2 s
[06-05-18 3:20:20 pm] | File Name: dev/postinitscripts
[06-05-18 3:20:29 pm] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[06-05-18 3:20:29 pm] * All files synced for this item.
[06-05-18 3:20:37 pm] | dev/postinitscripts: No need to sync fog.postinit file to PH-FOG-NODE
[06-05-18 3:20:37 pm] * All files synced for this item.
[06-05-18 3:20:38 pm] * Not syncing Image between s
[06-05-18 3:20:38 pm] | Image Name: Win10BaseVM
[06-05-18 3:20:38 pm] | There are no other members to sync to.
[06-05-18 3:20:38 pm] * Not syncing Image between s
[06-05-18 3:20:38 pm] | Image Name: Win7BaseVM
[06-05-18 3:20:38 pm] | There are no other members to sync to.
[06-05-18 3:20:38 pm] * Attempting to perform Group -> Nodes image replication.
[06-05-18 3:20:38 pm] * Found Image to transfer to 2 s
[06-05-18 3:20:38 pm] | Image Name: Win10BaseVM
[06-05-18 3:20:48 pm] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[06-05-18 3:20:48 pm] | Win10BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[06-05-18 3:20:48 pm] | Win10BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[06-05-18 3:20:48 pm] | Win10BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[06-05-18 3:20:49 pm] | Win10BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[06-05-18 3:20:49 pm] | Win10BaseVM: No need to sync d1.original.uuids file to OC-FOG-NODE
[06-05-18 3:20:49 pm] | Win10BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[06-05-18 3:20:50 pm] | Win10BaseVM: No need to sync d1p1.img file to OC-FOG-NODE
[06-05-18 3:20:50 pm] | Win10BaseVM: No need to sync d1p2.img file to OC-FOG-NODE
[06-05-18 3:20:50 pm] | Win10BaseVM: No need to sync d1p3.img file to OC-FOG-NODE
[06-05-18 3:22:42 pm] | Win10BaseVM: No need to sync d1p4.img file to OC-FOG-NODE
[06-05-18 3:22:42 pm] * All files synced for this item.
[06-05-18 3:22:51 pm] | Win10BaseVM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[06-05-18 3:22:52 pm] | Win10BaseVM: No need to sync d1.mbr file to PH-FOG-NODE
[06-05-18 3:22:52 pm] | Win10BaseVM: No need to sync d1.minimum.partitions file to PH-FOG-NODE
[06-05-18 3:22:52 pm] | Win10BaseVM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[06-05-18 3:22:53 pm] | Win10BaseVM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[06-05-18 3:22:53 pm] | Win10BaseVM: No need to sync d1.original.uuids file to PH-FOG-NODE
[06-05-18 3:22:53 pm] | Win10BaseVM: No need to sync d1.partitions file to PH-FOG-NODE
[06-05-18 3:22:53 pm] | Win10BaseVM: No need to sync d1p1.img file to PH-FOG-NODE
[06-05-18 3:22:54 pm] | Win10BaseVM: No need to sync d1p2.img file to PH-FOG-NODE
[06-05-18 3:22:54 pm] | Win10BaseVM: No need to sync d1p3.img file to PH-FOG-NODE
[06-05-18 3:24:48 pm] | Win10BaseVM: No need to sync d1p4.img file to PH-FOG-NODE
[06-05-18 3:24:48 pm] * All files synced for this item.
[06-05-18 3:24:48 pm] * Found Image to transfer to 2 s
[06-05-18 3:24:48 pm] | Image Name: Win7BaseVM
[06-05-18 3:24:58 pm] | Win7BaseVM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[06-05-18 3:24:58 pm] | Win7BaseVM: No need to sync d1.mbr file to OC-FOG-NODE
[06-05-18 3:24:59 pm] | Win7BaseVM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[06-05-18 3:24:59 pm] | Win7BaseVM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[06-05-18 3:24:59 pm] | Win7BaseVM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[06-05-18 3:25:00 pm] | Win7BaseVM: No need to sync d1.partitions file to OC-FOG-NODE
[06-05-18 3:26:57 pm] | Files do not match on server: OC-FOG-NODE
[06-05-18 3:26:57 pm] | Deleting remote file: /images/Win7BaseVM/d1p1.img
[06-05-18 3:26:57 pm] * Starting Sync Actions
[06-05-18 3:26:57 pm] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win7BaseVM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win7BaseVM" "/images/Win7BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[06-05-18 3:26:57 pm] * Started sync for Image Win7BaseVM
[06-05-18 3:26:57 pm] | Replication already running with PID: 25890

If I use rsync I can get the files to copy manually, or if I delete the files from the node it seems to be able to send the files out again. It just seems that the replication service won’t update my images. The md5sum on /images/Win7BaseVM.d1p1.img is different between the master and the node, which is triggering the lftp, but it isn’t overriding the node files.

jflippen

Like @Tom-Elliott said, the initial postdownload script always runs. However, you can use CASE or IF statements to either call a function or open another script. Here is my current postdownload script that I got from one of @george1421 and his wonderful driver injection scripts found here

#!/bin/bash
. /usr/share/fog/lib/funcs.sh
[[ -z $postdownpath ]] && postdownpath="/images/postdownloadscripts/"
if [ $img == "Win7BaseVM" ] || [ $img == "Win10BaseVM" ] ; then
	case $osid in
	    5|6|7|9)
	        clear
	        [[ ! -d /ntfs ]] && mkdir -p /ntfs
	        getHardDisk
	        if [[ -z $hd ]]; then
	            handleError "Could not find hdd to use"
	        fi
	        getPartitions $hd
	        for part in $parts; do
	            umount /ntfs >/dev/null 2>&1
	            fsTypeSetting "$part"
	            case $fstype in
	                ntfs)
	                    dots "Testing partition $part"
	                    ntfs-3g -o force,rw $part /ntfs
	                    ntfsstatus="$?"
	                    if [[ ! $ntfsstatus -eq 0 ]]; then
	                        echo "Skipped"
	                        continue
	                    fi
	                    if [[ ! -d /ntfs/windows && ! -d /ntfs/Windows && ! -d /ntfs/WINDOWS ]]; then
	                        echo "Not found"
	                        umount /ntf >/dev/null 2>&1
	                        continue
	                    fi
	                    echo "Success"
	                    break
	                    ;;
	                *)
	                    echo " * Partition $part not NTFS filesystem"
	                    ;;
	            esac
	        done
	        if [[ ! $ntfsstatus -eq 0 ]]; then
	            echo "Failed"
	            debugPause
	            handleError "Failed to mount $part ($0)\n    Args: $*"
	        fi
	        echo "Done"
	        debugPause
	        . ${postdownpath}fog.deletelog
	        . ${postdownpath}fog.drivers
	        #. ${postdownpath}fog.ad
	        umount /ntfs
	        ;;
	    *)
	        echo "Non-Windows Deployment"
	        debugPause
	        return
	        ;;
	esac
fi

You can see that I have an if statement at the beginning to only run his driver injection script if the image name is one of my golden image VM’s.

jflippen

@wayne-workman Okay, thanks Wayne. It was just an idea since I saw that Tom had made drop downs possible for the OU’s. I saw this post by George which might work https://forums.fogproject.org/topic/7740/the-magical-mystical-fog-post-download-script/6t,
though I think I will just do things manually until we flatten our domain since there are times when multiple domains may be on the same IP range.

jflippen

@tom-elliott Hey Tom,
It looks like updating didn’t fix the issue after all. I have all three on 1.5.3 and the issue persists. It seems that the md5sum doesn’t match on the files in the log, and the server keeps trying to sync the same files over and over. I also noticed that whenever the CMD: is sent to transfer files, it will sometimes give an error saying that replication is already running. However, it seems the PID number changes between the error messages.

[05-31-18 7:34:02 am] * Starting Image Replication.
[05-31-18 7:34:02 am] * We are group ID: 1. We are group name: default
[05-31-18 7:34:02 am] * We are node ID: 1. We are node name: DO-FOG-MASTER
[05-31-18 7:34:02 am] * Attempting to perform Group -> Group image replication.
[05-31-18 7:34:02 am] | Replicating postdownloadscripts
[05-31-18 7:34:02 am] * Found Image to transfer to 2 s
[05-31-18 7:34:02 am] | File Name: postdownloadscripts
[05-31-18 7:34:12 am] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[05-31-18 7:34:12 am] | postdownloadscripts: No need to sync fog.drivers file to OC-FOG-NODE
[05-31-18 7:34:13 am] | postdownloadscripts: No need to sync fog.postdownload file to OC-FOG-NODE
[05-31-18 7:34:13 am] * All files synced for this item.
[05-31-18 7:34:22 am] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[05-31-18 7:34:22 am] | postdownloadscripts: No need to sync fog.drivers file to PH-FOG-NODE
[05-31-18 7:34:22 am] | postdownloadscripts: No need to sync fog.postdownload file to PH-FOG-NODE
[05-31-18 7:34:22 am] * All files synced for this item.
[05-31-18 7:34:22 am] | Replicating postinitscripts
[05-31-18 7:34:23 am] * Found Image to transfer to 2 s
[05-31-18 7:34:23 am] | File Name: dev/postinitscripts
[05-31-18 7:34:32 am] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[05-31-18 7:34:32 am] * All files synced for this item.
[05-31-18 7:34:41 am] | dev/postinitscripts: No need to sync fog.postinit file to PH-FOG-NODE
[05-31-18 7:34:41 am] * All files synced for this item.
[05-31-18 7:34:41 am] * Not syncing Image between s
[05-31-18 7:34:41 am] | Image Name: Win 10 Base VM
[05-31-18 7:34:41 am] | There are no other members to sync to.
[05-31-18 7:34:41 am] * Not syncing Image between s
[05-31-18 7:34:41 am] | Image Name: Win7 Base VM
[05-31-18 7:34:41 am] | There are no other members to sync to.
[05-31-18 7:34:41 am] * Attempting to perform Group -> Nodes image replication.
[05-31-18 7:34:42 am] * Found Image to transfer to 2 s
[05-31-18 7:34:42 am] | Image Name: Win 10 Base VM
[05-31-18 7:34:51 am] | Win 10 Base VM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[05-31-18 7:34:52 am] | Win 10 Base VM: No need to sync d1.mbr file to OC-FOG-NODE
[05-31-18 7:34:52 am] | Win 10 Base VM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[05-31-18 7:34:52 am] | Win 10 Base VM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[05-31-18 7:34:52 am] | Win 10 Base VM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[05-31-18 7:34:53 am] | Win 10 Base VM: No need to sync d1.partitions file to OC-FOG-NODE
[05-31-18 7:34:53 am] | Win 10 Base VM: No need to sync d1p1.img file to OC-FOG-NODE
[05-31-18 7:36:38 am] | Files do not match on server: OC-FOG-NODE
[05-31-18 7:36:38 am] | Deleting remote file: /images/Win10BaseVM/d1p2.img
[05-31-18 7:36:38 am] * Starting Sync Actions
[05-31-18 7:36:38 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win 10 Base VM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win10BaseVM" "/images/Win10BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[05-31-18 7:36:38 am] * Started sync for Image Win 10 Base VM
[05-31-18 7:36:38 am] | Replication already running with PID: 23263
[05-31-18 7:36:38 am] * Found Image to transfer to 2 s
[05-31-18 7:36:38 am] | Image Name: Win7 Base VM
[05-31-18 7:36:48 am] | Win7 Base VM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[05-31-18 7:36:48 am] | Win7 Base VM: No need to sync d1.mbr file to OC-FOG-NODE
[05-31-18 7:36:49 am] | Win7 Base VM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[05-31-18 7:36:49 am] | Win7 Base VM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[05-31-18 7:36:49 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[05-31-18 7:36:49 am] | Win7 Base VM: No need to sync d1.partitions file to OC-FOG-NODE
[05-31-18 7:38:37 am] | Win7 Base VM: No need to sync d1p1.img file to OC-FOG-NODE
[05-31-18 7:38:37 am] * All files synced for this item.
[05-31-18 7:38:47 am] | Win7 Base VM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[05-31-18 7:38:47 am] | Files do not match on server: PH-FOG-NODE
[05-31-18 7:38:47 am] | Deleting remote file: /images/Win7BaseVM/d1.mbr
[05-31-18 7:38:47 am] | Files do not match on server: PH-FOG-NODE
[05-31-18 7:38:47 am] | Deleting remote file: /images/Win7BaseVM/d1.minimum.partitions
[05-31-18 7:38:47 am] | Win7 Base VM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[05-31-18 7:38:48 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[05-31-18 7:38:48 am] | Win7 Base VM: No need to sync d1.partitions file to PH-FOG-NODE
[05-31-18 7:40:36 am] | Files do not match on server: PH-FOG-NODE
[05-31-18 7:40:36 am] | Deleting remote file: /images/Win7BaseVM/d1p1.img
[05-31-18 7:40:36 am] * Starting Sync Actions
[05-31-18 7:40:36 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win7 Base VM.transfer.PH-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win7BaseVM" "/images/Win7BaseVM"; exit' -u fog,[Protected] 10.60.219.12
[05-31-18 7:40:36 am] * Started sync for Image Win7 Base VM
[05-31-18 8:34:02 am] * Starting Image Replication.
[05-31-18 8:34:02 am] * We are group ID: 1. We are group name: default
[05-31-18 8:34:02 am] * We are node ID: 1. We are node name: DO-FOG-MASTER
[05-31-18 8:34:02 am] * Attempting to perform Group -> Group image replication.
[05-31-18 8:34:02 am] | Replicating postdownloadscripts
[05-31-18 8:34:02 am] * Found Image to transfer to 2 s
[05-31-18 8:34:02 am] | File Name: postdownloadscripts
[05-31-18 8:34:11 am] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[05-31-18 8:34:12 am] | postdownloadscripts: No need to sync fog.drivers file to OC-FOG-NODE
[05-31-18 8:34:12 am] | postdownloadscripts: No need to sync fog.postdownload file to OC-FOG-NODE
[05-31-18 8:34:12 am] * All files synced for this item.
[05-31-18 8:34:22 am] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[05-31-18 8:34:22 am] | postdownloadscripts: No need to sync fog.drivers file to PH-FOG-NODE
[05-31-18 8:34:22 am] | postdownloadscripts: No need to sync fog.postdownload file to PH-FOG-NODE
[05-31-18 8:34:22 am] * All files synced for this item.
[05-31-18 8:34:22 am] | Replicating postinitscripts
[05-31-18 8:34:23 am] * Found Image to transfer to 2 s
[05-31-18 8:34:23 am] | File Name: dev/postinitscripts
[05-31-18 8:34:31 am] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[05-31-18 8:34:31 am] * All files synced for this item.
[05-31-18 8:34:40 am] | dev/postinitscripts: No need to sync fog.postinit file to PH-FOG-NODE
[05-31-18 8:34:40 am] * All files synced for this item.
[05-31-18 8:34:40 am] * Not syncing Image between s
[05-31-18 8:34:40 am] | Image Name: Win 10 Base VM
[05-31-18 8:34:40 am] | There are no other members to sync to.
[05-31-18 8:34:40 am] * Not syncing Image between s
[05-31-18 8:34:40 am] | Image Name: Win7 Base VM
[05-31-18 8:34:40 am] | There are no other members to sync to.
[05-31-18 8:34:40 am] * Attempting to perform Group -> Nodes image replication.
[05-31-18 8:34:41 am] * Found Image to transfer to 2 s
[05-31-18 8:34:41 am] | Image Name: Win 10 Base VM
[05-31-18 8:34:50 am] | Win 10 Base VM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[05-31-18 8:34:50 am] | Win 10 Base VM: No need to sync d1.mbr file to OC-FOG-NODE
[05-31-18 8:34:51 am] | Win 10 Base VM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[05-31-18 8:34:51 am] | Win 10 Base VM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[05-31-18 8:34:51 am] | Win 10 Base VM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[05-31-18 8:34:52 am] | Win 10 Base VM: No need to sync d1.partitions file to OC-FOG-NODE
[05-31-18 8:34:52 am] | Win 10 Base VM: No need to sync d1p1.img file to OC-FOG-NODE
[05-31-18 8:36:36 am] | Files do not match on server: OC-FOG-NODE
[05-31-18 8:36:36 am] | Deleting remote file: /images/Win10BaseVM/d1p2.img
[05-31-18 8:36:36 am] * Starting Sync Actions
[05-31-18 8:36:36 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win 10 Base VM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win10BaseVM" "/images/Win10BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[05-31-18 8:36:36 am] * Started sync for Image Win 10 Base VM
[05-31-18 8:36:36 am] | Replication already running with PID: 9086
[05-31-18 8:36:37 am] * Found Image to transfer to 2 s
[05-31-18 8:36:37 am] | Image Name: Win7 Base VM
[05-31-18 8:36:47 am] | Win7 Base VM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[05-31-18 8:36:47 am] | Win7 Base VM: No need to sync d1.mbr file to OC-FOG-NODE
[05-31-18 8:36:47 am] | Win7 Base VM: No need to sync d1.minimum.partitions file to OC-FOG-NODE
[05-31-18 8:36:48 am] | Win7 Base VM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[05-31-18 8:36:48 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[05-31-18 8:36:49 am] | Win7 Base VM: No need to sync d1.partitions file to OC-FOG-NODE
[05-31-18 8:38:38 am] | Win7 Base VM: No need to sync d1p1.img file to OC-FOG-NODE
[05-31-18 8:38:38 am] * All files synced for this item.
[05-31-18 8:38:47 am] | Win7 Base VM: No need to sync d1.fixed_size_partitions file to PH-FOG-NODE
[05-31-18 8:38:48 am] | Files do not match on server: PH-FOG-NODE
[05-31-18 8:38:48 am] | Deleting remote file: /images/Win7BaseVM/d1.mbr
[05-31-18 8:38:48 am] | Files do not match on server: PH-FOG-NODE
[05-31-18 8:38:48 am] | Deleting remote file: /images/Win7BaseVM/d1.minimum.partitions
[05-31-18 8:38:48 am] | Win7 Base VM: No need to sync d1.original.fstypes file to PH-FOG-NODE
[05-31-18 8:38:48 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[05-31-18 8:38:49 am] | Win7 Base VM: No need to sync d1.partitions file to PH-FOG-NODE
[05-31-18 8:40:37 am] | Files do not match on server: PH-FOG-NODE
[05-31-18 8:40:37 am] | Deleting remote file: /images/Win7BaseVM/d1p1.img
[05-31-18 8:40:37 am] * Starting Sync Actions
[05-31-18 8:40:37 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win7 Base VM.transfer.PH-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win7BaseVM" "/images/Win7BaseVM"; exit' -u fog,[Protected] 10.60.219.12
[05-31-18 8:40:37 am] * Started sync for Image Win7 Base VM

I have also noticed that I have .transfer logs sitting in the log folder for my OC-FOG-NODE, but not my PHS-FOG-NODE, even though the replicator log indicates that it is writing to a transfer log for PHS-FOG-NODE. This is what one of the transfer logs looks like:

2018-05-30 12:34:59 /images/Win10BaseVM/d1.original.fstypes -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1.original.fstypes 0-15 2b/s
2018-05-30 12:34:59 /images/Win10BaseVM/d1.partitions -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1.partitions 0-190 20b/s
2018-05-30 12:34:59 /images/Win10BaseVM/d1.original.swapuuids -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1.original.swapuuids 0-0 
2018-05-30 12:34:59 /images/Win10BaseVM/d1.minimum.partitions -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1.minimum.partitions 0-190 20b/s
2018-05-30 12:34:59 /images/Win10BaseVM/d1.fixed_size_partitions -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1.fixed_size_partitions 0-3 
2018-05-30 12:34:59 /images/Win10BaseVM/d1.mbr -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1.mbr 0-1048576 108.5K/s
2018-05-30 12:35:00 /images/Win10BaseVM/d1p1.img -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1p1.img 0-10220821 994.2K/s
2018-05-30 12:36:27 /images/Win10BaseVM/d1p2.img -> ftp://fog@10.59.181.12/%2Fimages/Win10BaseVM/d1p2.img 0-7248799134 70.58M/s```

jflippen

@wayne-workman We are planning on flattening our domain, but we are a ways out from doing that due to other projects that need to take place first. Until then, I have to deal with 7 subdomains and multiple default OU’s for each site (office staff is on different domain than school staff). I’m just trying to prevent one of us fat fingering the wrong OU or domain with drop down menus to get us by in the meantime.

jflippen

Hello again,
I was wondering if it’s possible to get drop downs for handling multiple domains similar to how @Tom-Elliott did in this post a while back:
https://forums.fogproject.org/topic/10268/active-directory-ou-aliases/2 and https://forums.fogproject.org/topic/11944/how-are-you-guys-using-ou-s-within-fog/3

Our school district has quite a few domains and I am trying to simplify things for applying settings to groups of computers. We used to have an old PC as a FOG server at each school but are now going to one large FOG server with nodes for the entire district.

jflippen

@quazz said in Windows 10 Image Not Getting Right Disk Size When Deployed:

@imagingmaster21 When FOG tries to create an image from the host it creates small text files with information about the partitions that are used during deployment so that it knows which to resize and which not, how big they should be etc.

You will find them typically in /images/IMAGENAME

The problem in your case is that your main data partition is locked in between two other partitions. As such the third partition starts at the marker for around 49.37GB or so (give or take). This means that the maximum size of the main partition will be limited by it.

On a default installation, the Windows partition itself is the last one

You’ll have to fix this on the host and recapture the image.

I would agree with @Quazz. Your Windows partition should be the last partition in order to expand. I have attached a picture of my VM 0_1527695774893_HDD Partitions.JPG

I was having an odd issue where it would only extend like 90% on certain machines, so I added this to my unattend.xml file (VM is in audit mode and I sysprep before uploading).

    <settings pass="specialize">
                <component name="Microsoft-Windows-Deployment" processorArchitecture="amd64" publicKeyToken="31bf3856ad364e35" language="neutral" versionScope="nonSxS" xmlns:wcm="http://schemas.microsoft.com/WMIConfig/2002/State" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
            <ExtendOSPartition>
                <Extend>true</Extend>
            </ExtendOSPartition>
        </component>
	</settings>

jflippen

@tom-elliott Hey Tom, i updated primary FOG server and nodes to working branch version 1.5.2.31 and the issue went away for the most part. It seems one of my nodes still has the same issue, with different files each time:

lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win 10 Base VM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win10BaseVM" "/images/Win10BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[05-29-18 6:53:54 am] * Started sync for Image Win 10 Base VM
[05-29-18 6:53:54 am] | Replication already running with PID: 1171
[05-29-18 6:53:55 am] * Found Image to transfer to 2 s
[05-29-18 6:53:55 am] | Image Name: Win7 Base VM
[05-29-18 6:54:04 am] | Win7 Base VM: No need to sync d1.fixed_size_partitions file to OC-FOG-NODE
[05-29-18 6:54:04 am] | Files do not match on server: OC-FOG-NODE
[05-29-18 6:54:04 am] | Deleting remote file: /images/Win7BaseVM/d1.mbr
[05-29-18 6:54:04 am] | Files do not match on server: OC-FOG-NODE
[05-29-18 6:54:04 am] | Deleting remote file: /images/Win7BaseVM/d1.minimum.partitions
[05-29-18 6:54:05 am] | Win7 Base VM: No need to sync d1.original.fstypes file to OC-FOG-NODE
[05-29-18 6:54:05 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to OC-FOG-NODE
[05-29-18 6:54:05 am] | Win7 Base VM: No need to sync d1.partitions file to OC-FOG-NODE
[05-29-18 6:56:00 am] | Files do not match on server: OC-FOG-NODE
[05-29-18 6:56:00 am] | Deleting remote file: /images/Win7BaseVM/d1p1.img
[05-29-18 6:56:00 am] * Starting Sync Actions
[05-29-18 6:56:00 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win7 Base VM.transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win7BaseVM" "/images/Win7BaseVM"; exit' -u fog,[Protected] 10.59.181.12
[05-29-18 6:56:00 am] * Started sync for Image Win7 Base VM
[05-29-18 6:56:00 am] | Replication already running with PID: 1969

Replicator service sleep time is still set for 10800, so I will try re-installing and rebooting on that one.

jflippen

I wanted to tag in and say that I also have this issue. It seems the files transfer fine after I upload an image, but when I check the replicator log I see a never-ending string of files to not match, deleting remote file. I have tried rebooting my master and both storage nodes, checked the md5sum on several files (they matched). I have also tried increasing the time, based off of other threads on the forum. Running 1.5.2 on all three servers. I noticed that even if it says that there is no need to sync, it still goes and says it doesn’t match and deletes the file. /images is set to fog:root -R and permissions to 777 Here is some of my replicator log:

[05-24-18 9:57:43 am] 
==================================
=== ==== ===== ====
=== ========= == === == ===
=== ======== ==== == ==== ===
=== ======== ==== == =========
=== ==== ==== == =========
=== ======== ==== == === ===
=== ======== ==== == ==== ===
=== ========= == === == ===
=== ========== ===== ====
==================================
===== Free Opensource Ghost ======
==================================
============ Credits =============
= https://fogproject.org/Credits =
==================================
== Released under GPL Version 3 ==
==================================


[05-24-18 9:57:44 am] Interface Ready with IP Address: 10.59.10.12
[05-24-18 9:57:44 am] Interface Ready with IP Address: 127.0.0.1
[05-24-18 9:57:44 am] Interface Ready with IP Address: 127.0.1.1
[05-24-18 9:57:44 am] Interface Ready with IP Address: do-isdir-01."REDACTED"
[05-24-18 9:57:44 am] * Starting ImageReplicator Service
[05-24-18 9:57:44 am] * Checking for new items every 10800 seconds
[05-24-18 9:57:44 am] * Starting service loop
[05-24-18 9:57:45 am] * Starting Image Replication.
[05-24-18 9:57:45 am] * We are group ID: 1. We are group name: default
[05-24-18 9:57:45 am] * We are node ID: 1. We are node name: DO-FOG-MASTER
[05-24-18 9:57:45 am] * Attempting to perform Group -> Group image replication.
[05-24-18 9:57:45 am] | Replicating postdownloadscripts
[05-24-18 9:57:45 am] * Found Image to transfer to 2 nodes
[05-24-18 9:57:45 am] | File Name: postdownloadscripts
[05-24-18 9:58:21 am] | postdownloadscripts: No need to sync fog.deletelog file to OC-FOG-NODE
[05-24-18 9:58:21 am] | 562 0 /images/postdownloadscripts/fog.deletelog ftp://fog:REDACTED@10.59.181.12/images/postdownloadscripts/fog.deletelog
[05-24-18 9:58:21 am] | Files do not match.
[05-24-18 9:58:21 am] * Deleting remote file: /images/postdownloadscripts/fog.deletelog
[05-24-18 9:58:21 am] | 2258 0 /images/postdownloadscripts/fog.drivers ftp://fog:REDACTED@10.59.181.12/images/postdownloadscripts/fog.drivers
[05-24-18 9:58:21 am] | Files do not match.
[05-24-18 9:58:21 am] * Deleting remote file: /images/postdownloadscripts/fog.drivers
[05-24-18 9:58:21 am] | 2258 0 /images/postdownloadscripts/fog.drivers ftp://fog:REDACTED@10.59.181.12/images/postdownloadscripts/fog.drivers
[05-24-18 9:58:21 am] | Files do not match.
[05-24-18 9:58:21 am] * Deleting remote file: /images/postdownloadscripts/fog.drivers
[05-24-18 9:58:21 am] | 1813 0 /images/postdownloadscripts/fog.postdownload ftp://fog:REDACTED@10.59.181.12/images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:21 am] | Files do not match.
[05-24-18 9:58:21 am] * Deleting remote file: /images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:22 am] | 1813 0 /images/postdownloadscripts/fog.postdownload ftp://fog:REDACTED@10.59.181.12/images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:22 am] | Files do not match.
[05-24-18 9:58:22 am] * Deleting remote file: /images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:22 am] * Starting Sync Actions
[05-24-18 9:58:22 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator..transfer.OC-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/postdownloadscripts" "/images/postdownloadscripts"; exit' -u fog,[Protected] 10.59.181.12
[05-24-18 9:58:22 am] * Started sync for Image postdownloadscripts
[05-24-18 9:58:58 am] | postdownloadscripts: No need to sync fog.deletelog file to PH-FOG-NODE
[05-24-18 9:58:58 am] | 562 0 /images/postdownloadscripts/fog.deletelog ftp://fog:REDACTED/images/postdownloadscripts/fog.deletelog
[05-24-18 9:58:58 am] | Files do not match.
[05-24-18 9:58:58 am] * Deleting remote file: /images/postdownloadscripts/fog.deletelog
[05-24-18 9:58:59 am] | 2258 0 /images/postdownloadscripts/fog.drivers ftp://fog:REDACTED/images/postdownloadscripts/fog.drivers
[05-24-18 9:58:59 am] | Files do not match.
[05-24-18 9:58:59 am] * Deleting remote file: /images/postdownloadscripts/fog.drivers
[05-24-18 9:58:59 am] | 2258 0 /images/postdownloadscripts/fog.drivers ftp://fog:REDACTED/images/postdownloadscripts/fog.drivers
[05-24-18 9:58:59 am] | Files do not match.
[05-24-18 9:58:59 am] * Deleting remote file: /images/postdownloadscripts/fog.drivers
[05-24-18 9:58:59 am] | 1813 0 /images/postdownloadscripts/fog.postdownload ftp://fog:REDACTED/images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:59 am] | Files do not match.
[05-24-18 9:58:59 am] * Deleting remote file: /images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:59 am] | 1813 0 /images/postdownloadscripts/fog.postdownload ftp://fog:REDACTED/images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:59 am] | Files do not match.
[05-24-18 9:58:59 am] * Deleting remote file: /images/postdownloadscripts/fog.postdownload
[05-24-18 9:58:59 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator..transfer.PH-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/postdownloadscripts" "/images/postdownloadscripts"; exit' -u fog,[Protected] 10.60.219.12
[05-24-18 9:58:59 am] * Started sync for Image postdownloadscripts
[05-24-18 9:58:59 am] | Replicating postinitscripts
[05-24-18 9:58:59 am] * Found Image to transfer to 2 nodes
[05-24-18 9:58:59 am] | File Name: dev/postinitscripts
[05-24-18 9:59:36 am] | dev/postinitscripts: No need to sync fog.postinit file to OC-FOG-NODE
[05-24-18 9:59:36 am] | 249 0 /images/dev/postinitscripts/fog.postinit ftp://fog:REDACTED@10.59.181.12/images/dev/postinitscripts/fog.postinit
[05-24-18 9:59:36 am] | Files do not match.
[05-24-18 9:59:36 am] * Deleting remote file: /images/dev/postinitscripts/fog.postinit
[05-24-18 9:59:36 am] * Starting Sync Actions

It does this for all the files in my /images folder:

[05-24-18 10:07:57 am] | 15 0 /images/Win7BaseVM/d1.original.fstypes ftp://fog:REDACTED@10.60.219.12/images/Win7BaseVM/d1.original.fstypes
[05-24-18 10:07:57 am] | Files do not match.
[05-24-18 10:07:57 am] * Deleting remote file: /images/Win7BaseVM/d1.original.fstypes
[05-24-18 10:08:15 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[05-24-18 10:08:33 am] | Win7 Base VM: No need to sync d1.original.swapuuids file to PH-FOG-NODE
[05-24-18 10:08:33 am] | 132 0 /images/Win7BaseVM/d1.partitions ftp://fog:REDACTED@10.60.219.12/images/Win7BaseVM/d1.partitions
[05-24-18 10:08:33 am] | Files do not match.
[05-24-18 10:08:33 am] * Deleting remote file: /images/Win7BaseVM/d1.partitions
[05-24-18 10:08:34 am] | 132 0 /images/Win7BaseVM/d1.partitions ftp://fog:REDACTED@10.60.219.12/images/Win7BaseVM/d1.partitions
[05-24-18 10:08:34 am] | Files do not match.
[05-24-18 10:08:34 am] * Deleting remote file: /images/Win7BaseVM/d1.partitions
[05-24-18 10:09:27 am] | 8925093455 0 /images/Win7BaseVM/d1p1.img ftp://fog:REDACTED@10.60.219.12/images/Win7BaseVM/d1p1.img
[05-24-18 10:09:27 am] | Files do not match.
[05-24-18 10:09:27 am] * Deleting remote file: /images/Win7BaseVM/d1p1.img
[05-24-18 10:10:21 am] | 8925093455 0 /images/Win7BaseVM/d1p1.img ftp://fog:REDACTED@10.60.219.12/images/Win7BaseVM/d1p1.img
[05-24-18 10:10:21 am] | Files do not match.
[05-24-18 10:10:21 am] * Deleting remote file: /images/Win7BaseVM/d1p1.img
[05-24-18 10:10:21 am] | CMD:
			lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Win7 Base VM.transfer.PH-FOG-NODE.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win7BaseVM" "/images/Win7BaseVM"; exit' -u fog,[Protected] 10.60.219.12
[05-24-18 10:10:21 am] * Started sync for Image Win7 Base VM

jflippen

Here is what my unattend.xml looks like. I have made some redactions and comments to help out. I made mine using Windows System Image Manager. This is one of many webpages I used to learn about building my unattend file (and lots of trial and error): https://www.tenforums.com/tutorials/3020-customize-windows-10-image-audit-mode-sysprep.html

<?xml version="1.0" encoding="utf-8"?>
<unattend xmlns="urn:schemas-microsoft-com:unattend">
    <settings pass="specialize">
        <component name="Microsoft-Windows-Shell-Setup" processorArchitecture="amd64" publicKeyToken="31bf3856ad364e35" language="neutral" versionScope="nonSxS" xmlns:wcm="http://schemas.microsoft.com/WMIConfig/2002/State" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
            <ProductKey>Your key</ProductKey>
            <TimeZone>Your TimeZone</TimeZone>
        </component>
        <component name="Microsoft-Windows-Deployment" processorArchitecture="amd64" publicKeyToken="31bf3856ad364e35" language="neutral" versionScope="nonSxS" xmlns:wcm="http://schemas.microsoft.com/WMIConfig/2002/State" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
            <!--I had to add this as FOG wasn't expanding my OS partition all the way after OOBE ran-->
			<ExtendOSPartition>
                <Extend>true</Extend>
            </ExtendOSPartition>
        </component>
    </settings>
    <settings pass="oobeSystem">
        <component name="Microsoft-Windows-International-Core" processorArchitecture="amd64" publicKeyToken="31bf3856ad364e35" language="neutral" versionScope="nonSxS" xmlns:wcm="http://schemas.microsoft.com/WMIConfig/2002/State" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
            <InputLocale>en-US</InputLocale>
            <SystemLocale>en-US</SystemLocale>
            <UILanguage>en-US</UILanguage>
            <UserLocale>en-US</UserLocale>
        </component>
        <component name="Microsoft-Windows-Shell-Setup" processorArchitecture="amd64" publicKeyToken="31bf3856ad364e35" language="neutral" versionScope="nonSxS" xmlns:wcm="http://schemas.microsoft.com/WMIConfig/2002/State" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
            <OOBE>
                <HideEULAPage>true</HideEULAPage>
                <HideLocalAccountScreen>true</HideLocalAccountScreen>
                <HideOEMRegistrationScreen>true</HideOEMRegistrationScreen>
                <HideOnlineAccountScreens>true</HideOnlineAccountScreens>
                <HideWirelessSetupInOOBE>true</HideWirelessSetupInOOBE>
                <ProtectYourPC>1</ProtectYourPC>
            </OOBE>
            <UserAccounts>
			<!--If you skip account creation in OOBE, you need to enable local Administrator account or create another admin account in unattend file -->
                <AdministratorPassword>
                    <Value>Your AdministratorPassword==</Value>
                    <PlainText>false</PlainText>
                </AdministratorPassword>
            </UserAccounts>
            <StartTiles>
                <PromoteOEMTiles>false</PromoteOEMTiles>
            </StartTiles>
            <AutoLogon>
                <Password>
                    <Value>password again</Value>
                    <PlainText>false</PlainText>
                </Password>
                <LogonCount>1</LogonCount>
                <Username>Administrator</Username>
                <Enabled>true</Enabled>
            </AutoLogon>
            <FirstLogonCommands>
                <SynchronousCommand wcm:action="add">
                    <CommandLine>reg add &quot;HKLM\SOFTWARE\Microsoft\Windows NT\CurrentVersion\Winlogon&quot; /v AutoLogonCount /t REG_DWORD /d 1 /f</CommandLine>
                    <Description>Set AutoLogin count back to zero</Description>
                    <Order>1</Order>
                    <RequiresUserInput>false</RequiresUserInput>
                </SynchronousCommand>
            </FirstLogonCommands>
        </component>
    </settings>
    <settings pass="offlineServicing">
        <component name="Microsoft-Windows-PnpCustomizationsNonWinPE" processorArchitecture="amd64" publicKeyToken="31bf3856ad364e35" language="neutral" versionScope="nonSxS" xmlns:wcm="http://schemas.microsoft.com/WMIConfig/2002/State" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
            <DriverPaths>
			<!--If you are using the postdownload script for driver injection, you will need this -->
                <PathAndCredentials wcm:action="add" wcm:keyValue="1">
                    <Path>C:\Windows\DRV</Path>
                </PathAndCredentials>
            </DriverPaths>
        </component>
    </settings>
	<!--don't think the offline image part is needed, but it's part of the one that get's made when I use Windows System Image Manager -->
    <cpi:offlineImage cpi:source="source" />
</unattend>