Unable to Image Since 1.5.9 Update

[Raymond Bell]

I am unable to image any computer since i upgrade from 1.5.7 to 1.5.9
Ubuntu 16.04


I have tried every image and i know they worked fine with 1.5.7 Because we used them last week before the upgrade.

[Raymond Bell]

Also having replication issues. It replicates then deletes and starts replication again

[05-24-21 7:10:20 pm] | Replication already running with PID: 7566
[05-24-21 7:10:20 pm] | Replication already running with PID: 7562
[05-24-21 7:10:20 pm] | Image Name: Windows 8 32Bit 9-5-19
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] | Replication already running with PID: 13860
[05-24-21 7:10:20 pm] | Replication already running with PID: 13857
[05-24-21 7:10:20 pm] | Image Name: Win 10 64Bit 4-15-21
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] | Replication already running with PID: 6708
[05-24-21 7:10:20 pm] | Replication already running with PID: 6703
[05-24-21 7:10:20 pm] | Image Name: Title1 6-29-16
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] | Replication already running with PID: 19930
[05-24-21 7:10:20 pm] | Replication already running with PID: 19929
[05-24-21 7:10:20 pm] | Image Name: Lenovo-E15-UEFI-Lap-5-24-21
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] | Replication already running with PID: 13818
[05-24-21 7:10:20 pm] | Replication already running with PID: 13815
[05-24-21 7:10:20 pm] | Image Name: Lenovo-E15-Lap-64Bit
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] | Replication already running with PID: 5727
[05-24-21 7:10:20 pm] | Replication already running with PID: 5725
[05-24-21 7:10:20 pm] | Image Name: HS-173-64Bit
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] | Replication already running with PID: 6665
[05-24-21 7:10:20 pm] | Replication already running with PID: 6654
[05-24-21 7:10:20 pm] | Image Name: HS-125-M700-64Bit-Win10
[05-24-21 7:10:20 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:20 pm] * Attempting to perform Group -> Nodes image replication.
[05-24-21 7:10:20 pm] | There are no other members to sync to.
[05-24-21 7:10:20 pm] | Image Name: Windows 8 32Bit 9-5-19
[05-24-21 7:10:20 pm] * Not syncing Image between groups
[05-24-21 7:10:20 pm] | There are no other members to sync to.
[05-24-21 7:10:20 pm] | Image Name: Win 10 64Bit 4-15-21
[05-24-21 7:10:20 pm] * Not syncing Image between groups
[05-24-21 7:10:20 pm] | This is not the primary group.
[05-24-21 7:10:20 pm] | Not syncing Image: Title1 6-29-16
[05-24-21 7:10:20 pm] | There are no other members to sync to.
[05-24-21 7:10:20 pm] | Image Name: Lenovo-E15-UEFI-Lap-5-24-21
[05-24-21 7:10:20 pm] * Not syncing Image between groups
[05-24-21 7:10:20 pm] | There are no other members to sync to.
[05-24-21 7:10:20 pm] | Image Name: Lenovo-E15-Lap-64Bit
[05-24-21 7:10:20 pm] * Not syncing Image between groups
[05-24-21 7:10:20 pm] | There are no other members to sync to.
[05-24-21 7:10:20 pm] | Image Name: HS-173-64Bit
[05-24-21 7:10:20 pm] * Not syncing Image between groups
[05-24-21 7:10:20 pm] | There are no other members to sync to.
[05-24-21 7:10:20 pm] | Image Name: HS-125-M700-64Bit-Win10
[05-24-21 7:10:20 pm] * Not syncing Image between groups
[05-24-21 7:10:20 pm] * All files synced for this item.
[05-24-21 7:10:20 pm] # dev/postinitscripts: No need to sync fog.postinit (fog-ThinkCentre-M58p)
[05-24-21 7:10:19 pm] * All files synced for this item.
[05-24-21 7:10:19 pm] # dev/postinitscripts: No need to sync fog.postinit (Fog-Main-Storage)
[05-24-21 7:10:18 pm] | File Name: dev/postinitscripts
[05-24-21 7:10:18 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:18 pm] | Replicating postinitscripts
[05-24-21 7:10:18 pm] * All files synced for this item.
[05-24-21 7:10:18 pm] # postdownloadscripts: No need to sync fog.postdownload (fog-ThinkCentre-M58p)
[05-24-21 7:10:18 pm] * All files synced for this item.
[05-24-21 7:10:18 pm] # postdownloadscripts: No need to sync fog.postdownload (Fog-Main-Storage)
[05-24-21 7:10:11 pm] | File Name: postdownloadscripts
[05-24-21 7:10:11 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:10:11 pm] | Replicating postdownloadscripts
[05-24-21 7:10:11 pm] * Attempting to perform Group -> Group image replication.
[05-24-21 7:10:11 pm] * We are node ID: 18. We are node name: fog-GX620-K2
[05-24-21 7:10:11 pm] * We are group ID: 1. We are group name: gsdfog
[05-24-21 7:10:11 pm] * Starting Image Replication.
[05-24-21 7:01:11 pm] | Replication already running with PID: 7566
[05-24-21 7:01:11 pm] | Replication already running with PID: 7562
[05-24-21 7:01:11 pm] | Image Name: Windows 8 32Bit 9-5-19
[05-24-21 7:01:11 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:01:11 pm] | Started sync for Image Win 10 64Bit 4-15-21 - Resource id #10070
[05-24-21 7:01:11 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file /opt/fog/log/fogreplicator.Win 10 64Bit 4-15-21.transfer.fog-ThinkCentre-M58p.log;set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win1064Bit4-15-21" "/images/Win1064Bit4-15-21"; exit' -u fogproject,[Protected] 10.24.28.17
[05-24-21 7:01:10 pm] # Win 10 64Bit 4-15-21: Deleting remote file d1p2.img
[05-24-21 7:01:10 pm] # Win 10 64Bit 4-15-21: File size mismatch - d1p2.img: -1469040948 != 50070566604
[05-24-21 7:01:09 pm] # Win 10 64Bit 4-15-21: No need to sync d1p1.img (fog-ThinkCentre-M58p)
[05-24-21 7:01:08 pm] # Win 10 64Bit 4-15-21: No need to sync d1.partitions (fog-ThinkCentre-M58p)
[05-24-21 7:01:08 pm] # Win 10 64Bit 4-15-21: No need to sync d1.original.swapuuids (fog-ThinkCentre-M58p)
[05-24-21 7:01:08 pm] # Win 10 64Bit 4-15-21: No need to sync d1.original.fstypes (fog-ThinkCentre-M58p)
[05-24-21 7:01:08 pm] # Win 10 64Bit 4-15-21: No need to sync d1.minimum.partitions (fog-ThinkCentre-M58p)
[05-24-21 7:01:08 pm] # Win 10 64Bit 4-15-21: No need to sync d1.mbr (fog-ThinkCentre-M58p)
[05-24-21 7:01:08 pm] # Win 10 64Bit 4-15-21: No need to sync d1.fixed_size_partitions (fog-ThinkCentre-M58p)
[05-24-21 7:01:07 pm] | Started sync for Image Win 10 64Bit 4-15-21 - Resource id #10005
[05-24-21 7:01:07 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file /opt/fog/log/fogreplicator.Win 10 64Bit 4-15-21.transfer.Fog-Main-Storage.log;set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Win1064Bit4-15-21" "/images/Win1064Bit4-15-21"; exit' -u fogproject,[Protected] 10.24.32.232
[05-24-21 7:01:07 pm] # Win 10 64Bit 4-15-21: Deleting remote file d1p2.img
[05-24-21 7:01:07 pm] # Win 10 64Bit 4-15-21: File size mismatch - d1p2.img: -1469040948 != 50070566604
[05-24-21 7:01:07 pm] # Win 10 64Bit 4-15-21: No need to sync d1p1.img (Fog-Main-Storage)
[05-24-21 7:00:54 pm] # Win 10 64Bit 4-15-21: No need to sync d1.partitions (Fog-Main-Storage)
[05-24-21 7:00:54 pm] # Win 10 64Bit 4-15-21: No need to sync d1.original.swapuuids (Fog-Main-Storage)
[05-24-21 7:00:54 pm] # Win 10 64Bit 4-15-21: No need to sync d1.original.fstypes (Fog-Main-Storage)
[05-24-21 7:00:53 pm] # Win 10 64Bit 4-15-21: No need to sync d1.minimum.partitions (Fog-Main-Storage)
[05-24-21 7:00:53 pm] # Win 10 64Bit 4-15-21: No need to sync d1.mbr (Fog-Main-Storage)
[05-24-21 7:00:52 pm] # Win 10 64Bit 4-15-21: No need to sync d1.fixed_size_partitions (Fog-Main-Storage)
[05-24-21 7:00:52 pm] | Image Name: Win 10 64Bit 4-15-21
[05-24-21 7:00:52 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:52 pm] | Replication already running with PID: 6708
[05-24-21 7:00:52 pm] | Replication already running with PID: 6703
[05-24-21 7:00:52 pm] | Image Name: Title1 6-29-16
[05-24-21 7:00:52 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:52 pm] | Replication already running with PID: 19930
[05-24-21 7:00:52 pm] | Replication already running with PID: 19929
[05-24-21 7:00:52 pm] | Image Name: Lenovo-E15-UEFI-Lap-5-24-21
[05-24-21 7:00:52 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:52 pm] | Started sync for Image Lenovo-E15-Lap-64Bit - Resource id #9915
[05-24-21 7:00:52 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file /opt/fog/log/fogreplicator.Lenovo-E15-Lap-64Bit.transfer.fog-ThinkCentre-M58p.log;set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Lenovo-E15-Lap-64Bit" "/images/Lenovo-E15-Lap-64Bit"; exit' -u fogproject,[Protected] 10.24.28.17
[05-24-21 7:00:52 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1p3.img (fog-ThinkCentre-M58p)
[05-24-21 7:00:47 pm] # Lenovo-E15-Lap-64Bit: Deleting remote file d1p2.img
[05-24-21 7:00:47 pm] # Lenovo-E15-Lap-64Bit: File size mismatch - d1p2.img: -2109178658 != 49430428894
[05-24-21 7:00:47 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1p1.img (fog-ThinkCentre-M58p)
[05-24-21 7:00:46 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1.partitions (fog-ThinkCentre-M58p)
[05-24-21 7:00:46 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1.mbr (fog-ThinkCentre-M58p)
[05-24-21 7:00:45 pm] | Started sync for Image Lenovo-E15-Lap-64Bit - Resource id #9871
[05-24-21 7:00:45 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file /opt/fog/log/fogreplicator.Lenovo-E15-Lap-64Bit.transfer.Fog-Main-Storage.log;set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Lenovo-E15-Lap-64Bit" "/images/Lenovo-E15-Lap-64Bit"; exit' -u fogproject,[Protected] 10.24.32.232
[05-24-21 7:00:45 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1p3.img (Fog-Main-Storage)
[05-24-21 7:00:32 pm] # Lenovo-E15-Lap-64Bit: Deleting remote file d1p2.img
[05-24-21 7:00:32 pm] # Lenovo-E15-Lap-64Bit: File size mismatch - d1p2.img: -2109178658 != 49430428894
[05-24-21 7:00:32 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1p1.img (Fog-Main-Storage)
[05-24-21 7:00:20 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1.partitions (Fog-Main-Storage)
[05-24-21 7:00:20 pm] # Lenovo-E15-Lap-64Bit: No need to sync d1.mbr (Fog-Main-Storage)
[05-24-21 7:00:18 pm] | Image Name: Lenovo-E15-Lap-64Bit
[05-24-21 7:00:18 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:18 pm] | Replication already running with PID: 5727
[05-24-21 7:00:18 pm] | Replication already running with PID: 5725
[05-24-21 7:00:18 pm] | Image Name: HS-173-64Bit
[05-24-21 7:00:18 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:18 pm] | Replication already running with PID: 6665
[05-24-21 7:00:18 pm] | Replication already running with PID: 6654
[05-24-21 7:00:18 pm] | Image Name: HS-125-M700-64Bit-Win10
[05-24-21 7:00:18 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:18 pm] * Attempting to perform Group -> Nodes image replication.
[05-24-21 7:00:18 pm] | There are no other members to sync to.
[05-24-21 7:00:18 pm] | Image Name: Windows 8 32Bit 9-5-19
[05-24-21 7:00:18 pm] * Not syncing Image between groups
[05-24-21 7:00:18 pm] | There are no other members to sync to.
[05-24-21 7:00:18 pm] | Image Name: Win 10 64Bit 4-15-21
[05-24-21 7:00:18 pm] * Not syncing Image between groups
[05-24-21 7:00:18 pm] | This is not the primary group.
[05-24-21 7:00:18 pm] | Not syncing Image: Title1 6-29-16
[05-24-21 7:00:18 pm] | There are no other members to sync to.
[05-24-21 7:00:18 pm] | Image Name: Lenovo-E15-UEFI-Lap-5-24-21
[05-24-21 7:00:18 pm] * Not syncing Image between groups
[05-24-21 7:00:18 pm] | There are no other members to sync to.
[05-24-21 7:00:18 pm] | Image Name: Lenovo-E15-Lap-64Bit
[05-24-21 7:00:18 pm] * Not syncing Image between groups
[05-24-21 7:00:18 pm] | There are no other members to sync to.
[05-24-21 7:00:18 pm] | Image Name: HS-173-64Bit
[05-24-21 7:00:18 pm] * Not syncing Image between groups
[05-24-21 7:00:18 pm] | There are no other members to sync to.
[05-24-21 7:00:18 pm] | Image Name: HS-125-M700-64Bit-Win10
[05-24-21 7:00:18 pm] * Not syncing Image between groups
[05-24-21 7:00:18 pm] * All files synced for this item.
[05-24-21 7:00:18 pm] # dev/postinitscripts: No need to sync fog.postinit (fog-ThinkCentre-M58p)
[05-24-21 7:00:17 pm] * All files synced for this item.
[05-24-21 7:00:17 pm] # dev/postinitscripts: No need to sync fog.postinit (Fog-Main-Storage)
[05-24-21 7:00:17 pm] | File Name: dev/postinitscripts
[05-24-21 7:00:17 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:17 pm] | Replicating postinitscripts
[05-24-21 7:00:17 pm] * All files synced for this item.
[05-24-21 7:00:17 pm] # postdownloadscripts: No need to sync fog.postdownload (fog-ThinkCentre-M58p)
[05-24-21 7:00:16 pm] * All files synced for this item.
[05-24-21 7:00:16 pm] # postdownloadscripts: No need to sync fog.postdownload (Fog-Main-Storage)
[05-24-21 7:00:10 pm] | File Name: postdownloadscripts
[05-24-21 7:00:10 pm] * Found Image to transfer to 2 nodes
[05-24-21 7:00:10 pm] | Replicating postdownloadscripts
[05-24-21 7:00:10 pm] * Attempting to perform Group -> Group image replication.
[05-24-21 7:00:10 pm] * We are node ID: 18. We are node name: fog-GX620-K2
[05-24-21 7:00:10 pm] * We are group ID: 1. We are group name: gsdfog
[05-24-21 7:00:10 pm] * Starting Image Replication.
[05-24-21 6:56:44 pm] | Sync finished - Resource id #892
[05-24-21 6:56:43 pm] | Sync finished - Resource id #848
[05-24-21 6:50:27 pm] | Replication already running with PID: 7566
[05-24-21 6:50:27 pm] | Replication already running with PID: 7562
[05-24-21 6:50:27 pm] | Image Name: Windows 8 32Bit 9-5-19
[05-24-21 6:50:27 pm] * Found Image to transfer to 2 nodes
[05-24-21 6:50:27 pm] | Replication already running with PID: 2710
[05-24-21 6:50:27 pm] | Replication already running with PID: 2705
[05-24-21 6:50:27 pm] | Image Name: Win 10 64Bit 4-15-21
[05-24-21 6:50:27 pm] * Found Image to transfer to 2 nodes
[05-24-21 6:50:27 pm] | Replication already running with PID: 6708
[05-24-21 6:50:27 pm] | Replication already running with PID: 6703
[05-24-21 6:50:27 pm] | Image Name: Title1 6-29-16
[05-24-21 6:50:27 pm] * Found Image to transfer to 2 nodes
[05-24-21 6:50:27 pm] | Replication already running with PID: 19930
[05-24-21 6:50:27 pm] | Replication already running with PID: 19929
[05-24-21 6:50:27 pm] | Image Name: Lenovo-E15-UEFI-Lap-5-24-21
[05-24-21 6:50:27 pm] * Found Image to transfer to 2 nodes
[05-24-21 6:50:27 pm] | Replication already running with PID: 2519
[05-24-21 6:50:27 pm] | Replication already running with PID: 2457
[05-24-21 6:50:27 pm] | Image Name: Lenovo-E15-Lap-64Bit
[05-24-21 6:50:27 pm] * Found Image to transfer to 2 nodes
[05-24-21 6:50:27 pm] | Replication already running with PID: 5727
[05-24-21 6:50:27 pm] | Replication already running with PID: 5725
[05-24-21 6:50:27 pm] | Image Name: HS-173-64Bit
[05-24-21 6:50:26 pm] * Found Image to transfer to 2 nodes
[05-24-21 6:50:26 pm] | Replication already running with PID: 6665

[Sebastian Roth]

@Raymond-Bell This somehow sounds like FOS is not able to properly decompress the image file (done on the fly through a pipe). I suppose you did not change any image settings (e.g. compression algorithm) when updating, right?

Do you have enough free space on the drive where you keep your images to do an extraction test?

cd /images
cp Win1064Bit4-15-21/d1p2.img test_extract.img.gz
file test_extract.img.gz
gunzip test_extract.img.gz
test_extract.img

See if the gunzip runs all the way to the end and post output of the commands here.

About replication: Please open a new topic on this as it’s just causing confusion and missunderstanding to discuss two issues in one topic.

[Raymond Bell]

@sebastian-roth said in Unable to Image Since 1.5.9 Update:

test_extract.img

I know the image is fine because it worked fine when on 1.5.7

fog@fog-GX620-K2:/images$ df -h
Filesystem      Size  Used Avail Use% Mounted on
udev            1.8G     0  1.8G   0% /dev
tmpfs           353M  5.7M  347M   2% /run
/dev/sda1       458G  311G  124G  72% /
tmpfs           1.8G  128K  1.8G   1% /dev/shm
tmpfs           5.0M  4.0K  5.0M   1% /run/lock
tmpfs           1.8G     0  1.8G   0% /sys/fs/cgroup
cgmfs           100K     0  100K   0% /run/cgmanager/fs
tmpfs           353M   68K  353M   1% /run/user/1000
fog@fog-GX620-K2:/images$ cp Win1064Bit4-15-21/d1p2.img test_extract.img.gz
fog@fog-GX620-K2:/images$ sudo service FOGImageReplicator stop
[sudo] password for fog:
fog@fog-GX620-K2:/images$ gunzip test_extract.img.gz

gzip: test_extract.img.gz: invalid compressed data--crc error

[Sebastian Roth]

@Raymond-Bell Please run this command as well and post output here: file test_extract.img.gz

[Raymond Bell]

@sebastian-roth
So i tried another image also smaller one lol and same thing

fog@fog-GX620-K2:/images$ cp Windows832Bit9-5-19/d1p2.img test_extract.img.gz                                                             
fog@fog-GX620-K2:/images$ gunzip test_extract.img.gz

gzip: test_extract.img.gz: invalid compressed data--crc error
fog@fog-GX620-K2:/images$ file test_extract.img.gz
test_extract.img.gz: gzip compressed data, last modified: Thu Sep  5 15:39:05 20                                                          19, from Unix

[Raymond Bell]

@sebastian-roth Checked on the storage node that was giving issues and it done fine i am going to just move everything to new master SN and test

fog@Fog-Main-Storage:/images$ cp Win1064Bit4-15-21/d1p2.img test_extract.img.gz
fog@Fog-Main-Storage:/images$ file test_extract.img.gz
test_extract.img.gz: gzip compressed data, last modified: Thu Apr 15 12:45:14 2021, from Unix, original size modulo 2^32 3448112244 gzip compressed data, reserved method, ASCII, has CRC, extra field, has comment, encrypted, from FAT filesystem (MS-DOS, OS/2, NT), original size modulo 2^32 3448112244
fog@Fog-Main-Storage:/images$ gunzip test_extract.img.gz