storage node sha512sum at 100% CPU/HDD usage
-
@sebastian-roth here the results
du --version du (GNU coreutils) 8.2sha512sum --version sha512sum (GNU coreutils) 8.21du -b /images/pbu_win7_19042018/d1p2.img /images/sojus_win10_09012018/d1p2.img
91071384023 /images/pbu_win7_19042018/d1p2.img 90351730508 /images/sojus_win10_09012018/d1p2.imgls -al /images/pbu_win7_19042018/d1p2.img /images/sojus_win10_09012018/d1p2.img
-rwxr-xr-x 1 fog fog 91071384023 Apr 25 11:05 /images/pbu_win7_19042018/d1p2.img -rwxr-xr-x 1 fog fog 90351730508 Apr 25 11:24 /images/sojus_win10_09012018/d1p2.imgAfter waiting a while today (I started the node in the morning) now there are about 5 sha512sum processes
These sha512sum are blocking the website on the master. Timeout 504
Will shutdown the node overnight.31667 3364 sh -c sha512sum '/images/sojus_win10_09012018/d1p2.img' | awk '{print $1}' 3364 3365 sha512sum /images/sojus_win10_09012018/d1p2.img 26029 4053 sh -c sha512sum '/images/sojus_win10_09012018/d1p2.img' | awk '{print $1}' 4053 4054 sha512sum /images/sojus_win10_09012018/d1p2.img 3462 4295 sh -c sha512sum '/images/sojus_win7_20042018/d1p2.img' | awk '{print $1}' 4295 4296 sha512sum /images/sojus_win7_20042018/d1p2.img 22534 4548 sh -c sha512sum '/images/sojus_win7_20042018/d1p2.img' | awk '{print $1}' 4548 4549 sha512sum /images/sojus_win7_20042018/d1p2.img 14808 5149 sh -c sha512sum '/images/sojus_win7_26042018/d1p2.img' | awk '{print $1}' 5149 5150 sha512sum /images/sojus_win7_26042018/d1p2.img -
@Tom-Elliott Do you have an idea why the size check wouldn’t work?
-
@sebastian-roth if I remember correctly if the node only has ftp, say the node is a nas, it will attempt via ftp to get the hash
-
Here is a copy from the fogreplicator.log. Maybe this helps
[04-30-18 1:25:42 pm] ================================== === ==== ===== ==== === ========= == === == === === ======== ==== == ==== === === ======== ==== == ========= === ==== ==== == ========= === ======== ==== == === === === ======== ==== == ==== === === ========= == === == === === ========== ===== ==== ================================== ===== Free Opensource Ghost ====== ================================== ============ Credits ============= = https://fogproject.org/Credits = ================================== == Released under GPL Version 3 == ================================== [04-30-18 1:25:42 pm] Interface Ready with IP Address: 127.0.0.1 [04-30-18 1:25:42 pm] Interface Ready with IP Address: 127.0.1.1 [04-30-18 1:25:42 pm] Interface Ready with IP Address: IPADRESS [04-30-18 1:25:42 pm] Interface Ready with IP Address: HOSTNAME [04-30-18 1:25:42 pm] * Starting ImageReplicator Service [04-30-18 1:25:42 pm] * Checking for new items every 600 seconds [04-30-18 1:25:42 pm] * Starting service loop [04-30-18 1:25:42 pm] * Starting Image Replication. [04-30-18 1:25:42 pm] * We are group ID: 1. We are group name: default [04-30-18 1:25:42 pm] * We are node ID: 1. We are node name: fog [04-30-18 1:25:42 pm] * Attempting to perform Group -> Group image replication. [04-30-18 1:25:42 pm] | Replicating postdownloadscripts [04-30-18 1:25:42 pm] * Found Image to transfer to 1 node [04-30-18 1:25:42 pm] | File Name: postdownloadscripts [04-30-18 1:25:43 pm] | postdownloadscripts: No need to sync fog.postdownload file to fognode [04-30-18 1:25:43 pm] | 233 0 /images/postdownloadscripts/fog.postdownload ftp://XXX@IPADRESS/images/postdownloadscripts/fog.postdownload [04-30-18 1:25:43 pm] | Files do not match. [04-30-18 1:25:43 pm] * Deleting remote file: /images/postdownloadscripts/fog.postdownload [04-30-18 1:25:43 pm] * Starting Sync Actions [04-30-18 1:25:43 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator..transfer.fognode.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/postdownloadscripts" "/images/postdownloadscripts"; exit' -u fog,[Protected] IPADRESS [04-30-18 1:25:43 pm] * Started sync for Image postdownloadscripts [04-30-18 1:25:43 pm] | Replicating postinitscripts [04-30-18 1:25:43 pm] * Found Image to transfer to 1 node [04-30-18 1:25:43 pm] | File Name: dev/postinitscripts [04-30-18 1:25:43 pm] | dev/postinitscripts: No need to sync fog.postinit file to fognode [04-30-18 1:25:44 pm] | 249 0 /images/dev/postinitscripts/fog.postinit ftp://XXX@IPADRESS/images/dev/postinitscripts/fog.postinit [04-30-18 1:25:44 pm] | Files do not match. [04-30-18 1:25:44 pm] * Deleting remote file: /images/dev/postinitscripts/fog.postinit [04-30-18 1:25:44 pm] * Starting Sync Actions [04-30-18 1:25:44 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator..transfer.fognode.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/dev/postinitscripts" "/images/dev/postinitscripts"; exit' -u fog,[Protected] IPADRESS [04-30-18 1:25:44 pm] * Started sync for Image dev/postinitscripts [04-30-18 1:25:44 pm] * Not syncing Image between groups [04-30-18 1:25:44 pm] | Image Name: Dell_Default_Win10 [04-30-18 1:25:44 pm] | There are no other members to sync to. [04-30-18 1:25:44 pm] * Not syncing Image between groups [04-30-18 1:25:44 pm] | Image Name: pbu_win7_19042018 [04-30-18 1:25:44 pm] | There are no other members to sync to. [04-30-18 1:25:44 pm] * Not syncing Image between groups [04-30-18 1:25:44 pm] | Image Name: sojus_win10_09012018 [04-30-18 1:25:44 pm] | There are no other members to sync to. [04-30-18 1:25:44 pm] * Not syncing Image between groups [04-30-18 1:25:44 pm] | Image Name: sojus_win7_20042018 [04-30-18 1:25:44 pm] | There are no other members to sync to. [04-30-18 1:25:44 pm] * Not syncing Image between groups [04-30-18 1:25:44 pm] | Image Name: sojus_win7_26042018 [04-30-18 1:25:44 pm] | There are no other members to sync to. [04-30-18 1:25:44 pm] * Attempting to perform Group -> Nodes image replication. [04-30-18 1:25:44 pm] * Found Image to transfer to 1 node [04-30-18 1:25:44 pm] | Image Name: Dell_Default_Win10 [04-30-18 1:25:44 pm] | Dell_Default_Win10: No need to sync d1.fixed_size_partitions file to fognode [04-30-18 1:25:44 pm] | 5 0 /images/Dell_Win10/d1.fixed_size_partitions ftp://XXX@IPADRESS/images/Dell_Win10/d1.fixed_size_partitions [04-30-18 1:25:44 pm] | Files do not match. [04-30-18 1:25:44 pm] * Deleting remote file: /images/Dell_Win10/d1.fixed_size_partitions [04-30-18 1:25:44 pm] | 1048576 0 /images/Dell_Win10/d1.mbr ftp://XXX@IPADRESS/images/Dell_Win10/d1.mbr [04-30-18 1:25:44 pm] | Files do not match. [04-30-18 1:25:44 pm] * Deleting remote file: /images/Dell_Win10/d1.mbr [04-30-18 1:25:44 pm] | 1048576 0 /images/Dell_Win10/d1.mbr ftp://XXX@IPADRESS/images/Dell_Win10/d1.mbr [04-30-18 1:25:44 pm] | Files do not match. [04-30-18 1:25:44 pm] * Deleting remote file: /images/Dell_Win10/d1.mbr [04-30-18 1:25:44 pm] | 839 0 /images/Dell_Win10/d1.minimum.partitions ftp://XXX@IPADRESS/images/Dell_Win10/d1.minimum.partitions [04-30-18 1:25:44 pm] | Files do not match. [04-30-18 1:25:44 pm] * Deleting remote file: /images/Dell_Win10/d1.minimum.partitions [04-30-18 1:25:45 pm] | 839 0 /images/Dell_Win10/d1.minimum.partitions ftp://XXX@IPADRESS/images/Dell_Win10/d1.minimum.partitions [04-30-18 1:25:45 pm] | Files do not match. [04-30-18 1:25:45 pm] * Deleting remote file: /images/Dell_Win10/d1.minimum.partitions [04-30-18 1:25:45 pm] | 30 0 /images/Dell_Win10/d1.original.fstypes ftp://XXX@IPADRESS/images/Dell_Win10/d1.original.fstypes [04-30-18 1:25:45 pm] | Files do not match. [04-30-18 1:25:45 pm] * Deleting remote file: /images/Dell_Win10/d1.original.fstypes [04-30-18 1:25:45 pm] | 30 0 /images/Dell_Win10/d1.original.fstypes ftp://XXX@IPADRESS/images/Dell_Win10/d1.original.fstypes [04-30-18 1:25:45 pm] | Files do not match. [04-30-18 1:25:45 pm] * Deleting remote file: /images/Dell_Win10/d1.original.fstypes [04-30-18 1:25:45 pm] | Dell_Default_Win10: No need to sync d1.original.swapuuids file to fognode [04-30-18 1:25:45 pm] | Dell_Default_Win10: No need to sync d1.original.swapuuids file to fognode [04-30-18 1:25:45 pm] | 283 0 /images/Dell_Win10/d1.original.uuids ftp://XXX@IPADRESS/images/Dell_Win10/d1.original.uuids [04-30-18 1:25:45 pm] | Files do not match. [04-30-18 1:25:45 pm] * Deleting remote file: /images/Dell_Win10/d1.original.uuids [04-30-18 1:25:45 pm] | 283 0 /images/Dell_Win10/d1.original.uuids ftp://XXX@IPADRESS/images/Dell_Win10/d1.original.uuids [04-30-18 1:25:45 pm] | Files do not match. [04-30-18 1:25:45 pm] * Deleting remote file: /images/Dell_Win10/d1.original.uuids [04-30-18 1:25:45 pm] | 833 0 /images/Dell_Win10/d1.partitions ftp://XXX@IPADRESS/images/Dell_Win10/d1.partitions [04-30-18 1:25:45 pm] | Files do not match. [04-30-18 1:25:45 pm] * Deleting remote file: /images/Dell_Win10/d1.partitions [04-30-18 1:25:46 pm] | 833 0 /images/Dell_Win10/d1.partitions ftp://XXX@IPADRESS/images/Dell_Win10/d1.partitions [04-30-18 1:25:46 pm] | Files do not match. [04-30-18 1:25:46 pm] * Deleting remote file: /images/Dell_Win10/d1.partitions [04-30-18 1:25:46 pm] | 10829637 0 /images/Dell_Win10/d1p1.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p1.img [04-30-18 1:25:46 pm] | Files do not match. [04-30-18 1:25:46 pm] * Deleting remote file: /images/Dell_Win10/d1p1.img [04-30-18 1:25:46 pm] | 10829637 0 /images/Dell_Win10/d1p1.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p1.img [04-30-18 1:25:46 pm] | Files do not match. [04-30-18 1:25:46 pm] * Deleting remote file: /images/Dell_Win10/d1p1.img [04-30-18 1:25:46 pm] | 1503016 0 /images/Dell_Win10/d1p2.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p2.img [04-30-18 1:25:46 pm] | Files do not match. [04-30-18 1:25:46 pm] * Deleting remote file: /images/Dell_Win10/d1p2.img [04-30-18 1:25:46 pm] | 1503016 0 /images/Dell_Win10/d1p2.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p2.img [04-30-18 1:25:46 pm] | Files do not match. [04-30-18 1:25:46 pm] * Deleting remote file: /images/Dell_Win10/d1p2.img [04-30-18 1:33:11 pm] | 11452366679 0 /images/Dell_Win10/d1p3.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p3.img [04-30-18 1:33:11 pm] | Files do not match. [04-30-18 1:33:11 pm] * Deleting remote file: /images/Dell_Win10/d1p3.img [04-30-18 1:33:44 pm] | 11452366679 0 /images/Dell_Win10/d1p3.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p3.img [04-30-18 1:33:44 pm] | Files do not match. [04-30-18 1:33:44 pm] * Deleting remote file: /images/Dell_Win10/d1p3.img [04-30-18 1:33:47 pm] | 400428853 0 /images/Dell_Win10/d1p4.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p4.img [04-30-18 1:33:47 pm] | Files do not match. [04-30-18 1:33:47 pm] * Deleting remote file: /images/Dell_Win10/d1p4.img [04-30-18 1:33:48 pm] | 400428853 0 /images/Dell_Win10/d1p4.img ftp://XXX@IPADRESS/images/Dell_Win10/d1p4.img [04-30-18 1:33:48 pm] | Files do not match. [04-30-18 1:33:48 pm] * Deleting remote file: /images/Dell_Win10/d1p4.img [04-30-18 1:33:48 pm] * Starting Sync Actions [04-30-18 1:33:48 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.Dell_Default_Win10.transfer.fognode.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/Dell_Win10" "/images/Dell_Win10"; exit' -u fog,[Protected] IPADRESS [04-30-18 1:33:48 pm] * Started sync for Image Dell_Default_Win10 [04-30-18 1:33:48 pm] * Found Image to transfer to 1 node [04-30-18 1:33:48 pm] | Image Name: pbu_win7_19042018 [04-30-18 1:33:49 pm] | pbu_win7_19042018: No need to sync d1.fixed_size_partitions file to fognode [04-30-18 1:33:49 pm] | 3 0 /images/pbu_win7_19042018/d1.fixed_size_partitions ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.fixed_size_partitions [04-30-18 1:33:49 pm] | Files do not match. [04-30-18 1:33:49 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.fixed_size_partitions [04-30-18 1:33:49 pm] | 1048576 0 /images/pbu_win7_19042018/d1.mbr ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.mbr [04-30-18 1:33:49 pm] | Files do not match. [04-30-18 1:33:49 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.mbr [04-30-18 1:33:49 pm] | 1048576 0 /images/pbu_win7_19042018/d1.mbr ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.mbr [04-30-18 1:33:49 pm] | Files do not match. [04-30-18 1:33:49 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.mbr [04-30-18 1:33:49 pm] | 190 0 /images/pbu_win7_19042018/d1.minimum.partitions ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.minimum.partitions [04-30-18 1:33:49 pm] | Files do not match. [04-30-18 1:33:49 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.minimum.partitions [04-30-18 1:33:50 pm] | 190 0 /images/pbu_win7_19042018/d1.minimum.partitions ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.minimum.partitions [04-30-18 1:33:50 pm] | Files do not match. [04-30-18 1:33:50 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.minimum.partitions [04-30-18 1:33:50 pm] | 15 0 /images/pbu_win7_19042018/d1.original.fstypes ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.original.fstypes [04-30-18 1:33:50 pm] | Files do not match. [04-30-18 1:33:50 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.original.fstypes [04-30-18 1:33:50 pm] | 15 0 /images/pbu_win7_19042018/d1.original.fstypes ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.original.fstypes [04-30-18 1:33:50 pm] | Files do not match. [04-30-18 1:33:50 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.original.fstypes [04-30-18 1:33:50 pm] | pbu_win7_19042018: No need to sync d1.original.swapuuids file to fognode [04-30-18 1:33:50 pm] | pbu_win7_19042018: No need to sync d1.original.swapuuids file to fognode [04-30-18 1:33:50 pm] | 190 0 /images/pbu_win7_19042018/d1.partitions ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.partitions [04-30-18 1:33:50 pm] | Files do not match. [04-30-18 1:33:50 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.partitions [04-30-18 1:33:50 pm] | 190 0 /images/pbu_win7_19042018/d1.partitions ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1.partitions [04-30-18 1:33:50 pm] | Files do not match. [04-30-18 1:33:50 pm] * Deleting remote file: /images/pbu_win7_19042018/d1.partitions [04-30-18 1:33:51 pm] | 7931434 0 /images/pbu_win7_19042018/d1p1.img ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1p1.img [04-30-18 1:33:51 pm] | Files do not match. [04-30-18 1:33:51 pm] * Deleting remote file: /images/pbu_win7_19042018/d1p1.img [04-30-18 1:33:51 pm] | 7931434 0 /images/pbu_win7_19042018/d1p1.img ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1p1.img [04-30-18 1:33:51 pm] | Files do not match. [04-30-18 1:33:51 pm] * Deleting remote file: /images/pbu_win7_19042018/d1p1.img [04-30-18 1:38:51 pm] | 91071384023 0 /images/pbu_win7_19042018/d1p2.img ftp://XXX@IPADRESS/images/pbu_win7_19042018/d1p2.img [04-30-18 1:38:51 pm] | Files do not match. [04-30-18 1:38:51 pm] * Deleting remote file: /images/pbu_win7_19042018/d1p2.imgThe last entry “/images/pbu_win7_19042018/d1p2.img” is now being checked by sha512sum.
-
@mp12 based on what I’m seeing the hash is working properly it’s just not finding the right file size. Unless you have two nodes being replicated to?
The lines showing the file name with the numbers is the file sizes it’s seeing. First one is the masternodes and the second is the remote nodes. All seem to show the file size of the remote as being 0.
-
I guess I need to see / understand how your nodes are setup. Are they all regular storage nodes (installed just like a server/node would be) or are they nas or other type of custom layout.
Knowing this information will certainly help me find the problem and possibly a solution if they are normal install nodes.
-
@tom-elliott just normal installed. One master server and one storage node. Maybe this is the mistake? Some time ago we had the location plugin enabled. But the problem existed before, I guess. We had a secound storage node some time ago, which I removed from the group. Both (all) running as VM.
-
I did a bit of work on the fogservice in regards to getting the replication tested more appropriately. I just wanted to give you a heads up that I hadn’t forgotten about this, just been kind of busy.
If you would be so kind as to install the github
workingbranch and see if this helps out? I did a bit of work toward getting the filesize and hashes a bit more correctly as it seemed things were in a double check before (which would explain maxing out the sha512sum too). -
Thanks @Tom-Elliott. I switched to
working. Deleted all images on fog node to see if replication is working properly. I will report back tomorrow. -
The load from sha512sum process has decreased to 80% on the node. But now the master is also involved checking hash with high load at around 80%. Smaller files seem to be synced/checked properly. Bigger files obvisly do not match?
Inside the
fogreplication.logI am getting messages like this:[05-17-18 3:38:59 pm] | Image Name: xxx_win7_26042018 [05-17-18 3:39:00 pm] | xxx_win7_26042018: No need to sync d1.fixed_size_partitions file to node [05-17-18 3:39:00 pm] | xxx_win7_26042018: No need to sync d1.mbr file to node [05-17-18 3:39:00 pm] | xxx_win7_26042018: No need to sync d1.minimum.partitions file to node [05-17-18 3:39:00 pm] | xxx_win7_26042018: No need to sync d1.original.fstypes file to node [05-17-18 3:39:01 pm] | xxx_win7_26042018: No need to sync d1.original.swapuuids file to node [05-17-18 3:39:01 pm] | xxx_win7_26042018: No need to sync d1.partitions file to node [05-17-18 3:39:01 pm] | xxx_win7_26042018: No need to sync d1p1.img file to node [05-17-18 3:51:16 pm] | Files do not match on server: node [05-17-18 3:51:16 pm] | Deleting remote file: /images/xxx_win7_26042018/d1p2.img [05-17-18 3:51:16 pm] * Starting Sync Actions [05-17-18 3:51:16 pm] | CMD: lftp -e 'set xfer:log 1; set xfer:log-file "/opt/fog/log/fogreplicator.xxx_win7_26042018.transfer.node.log";set ftp:list-options -a;set net:max-retries 10;set net:timeout 30; mirror -c --parallel=20 -R --ignore-time -vvv --exclude ".srvprivate" "/images/xxx_win7_26042018" "/images/xxx_win7_26042018"; exit' -u fog,[Protected] x.x.x.xLast entry
/opt/fog/log/fogreplicator.xxx_win7_26042018.transfer.node.logis in the past. I don’t think that thed1p2.imgfile was copied to the node again. I checked theBandwidthmonitorfor 30 minutes. Nothing higher than3Mbps.2018-05-17 10:12:37 /images/xxx_win7_26042018/d1p2.img -> ftp://xxx@x.x.x.x/%2Fimages/xxx_win7_26042018/d1p2.img 0-101176680804 27.78 MiB/sSo I think that the sync/check process now only has problems with larger files.
Size ofd1p2.imgis around 95G. -
@mp12 I’m not seeing the same issue. I suppose it could be how large the files are but that still seems unlikely. Is it possible the Lftp command is stuck itself? On the transferring node you can see running lftp processes via
ps -ef|grep lftpand I’m going to guess there is none running. Maybe disk space on the receiving node is out? -
@tom-elliott there is no
lftprunning. I am having one default image that passes the check normally. The filed1p3.imgis around11G.[05-18-18 7:29:19 am] | Image Name: xxx_Default_Win10 [05-18-18 7:29:19 am] | xxx_Default_Win10: No need to sync d1.fixed_size_partitions file to node [05-18-18 7:29:19 am] | xxx_Default_Win10: No need to sync d1.mbr file to node [05-18-18 7:29:20 am] | xxx_Default_Win10: No need to sync d1.minimum.partitions file to node [05-18-18 7:29:20 am] | xxx_Default_Win10: No need to sync d1.original.fstypes file to node [05-18-18 7:29:20 am] | xxx_Default_Win10: No need to sync d1.original.swapuuids file to node [05-18-18 7:29:20 am] | xxx_Default_Win10: No need to sync d1.original.uuids file to node [05-18-18 7:29:20 am] | xxx_Default_Win10: No need to sync d1.partitions file to node [05-18-18 7:29:21 am] | xxx_Default_Win10: No need to sync d1p1.img file to node [05-18-18 7:29:21 am] | xxx_Default_Win10: No need to sync d1p2.img file to node [05-18-18 7:30:49 am] | xxx_Default_Win10: No need to sync d1p3.img file to node [05-18-18 7:30:52 am] | xxx_Default_Win10: No need to sync d1p4.img file to node [05-18-18 7:30:52 am] * All files synced for this item.Free disk space around
70G. I will move one image to free up some space and reboot both maschines. -
@mp12 Any word on this? It really seems there could be a disk usage type issue, though your free space does appear to fit the size needed for that image. Then again, if there’s other images also trying to replicate at the same time, this could pose a bit of a problem as well.
-
@tom-elliott I will set up a new node and check if something goes wrong in replication. If not I will remove the old node.
-
Any word on this @mp12? I want to nail this one down, though you already admitted that it seems a little better. Hopefully a new node will help out a bit?
Thanks for the feedback.
-
@tom-elliott
just wanted to see if things improved over the weekend. But the new node has the same problem as discribed before. I will recheck the master and try a Zstd split. -
@Tom-Elliott after replicating 492 files and waiting one night, I can say that nothing goes wrong with small files. The check of the 200M files takes 2-3 seconds. Large files are still not checked correctly. I don’t know exactly at what size the test fails. A file with 11G is checked correctly. Files from 85G lead to errors.
-
@Tom-Elliott after I noticed that you can’t distribute splitfiles via multicast, I discarded this possibility.
-
Should be solved in latest as we have re-worked the replication stuff a fair bit.
-
@Sebastian-Roth
Thanks for the reply! Did an update to 1.5.5.1 two weeks ago. Everything works fine so far!