Multi drive image reversing disks.
-
@sebastian-roth said in Multi drive image reversing disks.:
I am not sure I understand what you mean. If you capture the image from a machine that has NVMe and SATA drive it will capture the drives in the same order as it would deploy them - see my comment above on the order.
If you want to mess with the order within the image you should be able to just rename all the files.
d1.*->d2.*and vice versa.The image was captured on a virtual machine which has the correct drive order. When deploying the image, the primary drive is defaulting to the SSD vs the NVME. It’s obvious now that this is the correct order based on how linux enumerates disks however, I do need these two disks switched around.
When using your first suggestion by defining the “Host Primary Disk,” FOG throws the error:
Could not find any disks (/bin/fog.download)This occurs whether I define the “Host Primary Disk” as /dev/nvme0n1 or /dev/sda which seems odd so perhaps I have the incorrect syntax?
Lastly, I also did attempt renaming all of the files. I renamed all the d1 files to d2 and all the d2 files to d1. After this change, I receive an error when deploying that states:
Target partition size(17 MB) is smaller than source(214730 MB). Use option -C to disable size checking(Dangerous). -
@george1421 I followed all of your steps and was able to define the “Host Primary Disk” to be the /dev/nvme0n1 disk, however it fails after deploying an image due to “Could not find any disks”
The host that I am deploying to has two disks: /dev/sda and /dev/nvme0n1. I also tried setting “Host Primary Disk” to /dev/sda but I received the same error “Could not find any disks.” This seems odd because when I leave the primary disk field blank, the image deploys to /dev/sda as the primary disk by default.
-
@samdoan Will you post a screen shot of the settings you have for this target host?
If they look right, then lets setup again a target deploy to this computer with the primary disk set. You will be dropped to a fos linux command prompt. I want you to key in these commands in order and take a clear to read screen shot of it.
lsblk
cat /proc/cmdlineI think maybe something isn’t entered right or the hardware is reacting strange. If everything check out you can run imaging in single step mode by keying in
fogand then pressing enter at each break point. In the imaging program. I have a feeling there is an error just prior to the screen shot you just provided that will give us a bit better understanding of what is going on with this hardware. -
@samdoan said in Multi drive image reversing disks.:
Lastly, I also did attempt renaming all of the files. I renamed all the d1 files to d2 and all the d2 files to d1.
Sorry, my explaination might have confused you when I told you to rename d1.*. Also rename the dXpY.img files. E.g. d1p3.img -> d2p3.img
-
@sebastian-roth No apology needed, I thought that was implied and that was exactly what I did. Every reference to d1 was renamed to d2 and I still encountered that error.
-
@george1421 said in Multi drive image reversing disks.:
@samdoan Will you post a screen shot of the settings you have for this target host?
If they look right, then lets setup again a target deploy to this computer with the primary disk set. You will be dropped to a fos linux command prompt. I want you to key in these commands in order and take a clear to read screen shot of it.
lsblk
cat /proc/cmdlineI think maybe something isn’t entered right or the hardware is reacting strange. If everything check out you can run imaging in single step mode by keying in
fogand then pressing enter at each break point. In the imaging program. I have a feeling there is an error just prior to the screen shot you just provided that will give us a bit better understanding of what is going on with this hardware.Here is a screenshot of the host settings:
Here is the other requested screenshot:
[Thu Jun 10 root@fogclient ~]# lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT sda 8:0 0 465.8G 0 disk nvme0n1 259:0 0 953.9G 0 disk [Thu Jun 10 root@fogclient ~]# cat /proc/cmdline bzImage loglevel=4 initrd=init.xz root=/dev/ram0 rw ramdisk_size=275000 web=http://192.168.1.40/fog/ consoleblank=0 rootfstype=ext4 nvme_core.default_ps_max_latency_us=0 mac=84:a9:3e:6d:b0:49 ftp=192.168.1.40 storage=192.168.1.40:/images/ storageip=192.168.1.40 osid=9 irqpoll hostname=HPDEV chkdsk=0 img=WEBDEV-SYSPREP-EFI imgType=mpa imgPartitionType=all imgid=38 imgFormat=5 PIGZ_COMP=-6 fdrive=/dev/nvme0n1 hostearly=1 isdebug=yes type=downIt appears that its failing on the step “Looking for Hard Disks”
* Using Image: WEBDEV-SYSPREP-EFI * Looking for Hard Disks............................Failed * Press [Enter] key to continue ############################################################################## # # # An error has been detected! # # # ############################################################################## Init Version: 20200906 Could not find any disks (/bin/fog.download) Args Passed: Kernel variables and settings: bzImage loglevel=4 initrd=init.xz root=/dev/ram0 rw ramdisk_size=275000 web=http://192.168.1.40/fog/ consoleblank=0 rootfstype=ext4 nvme_core.default_ps_max_latency_us=0 mac=84:a9:3e:6d:b0:49 ftp=192.168.1.40 storage=192.168.1.40:/images/ storageip=192.168.1.40 osid=9 irqpoll hostname=HPDEV chkdsk=0 img=WEBDEV-SYSPREP-EFI imgType=mpa imgPartitionType=all imgid=38 imgFormat=5 PIGZ_COMP=-6 fdrive=/dev/nvme0n1 hostearly=1 isdebug=yes type=down * Press [Enter] key to continue -
@samdoan said in Multi drive image reversing disks.:
Looking for Hard Disks
Its probably failing in this section of the code: https://github.com/FOGProject/fos/blob/a46d5e9534715dad09fcfbc631ff681f4b42d208/Buildroot/board/FOG/FOS/rootfs_overlay/usr/share/fog/lib/funcs.sh#L1376
Everything connects correctly so this is not an OP misconfiguration (IMO)
-
@samdoan said in Multi drive image reversing disks.:
Target partition size(17 MB) is smaller than source(214730 MB).
I would imagine this error can only happen if partition layout files (dX.*) and image files (dXpY.img) are being mixed up somehow.
About the error when setting “Host Primary Disk”: seems like there is an issue in the code when using Multiple Disk image type.
-
@sebastian-roth said in Multi drive image reversing disks.:
@samdoan said in Multi drive image reversing disks.:
Target partition size(17 MB) is smaller than source(214730 MB).
I would imagine this error can only happen if partition layout files (dX.*) and image files (dXpY.img) are being mixed up somehow.
About the error when setting “Host Primary Disk”: seems like there is an issue in the code when using Multiple Disk image type.
I’ve gone back and double and triple checked my process for re-naming the image files. I am renaming them accurately and still receive the error Target partition size(17 MB) is smaller than source(214730 MB) in part clone when attempting to reverse the two disks by renaming.
-
@sebastian-roth So I found in addition to renaming dXpY.*, you also need to edit the dX.size files as they also reference the disk number
1:1610612736002:214748364800After making this change partclone successfully runs and is correctly deploying disk1 to /dev/sda. However after deploying disk1, the process completes without deploying disk2 to /de/nvme0n1. Is there something else I need to edit in order to tell the fog server that there’s another disk? How does fog server know that there are X number of disks in the image?
-
@samdoan said in Multi drive image reversing disks.:
So I found in addition to renaming dXpY.*, you also need to edit the dX.size files as they also reference the disk number
Ahhh, good call. This part was added later because of the random enumeration when you have two NVMe drives. I didn’t have that in mind when I told you to simply rename the files. FOS is trying to use the size information to match disk size. So even if you rename the img and partition files it still tried to match to the information found in the dX.size files.
Either edit or delete those dX.size files. If you delete the files FOS will skip the size matching and just do them in alphabetical order as mentioned before - nvme0n1 before sda.
After making this change partclone successfully runs and is correctly deploying disk1 to /dev/sda. However after deploying disk1, the process completes without deploying disk2 to /de/nvme0n1. Is there something else I need to edit in order to tell the fog server that there’s another disk? How does fog server know that there are X number of disks in the image?
FOG enumerates drives/disks using the
lsblkcommand when it boots up and should process both drives. Make sure Host Primary Disk is not set for this host. -
@sebastian-roth said in Multi drive image reversing disks.:
After making this change partclone successfully runs and is correctly deploying disk1 to /dev/sda. However after deploying disk1, the process completes without deploying disk2 to /de/nvme0n1. Is there something else I need to edit in order to tell the fog server that there’s another disk? How does fog server know that there are X number of disks in the image?
FOG enumerates drives/disks using the
lsblkcommand when it boots up and should process both drives. Make sure Host Primary Disk is not set for this host.Renaming the disks does work. I know this because I captured a new, simple image and was able to reverse the order in which the disks are deployed.
But when I try this on my real image, it’s deploying the same image to both physical disks which is weird. At the bottom you can see that /dev/sda and /dev/nvme0n1 have the same partition layout. This tells me that it’s deploying Disk1 to /dev/sda AND /dev/nvme0n1.
Debug deployment - You can see it process /dev/sda1 and /dev/sda2 but not /dev/nvmen01 - 04
Here are the raw files in the capture:
-
@samdoan said in Multi drive image reversing disks.:
This tells me that it’s deploying Disk1 to /dev/sda AND /dev/nvme0n1
I don’t think this is the case! It’s just the partition layout that was deployed to /dev/nvme0n1 on an earlier run and it’s still like that because for some reason it only deploys one disk right now.
Please check your image and host settings again. Is the image set to All Disks? Also make sure Host Primary Disk is not set for the host you deploy to.
