• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Very slow cloning speed on specific model

Scheduled Pinned Locked Moved Solved
FOG Problems
18
145
58.8k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S
    Sebastian Roth Moderator
    last edited by Dec 19, 2019, 9:59 AM

    @darkxeno Build server is back and I started a fresh 4.9.x init build. Will update here soon.

    Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

    Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

    1 Reply Last reply Reply Quote 0
    • S
      Sebastian Roth Moderator
      last edited by Dec 20, 2019, 9:03 PM

      @darkxeno @dylan123 @Middle @oleg-knysh Build is done. Anyone keen to test?

      sudo -i
      cd /var/www/html/fog/service/ipxe
      wget https://fogproject.org/kernels/bzImage-4.9.51
      wget https://fogproject.org/inits/init-4.9.x.xz
      chown apache:apache bzImage-4.9.51 init-4.9.x.xz
      

      Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

      Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

      D M 2 Replies Last reply Jan 14, 2020, 1:05 AM Reply Quote 0
      • S
        Sebastian Roth Moderator
        last edited by Dec 20, 2019, 11:57 PM

        @Quazz said:

        edit2: On the note of pigz, Buildroot provides a version these days, so we could remove the manually specified package unless we are attached to version 2.3.4 for some reason

        Don’t think we are bound to use 2.3.4 - not that I know of. I just pushed on to buildroot 2019.04.8 and their official pigz version 2.4.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        1 Reply Last reply Reply Quote 0
        • B
          bberret
          last edited by Jan 7, 2020, 7:51 PM

          I’m noticing an issue as well. We just received some HP 840 G6 laptops and they came pre-loaded with bios version 01.03.00 and I was able to image them just fine. But then I decided to upgrade one of them to bios version 01.03.04 before imaging and now the imaging process is super slow. It also looks like bios version 01.03.00 isn’t available to download. So now I’m stuck waiting for a bios update I guess. I’ve talked to HP chat and they didn’t have 01.03.00 bios available to download.

          G 1 Reply Last reply Jan 7, 2020, 8:22 PM Reply Quote 0
          • S
            Sebastian Roth Moderator
            last edited by Jan 7, 2020, 8:10 PM

            @bberret said in Very slow cloning speed on specific model:

            I’ve talked to HP chat and they didn’t have 01.03.00 bios available to download.

            Probably good to keep on asking HP (email, telephone, …) about this to make them aware of the problem.

            Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

            Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

            1 Reply Last reply Reply Quote 0
            • G
              george1421 Moderator @bberret
              last edited by george1421 Jan 7, 2020, 2:23 PM Jan 7, 2020, 8:22 PM

              @bberret Will you try something for us? In the fog configuration -> fog settings -> general settings page there is a KERNEL ARGS parameter . Will you place this value in that field nvme_core.default_ps_max_latency_us=0 and then try imaging again. You may see a warning about that variable during imaging, but ignore it. It is a spurious error that is fixed in the yet unreleased FOG v1.5.8. This settings tells the nvme drive to not go into low power mode during imaging.

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

              B 1 Reply Last reply Jan 8, 2020, 5:34 PM Reply Quote 0
              • B
                bberret @george1421
                last edited by Jan 8, 2020, 5:34 PM

                @george1421 Thanks for the quick reply. I tried what you suggested and didn’t seem to help. And now my theory with it being an issue with only bios version 01.03.00 doesn’t seem to be holding true. Just unboxed another laptop and it seems to be having that exact same issue. This issue isn’t just slow imaging, it is slow loading pretty much everything after it loads ipxe.efi file. when its trying to load bzImage file (which usually takes 1 second) it is taking 15 minutes before that file is loaded.

                G 1 Reply Last reply Jan 8, 2020, 5:46 PM Reply Quote 0
                • G
                  george1421 Moderator @bberret
                  last edited by Jan 8, 2020, 5:46 PM

                  @bberret So two changes (test) come to mind.

                  1. Does this computer have a bios mode? If so, as a test change it to bios mode to see if the bzImage and init.xz transfer speeds are normal.

                  2. Do you have an add on card (pci-e) that has pxe booting capabilities. The idea is to remove the onboard pxe firmware and network card. See if bzImage transfer is normal or not.

                  3. I thought about booting FOS linux from a usb stick, but you are telling me that imaging is not fast too. If imaging was fast but pxe booting was slow then I might point to iPXE as being a problem. But in this case booting for a usb stick will not mask/test the issue.

                  Off the top of my head I would either say network adapter or pxe / uefi firmware.

                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                  J 1 Reply Last reply Jan 8, 2020, 7:59 PM Reply Quote 0
                  • J
                    Junkhacker Developer @george1421
                    last edited by Jan 8, 2020, 7:59 PM

                    @george1421 one option for eliminating the network card as the source of the problem (not completely, but mostly) is to boot with a usb adapter plugged in as well, both plugged into the network, and after ipxe loads unplug the network from the built in adapter.

                    signature:
                    Junkhacker
                    We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                    1 Reply Last reply Reply Quote 1
                    • D
                      dylan123 @Sebastian Roth
                      last edited by Jan 14, 2020, 1:05 AM

                      @Sebastian-Roth said in Very slow cloning speed on specific model:

                      @darkxeno @dylan123 @Middle @oleg-knysh Build is done. Anyone keen to test?

                      sudo -i
                      cd /var/www/html/fog/service/ipxe
                      wget https://fogproject.org/kernels/bzImage-4.9.51
                      wget https://fogproject.org/inits/init-4.9.x.xz
                      chown apache:apache bzImage-4.9.51 init-4.9.x.xz
                      

                      Thanks @Sebastian-Roth , I’ve just got back from leave. Ended up just manually setting up the device and don’t have another one to test with unfortunately. If I do, I’ll give this a test and see if it makes a difference. Thanks again for your assistance.

                      1 Reply Last reply Reply Quote 0
                      • M
                        Middle @Sebastian Roth
                        last edited by Jan 15, 2020, 10:13 AM

                        @Sebastian-Roth said in Very slow cloning speed on specific model:

                        @darkxeno @dylan123 @Middle @oleg-knysh Build is done. Anyone keen to test?

                        sudo -i
                        cd /var/www/html/fog/service/ipxe
                        wget https://fogproject.org/kernels/bzImage-4.9.51
                        wget https://fogproject.org/inits/init-4.9.x.xz
                        chown apache:apache bzImage-4.9.51 init-4.9.x.xz
                        

                        Sorry for the late update. This didn’t change anything I’m afraid. I’ve been a little reluctant in updating during testing as the results I’ve had have been very inconsistent. I can’t explain it, but the first deployment of the day works without issues - it’s happened too many times now to be a coincidence.

                        I’ve currently changed back to the master branch to clean-up the server of the test kernels/inits we’ve been using. The only consistent deploy I can get is using the init_partclone.xy that @Quazz posted on the 5th Dec, entering debug mode and running the following:

                        nvme set-feature -f 0x0c -v=0 /dev/nvme0
                        

                        This works every time. The average transfer speed is around 3GB/min, rather than >10GB/min that I get from the master branch build when it randomly works, but that’s good enough for us as the result is consistent and the image is small anyway.

                        This is google drive link Quazz provided for the init: https://drive.google.com/open?id=1u_HuN5NSpzb7YmQBAsrzDELteNmlWUWU

                        I’ve had a look at the post init script option to see if I can automate this rather than entering debug, but I’m not really sure what I’m doing here.

                        Q 1 Reply Last reply Jan 15, 2020, 10:29 AM Reply Quote 0
                        • Q
                          Quazz Moderator @Middle
                          last edited by Jan 15, 2020, 10:29 AM

                          @Middle Can you try the KERNEL ARGS George suggested?

                          nvme_core.default_ps_max_latency_us=0

                          M 1 Reply Last reply Jan 15, 2020, 10:42 AM Reply Quote 0
                          • M
                            Middle @Quazz
                            last edited by Jan 15, 2020, 10:42 AM

                            @Quazz We’ve tried that as well but doesn’t help. I think it’s also included in the Dev branch by default now which we’re tried.

                            Q 1 Reply Last reply Jan 15, 2020, 12:17 PM Reply Quote 0
                            • Q
                              Quazz Moderator @Middle
                              last edited by Quazz Jan 15, 2020, 6:17 AM Jan 15, 2020, 12:17 PM

                              @Middle That’s really unfortunate. We were hoping that would be sufficient for all usecases, but unfortunately it seems that in some cases that’s not true.

                              We also can’t disable it globally since that would hinder performance for a lot of users that don’t have this issue…

                              You can try setting the command in postinit scripts. (/images/dev/postinitscripts/fog.postinit)

                              The command should execute after the init has loaded and before FOG starts its magic.

                              M 1 Reply Last reply Jan 15, 2020, 4:49 PM Reply Quote 0
                              • M
                                Middle @Quazz
                                last edited by Middle Jan 15, 2020, 10:58 AM Jan 15, 2020, 4:49 PM

                                @Quazz That’s great - setting the nvme command in the fog.postinit file and making the init-partclone.xz you created the system wide default means we can now just pxe boot and select deploy image without issues. Huge improvement. Many thanks.

                                Edit: for clarification, it’s the nvme set-feature -f 0x0c -v=0 /dev/nvme0 command I’m using, not the latency one.

                                N 1 Reply Last reply Jan 24, 2020, 5:39 PM Reply Quote 0
                                • N
                                  nrg @Middle
                                  last edited by nrg Jan 24, 2020, 12:12 PM Jan 24, 2020, 5:39 PM

                                  @Middle said in Very slow cloning speed on specific model:

                                  nvme set-feature -f 0x0c -v=0 /dev/nvme0

                                  so the solution was to put that under fog general settings?? I tried and it didn’t work on my end.

                                  I’m also facing the same issue. I have 5 hp 840 g6 and only 4 of them has this issue. One of them does not have this issue. They’re all identical laptop in hardware and software. even the bios is the same.

                                  I can fog to the rest of my 800 computers perfectly fine at normal speed. It’s just these new G6.

                                  disk drive: Samsung MZVLB256HAHQ-000H1
                                  NIC: Intel Ethernet I219-LM
                                  bios ver: R70 Ver. 01.03.04 11/06/2019

                                  FOG server: 1.5.6 on ubuntu 18.04.3 lts

                                  M 1 Reply Last reply Jan 27, 2020, 10:33 AM Reply Quote 0
                                  • M
                                    Middle @nrg
                                    last edited by Jan 27, 2020, 10:33 AM

                                    @nrg The following is based on using Fog 1.5.7 master branch on CentOS.

                                    Are you using the updated init_partclone.xz? Here’s the link:

                                    https://drive.google.com/open?id=1u_HuN5NSpzb7YmQBAsrzDELteNmlWUWU

                                    You need to copy this to /var/www/html/fog/service/ipxe and then run chown apache:apache init_partclone.xz to update file permissions.

                                    We only have G6 laptops for imaging now, so I made this the default init under Fog Config > Fog Settings > TFTP Server > PXE BOOT IMAGE > enter init_partclone.xz. Alternatively, if you register hosts, you can add it to the host init section for just the G6 laptops.

                                    You then have to edit the file /images/dev/postinitscripts/fog.postinit and add the line nvme set-feature -f 0x0c -v=0 /dev/nvme0

                                    hermanH 1 Reply Last reply Aug 30, 2023, 6:35 PM Reply Quote 1
                                    • B
                                      bberret
                                      last edited by Jan 28, 2020, 10:36 PM

                                      We have had some success with using the snponly.efi boot file instead of ipxe.efi. Also updating to fog version 1.5.7.100 might have helped as well. I did notice today HP came out with a newer bios verison for the HP 840 G6 model. Bios version 01.04.02 which seems to have a lot of bug fixes. I might give this a try tomorrow but I figured someone else might want to try it out before me and let me know how it goes.

                                      1 Reply Last reply Reply Quote 1
                                      • I
                                        itsupport @darkxeno
                                        last edited by Apr 9, 2021, 10:12 AM

                                        @darkxeno We have the same with Dell Ultra 7090
                                        Updated the Kernal latest version of FOG stable
                                        All our other Machines image in a few mins with SSD’s in them HDD’s 10 mins

                                        These new ones take hrs which is not right
                                        Doing one now and its like 200-300 mbps normally running at 1gig

                                        Tested all our cables and like earlier other older machines like Latitude 5480 5490 5400
                                        Desktops Opitplex 3020 3010 3050 3060 are all fine

                                        W 1 Reply Last reply May 24, 2021, 6:27 PM Reply Quote 0
                                        • S
                                          Sebastian Roth Moderator
                                          last edited by Apr 9, 2021, 5:13 PM

                                          @itsupport This topic is fairly old and huge! No idea if this even talked about the DELL Ultra 7090 you seem to see an issue with. Please open your own topic and post details there (exact FOG and kernel versions and so on). Always good to post a link as reference to this topic as well.

                                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                          1 Reply Last reply Reply Quote 0
                                          • 1
                                          • 2
                                          • 3
                                          • 4
                                          • 5
                                          • 6
                                          • 7
                                          • 8
                                          • 7 / 8
                                          • First post
                                            Last post

                                          302

                                          Online

                                          12.0k

                                          Users

                                          17.3k

                                          Topics

                                          155.2k

                                          Posts
                                          Copyright © 2012-2024 FOG Project