• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Image upload & deploy taking a long time

Scheduled Pinned Locked Moved Solved
FOG Problems
10
64
31.1k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • B
    Brad Schumann
    last edited by Sep 20, 2017, 3:13 PM

    Server
    • FOG Version: 1.4.4
    • OS: Debian 7
    Client
    • Service Version:
    • OS: Win10 Pro 64bit
    Description

    When I am uploading or deploying an image it takes 4-5 hours. In image management I have it set to single disk - resizable, the hard drive is a 500GB hard drive but that has never changed for our machines. Imaging only use to take 10-15 min. during the imaging process on the device it is showing the "Device size: 499.0 GB, Space in use 499.0 GB but it only has an OS and windows office installed on it. Thoughts… 0_1505920369562_Capture.JPG

    1 Reply Last reply Reply Quote 0
    • G
      george1421 Moderator
      last edited by Sep 20, 2017, 3:20 PM

      I’m a bit confused by your post so lets think about the size bit first.

      You have a 500GB drive and upload a single disk resizable. When you view the captured image in the FOG management GUI, what size does it say in the list view for this image?

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

      B 1 Reply Last reply Sep 20, 2017, 3:31 PM Reply Quote 0
      • G
        george1421 Moderator
        last edited by Sep 20, 2017, 3:21 PM

        @brad-schumann said in Image upload & deploy taking a long time:

        When I am uploading or deploying an image it takes 4-5 hours.

        Imaging only use to take 10-15 min.

        The confusion for me is here. Does it take 4-5 hours to image or 10-15 minutes. I can say for my reference image that is about 25GB in size it take about 4 minutes to push it to the target hard drive. If you based your transfer rate on the Partclone speed that is about 6GB/min.

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

        B 1 Reply Last reply Sep 20, 2017, 3:40 PM Reply Quote 0
        • B
          Brad Schumann @george1421
          last edited by Sep 20, 2017, 3:31 PM

          @george1421 In Image Management it shows 465.30 under “Image size: on Client”.

          G 1 Reply Last reply Sep 20, 2017, 3:43 PM Reply Quote 0
          • S
            Sebastian Roth Moderator
            last edited by Sep 20, 2017, 3:35 PM

            Well then the client’s disk is very full…

            Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

            Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

            B G 2 Replies Last reply Sep 20, 2017, 3:43 PM Reply Quote 0
            • B
              Brad Schumann @george1421
              last edited by Sep 20, 2017, 3:40 PM

              @george1421 it used to take 10-15 min to image when I was on fog ver. 1.2 I upgraded to 1.4.4 and now it was taking roughly 4 hours to image.

              G 1 Reply Last reply Sep 20, 2017, 3:41 PM Reply Quote 0
              • G
                george1421 Moderator @Brad Schumann
                last edited by george1421 Sep 20, 2017, 9:42 AM Sep 20, 2017, 3:41 PM

                @brad-schumann This is only in regards to the speed issue: Can you tell us what the target computer you are using (mfg and model) as well as when you deploy the image what transfer rate is Partclone indicating? Is it the same as in your OP 5580 dell?

                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                B 1 Reply Last reply Sep 20, 2017, 3:46 PM Reply Quote 0
                • B
                  Brad Schumann @Sebastian Roth
                  last edited by Sep 20, 2017, 3:43 PM

                  @sebastian-roth full of what? we only are using 56GB of the 500GB available on the hard drive. but Fog seems like it is coping the whole HD and what used to seem it would only image what was being used on the HD, or am I mis-understanding…

                  1 Reply Last reply Reply Quote 0
                  • G
                    george1421 Moderator @Brad Schumann
                    last edited by Sep 20, 2017, 3:43 PM

                    @brad-schumann said in Image upload & deploy taking a long time:

                    @george1421 In Image Management it shows 465.30 under “Image size: on Client”.

                    It almost sounds like fog is copying the file as RAW for some reason. Can you confirm from inside windows that the disk contains only a little percentage of the entire size?

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                    B 1 Reply Last reply Sep 20, 2017, 3:53 PM Reply Quote 1
                    • G
                      george1421 Moderator @Sebastian Roth
                      last edited by Sep 20, 2017, 3:46 PM

                      @sebastian-roth Could we tell from the image meta data in the /images/<image_name> directory if fog was using raw or single disk non-resizable to capture the image?

                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                      1 Reply Last reply Reply Quote 0
                      • B
                        Brad Schumann @george1421
                        last edited by Sep 20, 2017, 3:46 PM

                        @george1421 yes it is a Dell latitude 5580 laptop

                        1 Reply Last reply Reply Quote 0
                        • B
                          Brad Schumann @george1421
                          last edited by Sep 20, 2017, 3:53 PM

                          @george1421 on the laptop being imaged currently the “File System” says raw. I have attached a pic. 0_1505922775947_20170920_104801 (2).jpg

                          G 1 Reply Last reply Sep 20, 2017, 3:57 PM Reply Quote 0
                          • G
                            george1421 Moderator @Brad Schumann
                            last edited by Sep 20, 2017, 3:57 PM

                            @brad-schumann I think we found our speed issue. What I’m also interested in is just off the screen to the right. What is partclone saying for transfer rate?

                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                            B 1 Reply Last reply Sep 20, 2017, 3:58 PM Reply Quote 0
                            • B
                              Brad Schumann @george1421
                              last edited by Sep 20, 2017, 3:58 PM

                              @george1421 transfer speed is avg. 4GB/min, sorry there was a size limit on the jpeg upload.

                              G 1 Reply Last reply Sep 20, 2017, 4:05 PM Reply Quote 0
                              • G
                                george1421 Moderator @Brad Schumann
                                last edited by george1421 Sep 20, 2017, 10:05 AM Sep 20, 2017, 4:05 PM

                                @brad-schumann Ok that speed isn’t bad, you are running a slightly higher compression than default so that will slow down throughput a little.

                                I guess we need to get the @developers comments on why would imaging switch from single disk resizable to raw. I know there are reasons that FOG will do this automatically, I just don’t know off the top of my head.

                                [edit] since this is a 500GB drive, can we assume its a SATA traditional hard drive?

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                1 Reply Last reply Reply Quote 0
                                • S
                                  Sebastian Roth Moderator
                                  last edited by Sebastian Roth Sep 20, 2017, 10:28 AM Sep 20, 2017, 4:27 PM

                                  Either image type has been set to raw (by hand?) in the web UI. Please check the image settings there. If not then I think the upload scripts fail to recognize the filesystem on disk. Can you please schedule a debug (like scheduling a normal job but just before clicking the button there is a checkbox for debug) upload job next and when you get to the shell run the following command, take a picture and post here: blkid

                                  Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                  Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                  B 1 Reply Last reply Sep 20, 2017, 4:53 PM Reply Quote 0
                                  • B
                                    Brad Schumann @Sebastian Roth
                                    last edited by Brad Schumann Sep 21, 2017, 1:22 PM Sep 20, 2017, 4:53 PM

                                    @sebastian-roth @developers here are 2 screenshots. 0_1505926417786_20170920_114235.jpg 0_1505926428535_20170920_114352.jpg

                                    1 Reply Last reply Reply Quote 0
                                    • J
                                      jhalbert
                                      last edited by jhalbert Sep 20, 2017, 2:03 PM Sep 20, 2017, 7:59 PM

                                      From my use of FOG for the short about of time. Few key important parts for making capturing image go faster and deploying. I know when I skip these steps, FOG will capture much more. Which takes longer.

                                      Step one - Turn off hibernate mode and delete the file.
                                      Step two - turn off swap file and delete the file
                                      Step three - Delete all cache files
                                      Step four - defrag the drive
                                      Step five - turn on hibernate and swap
                                      Step six - capture the image. I am running raid 10 with 10 gig network. Windows 10 fully updated and ready to work takes about 45 minutes. To deploy takes about 5 minutes. My image size is about 50 gb.

                                      1 Reply Last reply Reply Quote 0
                                      • x23piracyX
                                        x23piracy
                                        last edited by x23piracy Sep 22, 2017, 11:49 AM Sep 22, 2017, 5:46 PM

                                        Hi,

                                        i would suggest to test both over netio: https://web.ars.de/netio/
                                        It’s easy, one binary, can act as server and client, look at the syntax:

                                        Bild Text

                                        Speed issue can have several causes, so knowing the native speed would be a good information in first instance.
                                        Even strong compression/decompression actions can hit the brake.

                                        Please post your results

                                        Regards X23

                                        ║▌║█║▌│║▌║▌█

                                        1 Reply Last reply Reply Quote 0
                                        • S
                                          Sebastian Roth Moderator
                                          last edited by Sep 24, 2017, 11:14 PM

                                          @Brad-Schumann Please boot up the client into another debug task and run the following commands:

                                          blkid -po udev /dev/sda1 | awk -F= /FS_TYPE=/'{print $2}'
                                          blkid -po udev /dev/sda2 | awk -F= /FS_TYPE=/'{print $2}'
                                          blkid -po udev /dev/sda3 | awk -F= /FS_TYPE=/'{print $2}'
                                          blkid -po udev /dev/sda4 | awk -F= /FS_TYPE=/'{print $2}'
                                          

                                          Again take a picture of the output and post here. As well could you please take a picture of the full screen when partclone (blue text window) is doing the work. I need to know which partition it is working on. To me it kind of looks like it’s doing a raw capture of sda (the whole 500GB disk) which should not happen when it’s set to do resizable.

                                          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                          B 1 Reply Last reply Sep 26, 2017, 8:02 PM Reply Quote 0
                                          • 1
                                          • 2
                                          • 3
                                          • 4
                                          • 1 / 4
                                          1 / 4
                                          • First post
                                            2/64
                                            Last post

                                          152

                                          Online

                                          12.0k

                                          Users

                                          17.3k

                                          Topics

                                          155.2k

                                          Posts
                                          Copyright © 2012-2024 FOG Project