• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Help a noob with Compression

Scheduled Pinned Locked Moved
General
3
6
2.5k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • F
    fry_p Moderator
    last edited by Apr 7, 2017, 1:39 PM

    Hi All,
    I saw another thread where people are getting very good speeds with the zstd compression method. Can anyone explain how I can utilize this? I am currently using the default compression method and level. Would I need to re-upload images?

    Like open source community computing? Why not do it for a good cause?
    Use your computer/server for humanitarian projects when it is idle!
    https://join.worldcommunitygrid.org?recruiterId=1026912

    G 1 Reply Last reply Apr 7, 2017, 1:54 PM Reply Quote 0
    • G
      george1421 Moderator @fry_p
      last edited by Apr 7, 2017, 1:54 PM

      @fry_p zstd is a newer and a bit more advanced than the gzip image compression.

      Starting with FOG 1.3.5 zstd is used as the decompression engine for FOG (it can read both formats). So you will get some speed improvements over FOG 1.3.4 by just upgrading. To get the most speed out of the system you need to recapture your image using zstd. This can be as simple as deploy an image, change the image definition to zstd and then recapture the image right away. I can tell you upload is much slower than gzip, but the advantage of zstd is better data compression (on the fog server) and a much faster image deployment on dual core and better processors (on target computer).

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

      W 1 Reply Last reply Apr 7, 2017, 9:51 PM Reply Quote 2
      • W
        Wayne Workman @george1421
        last edited by Apr 7, 2017, 9:51 PM

        @george1421 said in Help a noob with Compression:

        I can tell you upload is much slower than gzip, but the advantage of zstd is better data compression (on the fog server) and a much faster image deployment on dual core and better processors (on target computer).

        I had the exact opposite experience using an Optiplex 790. My upload speeds were just ridiculously fast, but deployment speeds lagged severely slower. Given my FOG Server is operating with a 100mbps connection in a VM on older equipment probably has a lot to do with it.

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
        Daily Clean Installation Results:
        https://fogtesting.fogproject.us/
        FOG Reporting:
        https://fog-external-reporting-results.fogproject.us/

        F 1 Reply Last reply Apr 8, 2017, 12:58 PM Reply Quote 0
        • F
          fry_p Moderator @Wayne Workman
          last edited by Apr 8, 2017, 12:58 PM

          @Wayne-Workman @george1421 That is interesting. I have model specific images, so maybe I should leave the older devices on the old compression method. I started an upload for a Dell 5440 laptop with zstd just before I left on Friday. I am eager to test the deployment on Monday!

          Like open source community computing? Why not do it for a good cause?
          Use your computer/server for humanitarian projects when it is idle!
          https://join.worldcommunitygrid.org?recruiterId=1026912

          G 1 Reply Last reply Apr 8, 2017, 1:02 PM Reply Quote 0
          • G
            george1421 Moderator @fry_p
            last edited by Apr 8, 2017, 1:02 PM

            @fry_p You do have to keep in mind that the target system really does all of the work for the FOG server. The fog server only manages the process and moves files about. The target does the data compression/decompression. So if you have an under powered target system the higher compression levels and algorithms may require too much processing power for the target.

            For lower end systems I would even use a bit lower compression index than the fog default of 6, just to ease up on the target requirements at the expense of file size on the fog server.

            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

            F 1 Reply Last reply Apr 8, 2017, 1:07 PM Reply Quote 1
            • F
              fry_p Moderator @george1421
              last edited by Apr 8, 2017, 1:07 PM

              @george1421 Ah ok. I think I may be fine with the i5 and 8GB of ram in that model, but I do have a Optiplex 780 image that I can improve by lowering the compression then. Thanks for the tips!

              Like open source community computing? Why not do it for a good cause?
              Use your computer/server for humanitarian projects when it is idle!
              https://join.worldcommunitygrid.org?recruiterId=1026912

              1 Reply Last reply Reply Quote 0
              • 1 / 1
              1 / 1
              • First post
                2/6
                Last post

              167

              Online

              12.0k

              Users

              17.3k

              Topics

              155.2k

              Posts
              Copyright © 2012-2024 FOG Project