• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

What is FOG_PIGZ_COMP and why is it so funny?

Scheduled Pinned Locked Moved
General
4
8
2.1k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • S
    sudburr
    last edited by Mar 10, 2017, 2:48 PM

    The FOG Boot Setting of FOG_PIGZ_COMP offers a value slider of 0-21 in RC13 (and a little earlier). I realize the change from 0-9 is because of implementing a new library( zstdmt vs pzstd?), but how does it affect things?

    Is the FOG RC now using this new method permanently?

    Is it still called PIGZ?

    How does it affect an image captured with RC13 when it comes time to be deployed by say, 1.3.4?

    Is it possible to switch between the old method and the new?

    Why is it a BOOT setting?

    Just looking for some clarity.

    [ Standing in between extinction in the cold and explosive radiating growth ]

    1 Reply Last reply Reply Quote 0
    • T
      Tom Elliott
      last edited by Mar 10, 2017, 2:52 PM

      This is a “default” setting since you can define the “compression” level at the image level now.

      PIGZ_COMP was the original name because the compression was using PIGZ.

      PIGZ is still the default, and so is the “compression” default of 6 still set.

      ZSTD has native support to decompress GZIP (PIGZ is gzip btw). So the utilities within the init are all using zstdmt currently.

      1.3.4 images should work fine with the new stuff.

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

      Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

      Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

      1 Reply Last reply Reply Quote 1
      • T
        Tom Elliott
        last edited by Mar 10, 2017, 2:57 PM

        It’s a “boot” setting because this value get’s passed to the init’s when the device is loading. It’s actually passed as a “kernel” argument, which is why it’s listed as a “Boot” setting. It’s set at “boot” if that helps make it more clear.

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        1 Reply Last reply Reply Quote 0
        • J
          Junkhacker Developer
          last edited by Junkhacker Mar 10, 2017, 9:30 AM Mar 10, 2017, 3:26 PM

          other important information to know

          we used PIGZ because it was a parallel implementation of gzip. it took better advantage of multicore/multithread processors than standard gzip while maintaining complete compatibility with the widely used gzip compression.
          gzip has been around for a long time and is a widely used standard. it, however, even using pigz, does not multi-thread well.
          gzip/pigz compression can go from 1-9, or you can crank it to 11 for a very intensive compression at high cpu cost (there is no compression level 10)

          zstd (zstandard) is a new type of compression. zstandard hasn’t been around long enough to become widely adopted, so if you ever want to use the files created by fog with another program, like clonezilla, that needs to be kept in mind. zstandard multi-threads well, and has better performance overall than gzip.
          zstd compression can go from 1-22. 20-22 are “ultra” settings that will fail to work if the system you’re using to capture does not have a high amount of ram.

          my personal experience in converting an image from pigz -6 compression to zstd -11 are as follows:
          capture ~20% faster
          size ~26% smaller
          deploy ~36% faster

          signature:
          Junkhacker
          We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

          1 Reply Last reply Reply Quote 1
          • S
            sudburr
            last edited by Mar 10, 2017, 3:37 PM

            Hmm, so a ZSTD compressed image requires what version FOG to deploy?

            … and Clonezilla 2.5.0-25 does not support a PartClone image compressed with ZSTD?

            [ Standing in between extinction in the cold and explosive radiating growth ]

            T J 2 Replies Last reply Mar 10, 2017, 3:39 PM Reply Quote 0
            • T
              Tom Elliott @sudburr
              last edited by Mar 10, 2017, 3:39 PM

              @sudburr Partclone, to my knowledge, does not support any compressed form of image. While the utilities may have a means to decompress before sending into the partclone system, what those utilities are I have no idea.

              ZSTD Was added with 1.3.5-RC-10. ZSTD Can decompress gzipped files natively so from a user perspective a “version” is not required.

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

              Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

              Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

              1 Reply Last reply Reply Quote 1
              • J
                Junkhacker Developer @sudburr
                last edited by Mar 10, 2017, 3:42 PM

                @sudburr the downloadable clonezilla boot cd, at the very least, will not include the needed program to decompress a zstd file, it does however contain the program to decompress a gzip file.

                signature:
                Junkhacker
                We are here to help you. If you are unresponsive to our questions, don't expect us to be responsive to yours.

                1 Reply Last reply Reply Quote 0
                • W
                  Wayne Workman
                  last edited by Wayne Workman Mar 11, 2017, 11:35 AM Mar 11, 2017, 5:35 PM

                  Maybe FOG_PIGZ_COMP can be changed to just FOG_COMP or IMG_COMP
                  At the end of the day though, it doesn’t really matter.

                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                  Daily Clean Installation Results:
                  https://fogtesting.fogproject.us/
                  FOG Reporting:
                  https://fog-external-reporting-results.fogproject.us/

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  1 / 1
                  • First post
                    5/8
                    Last post

                  167

                  Online

                  12.0k

                  Users

                  17.3k

                  Topics

                  155.2k

                  Posts
                  Copyright © 2012-2024 FOG Project