• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Development FOG not capturing image - PartClone update

Scheduled Pinned Locked Moved Solved
FOG Problems
5
36
4.9k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • T
    ty900000 @shruggy
    last edited by Jan 15, 2020, 2:03 PM

    @shruggy

    That seems to work better. It is pull the ‘raw’ partition 3 and works when using uncompressed capture and deploy, Zstd compression 6 worked well too. I did see a few errors that didn’t seem to affect anything. The first one was after imaging with complete and the second image was before it started.

    FOG.PNG

    FOG2.PNG

    1 Reply Last reply Reply Quote 0
    • S
      shruggy
      last edited by shruggy Jan 15, 2020, 9:58 AM Jan 15, 2020, 3:52 PM

      @Quazz has just fixed it in the source.

      And I suppose the errors won’t show up if you set the image type to “Multiple Partition Image - Single Disk (Not Resizable)”, since the awk script gets only invoked during partition resizing.

      T 1 Reply Last reply Jan 15, 2020, 4:53 PM Reply Quote 0
      • T
        ty900000 @shruggy
        last edited by Jan 15, 2020, 4:53 PM

        @shruggy

        Okay, cool. I’ll wait for the build to complete and then pull it done for one more test. Thanks!

        Q 1 Reply Last reply Jan 15, 2020, 4:53 PM Reply Quote 0
        • Q
          Quazz Moderator @ty900000
          last edited by Jan 15, 2020, 4:53 PM

          @ty900000 That build does not yet include the partclone fixes, though. But we are getting close to that.

          1 Reply Last reply Reply Quote 1
          • S
            Sebastian Roth Moderator
            last edited by Jan 16, 2020, 4:32 PM

            @ty900000 said in Development FOG not capturing image - PartClone update:

            I did test with several of the other compression types. As far as I can figure the Partclone Uncompressed is the only one that throws the above error with the 1 minute time out.

            and…

            I pulled the latest init just now, too. Using both uncompressed and Zstd
            … picture with segmentation fault …

            Those two answers don’t add up for me. Can you please do a simple test with the different compressions (none, Gzip, Zstd) and post which error exact you get for each.

            Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

            Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

            T 1 Reply Last reply Jan 16, 2020, 6:24 PM Reply Quote 0
            • T
              ty900000 @Sebastian Roth
              last edited by Jan 16, 2020, 6:24 PM

              @Sebastian-Roth

              My apologies; I know my previous message was confusing.

              A few days ago, the init from Jenkins and using Uncompressed would throw the error when it deployed - the image above about /dev/sda3. A few hours after that a new init was pushed to Jenkins that I tried. That one reintroduced the segmentation error during image capture, not matter what compression I tried.

              I currently am using the init @shruggy suggested yesterday and that one seems to have fixed everything for me during image capture and deployment.

              I haven’t pulled the latest init from the Jenkins. Would you like me to do that?

              Thanks everyone!

              1 Reply Last reply Reply Quote 0
              • S
                Sebastian Roth Moderator
                last edited by Jan 16, 2020, 7:31 PM

                @ty900000 said:

                A few days ago, the init from Jenkins and using Uncompressed would throw the error when it deployed - the image above about /dev/sda3.

                I guess you mean this error: alt text

                That would mean the capture did run fine and partclone did not segfault when capturing. Though we probably can’t figure out which version it was you were using back then as too many things were tried in a rush. Nevermind.

                I currently am using the init @shruggy suggested yesterday …

                @shruggy Would you mind telling us which version of partclone this is?

                Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                T S 2 Replies Last reply Jan 16, 2020, 7:51 PM Reply Quote 0
                • T
                  ty900000 @Sebastian Roth
                  last edited by Jan 16, 2020, 7:51 PM

                  @Sebastian-Roth

                  I’m sorry! I had to backtrace this information, if you still want it: FOS 112 had the segmentation fault, FOS 113 had the segmentation fault (also tried the debug with this one), FOS 114 captured without the segmentation fault and introduced the unset_name [OPTIONS] error during capture and subsequently the /dev/sda3 error during deployment, and FOS 115 reintroduced the segmentation error.

                  I can redownload FOS 114 files and test with those again, if need be.

                  T 1 Reply Last reply Jan 16, 2020, 8:25 PM Reply Quote 1
                  • T
                    Tom Elliott @ty900000
                    last edited by Jan 16, 2020, 8:25 PM

                    @ty900000 The problem with using 114, is it’s missing an argument. So the Segfault is double’d due to -c/-a0 and not likely due to either of the arguments, but rather the fact partclone is segfaulting as it cannot determine file size, as it is literally commented out of the code. This means, a raw (imager) image file will not be generated at all. (/images/<imagename>/d1p<#ofparttion_to_be_cloned_in_imager_format>.img will be missing comletely.)

                    In my case the partition number was 2, and in yours it appears the partition number is 3.

                    I have created a fork of the partclone repository and implemented what I would think should address the issue by reimplementing the filesize display capabilities. As @Sebastian-Roth learned, simply uncommenting the line allowed partclone to work properly (as far as we could tell).

                    Until we patch the issue on our side (either by using our forked copy of the repository or directly implementing it as a part of the build process), this is still going to be a problem. I think we have a way to fix it, just haven’t had time to implement and have you (or anybody else who’d be willing) to test it.

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                    Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                    Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                    1 Reply Last reply Reply Quote 1
                    • S
                      shruggy @Sebastian Roth
                      last edited by shruggy Jan 17, 2020, 4:12 AM Jan 17, 2020, 10:01 AM

                      @Sebastian-Roth said in Development FOG not capturing image - PartClone update:

                      @shruggy Would you mind telling us which version of partclone this is?

                      It’s the latest git shapshot:
                      https://github.com/Thomas-Tsai/partclone/tree/58d138da6e0f473acd80a7c9b8544d104377d50f
                      with the fix you suggested:

                      $ cd git/fos/Buildroot/package/partclone
                      $ ls
                      Config.in  partclone-0.3.12.patch  partclone.imager.patch  partclone.mk
                      $ cat partclone.imager.patch
                      diff --git a/src/ddclone.c b/src/ddclone.c
                      index 04f8775..cab5386 100644
                      --- a/src/ddclone.c
                      +++ b/src/ddclone.c
                      @@ -30,7 +30,9 @@ void read_super_blocks(char* device, file_system_info* fs_info)
                       	}
                       	strncpy(fs_info->fs, raw_MAGIC, FS_MAGIC_SIZE);
                       	fs_info->block_size  = PART_SECTOR_SIZE;
                      -	//fs_info->device_size = get_partition_size(&src);
                      +#ifdef IMG
                      +	fs_info->device_size = get_partition_size(&src);
                      +#endif
                       	fs_info->totalblock  = fs_info->device_size / PART_SECTOR_SIZE;
                       	fs_info->usedblocks  = fs_info->device_size / PART_SECTOR_SIZE;
                       	close(src);
                      

                      I haven’t yet pulled the latest FOS, however. So it doesn’t contain the changes to func.sh by @Tom-Elliott i.e. no special case for partclone.imager.

                      On the other note, when using unpatched Partclone 0.3.12 I also sometimes got segmentation fault, but didn’t report it. The case when Partclone finished successfully, but actually didn’t capture the partition was the more common outcome. I’d say, somewhere in the relation of 4 (empty) successes to 1 segfault, IIRC. And I didn’t notice any pattern to segfaults then (e.g. it could happen with or without compression).

                      1 Reply Last reply Reply Quote 0
                      • S
                        Sebastian Roth Moderator
                        last edited by Feb 6, 2020, 9:01 PM

                        @ty900000 Sorry, forgot to update this topic as well. We have added a fix. Please update to the latest dev-branch and it should be all good to go again,

                        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                        1 Reply Last reply Reply Quote 0
                        • 1
                        • 2
                        • 1 / 2
                        • First post
                          Last post

                        220

                        Online

                        12.0k

                        Users

                        17.3k

                        Topics

                        155.2k

                        Posts
                        Copyright © 2012-2024 FOG Project