• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Image replication loop - incorrect file size calculation

Scheduled Pinned Locked Moved Solved
Bug Reports
3
15
2.6k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • M
    Mark Shelton
    last edited by Aug 2, 2016, 10:56 PM

    Hi,
    I have FOG 1.3.0 RC4 SVN 5941 running on 3 servers, connected via WAN. For the last few revisions, image replication has been looping. It takes a few days to replicate over the WAN and when finished starts all over again.
    Upon further investigation of the logs, I have realised that it is because the replication process incorrectly calculates the local file size. Please find attached two shapshots. One of the local image filesize of the largest file being 8306809333 bytes. The other image shows the log displaying the remote filesize as the correct number, but the local size incorrectly as -283125259. So the replication starts all over again.
    0_1470178490300_filesize.jpg
    0_1470178412754_replicationlog.jpg

    1 Reply Last reply Reply Quote 0
    • T
      Tom Elliott @Wayne Workman
      last edited by Aug 3, 2016, 12:33 AM

      @Wayne-Workman It’s requesting the filesize from the remote server using ftp. Locally it is using the filesize php command.

      I’ve created an arch agnostic filesize getter which should fix this issue.

      Will be in RC-6.

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

      Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

      Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

      M 1 Reply Last reply Aug 3, 2016, 12:44 AM Reply Quote 1
      • T
        Tom Elliott
        last edited by Aug 2, 2016, 10:59 PM

        Just a guess, but a 32 bit operating system?

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

        M 1 Reply Last reply Aug 3, 2016, 12:13 AM Reply Quote 1
        • W
          Wayne Workman
          last edited by Aug 2, 2016, 11:00 PM

          Also, please update to RC-5.

          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
          Daily Clean Installation Results:
          https://fogtesting.fogproject.us/
          FOG Reporting:
          https://fog-external-reporting-results.fogproject.us/

          M 1 Reply Last reply Aug 3, 2016, 12:15 AM Reply Quote 0
          • M
            Mark Shelton @Tom Elliott
            last edited by Aug 3, 2016, 12:13 AM

            @Tom-Elliott Yes 32 bit. However it reads the remote image size accurately which is also 32 bit.

            T W 2 Replies Last reply Aug 3, 2016, 12:14 AM Reply Quote 0
            • T
              Tom Elliott @Mark Shelton
              last edited by Aug 3, 2016, 12:14 AM

              @Mark-Shelton And both nodes are at the same version?

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

              Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

              Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

              M 1 Reply Last reply Aug 3, 2016, 12:19 AM Reply Quote 0
              • M
                Mark Shelton @Wayne Workman
                last edited by Aug 3, 2016, 12:15 AM

                @Wayne-Workman I will try that, but this issue has been happening for a few releases. I’ve not noticed anyone else reporting the problem so not sure if it has been addressed.

                1 Reply Last reply Reply Quote 0
                • M
                  Mark Shelton @Tom Elliott
                  last edited by Aug 3, 2016, 12:19 AM

                  @Tom-Elliott Yes all are FOG 1.3.0 RC4 SVN 5941. All have Ubuntu 14.04 installed. Interesting that the local file size is always incorrect for the large files. This has been happening for a while, I’ve only just realised why.

                  1 Reply Last reply Reply Quote 0
                  • W
                    Wayne Workman @Mark Shelton
                    last edited by Wayne Workman Aug 2, 2016, 6:31 PM Aug 3, 2016, 12:31 AM

                    @Mark-Shelton said in Image replication loop - incorrect file size calculation:

                    Yes 32 bit. However it reads the remote image size accurately which is also 32 bit.

                    But, it’s requesting the data from the remote server, which is 64 bit I presume. The remote server is the one doing the measuring on it’s files.

                    32 bit OSs have a file size limit of 2GB. There’s nothing we can do about that.

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                    Daily Clean Installation Results:
                    https://fogtesting.fogproject.us/
                    FOG Reporting:
                    https://fog-external-reporting-results.fogproject.us/

                    T M 2 Replies Last reply Aug 3, 2016, 12:33 AM Reply Quote 0
                    • T
                      Tom Elliott @Wayne Workman
                      last edited by Aug 3, 2016, 12:33 AM

                      @Wayne-Workman It’s requesting the filesize from the remote server using ftp. Locally it is using the filesize php command.

                      I’ve created an arch agnostic filesize getter which should fix this issue.

                      Will be in RC-6.

                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                      Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                      Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                      M 1 Reply Last reply Aug 3, 2016, 12:44 AM Reply Quote 1
                      • M
                        Mark Shelton @Wayne Workman
                        last edited by Aug 3, 2016, 12:37 AM

                        @Wayne-Workman It worked in the past. I have always used 32 bit filesystems, and the remote server is also 32 bit.

                        T 1 Reply Last reply Aug 3, 2016, 12:45 AM Reply Quote 0
                        • M
                          Mark Shelton @Tom Elliott
                          last edited by Aug 3, 2016, 12:44 AM

                          @Tom-Elliott Thanks Tom. I’ll wait a few days for RC-6. Regards, Mark

                          1 Reply Last reply Reply Quote 0
                          • T
                            Tom Elliott @Mark Shelton
                            last edited by Aug 3, 2016, 12:45 AM

                            @Mark-Shelton basically, the remote was working because I get the size using a raw from look at the content. This is why the remote worked even on 32 bit remotes. However, I was using the filesize php function to get the local filesize.

                            The ftp essentially just reads the size as a string. So displaying it is proper as it’s not converting to an integer. The local was returning an integer.

                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                            Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                            Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                            M 1 Reply Last reply Aug 3, 2016, 1:11 AM Reply Quote 1
                            • M
                              Mark Shelton @Tom Elliott
                              last edited by Aug 3, 2016, 1:11 AM

                              @Tom-Elliott I’m so pleased you found the issue so quickly! I’ve had to turn off replication for the last number of releases and upload them when at the sites. Didn’t want to post about it until I had done some investigation and had evidence of the exact issue.

                              1 Reply Last reply Reply Quote 0
                              • W
                                Wayne Workman
                                last edited by Aug 3, 2016, 1:38 AM

                                Fedora project isn’t making 32 bit builds anymore. What does that tell you about the next release of RHEL and CentOS? I doubt Debian would ever stop building 32 bit versions though, so Ubuntu may or may not have a future in 32 bit.

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                Daily Clean Installation Results:
                                https://fogtesting.fogproject.us/
                                FOG Reporting:
                                https://fog-external-reporting-results.fogproject.us/

                                M 1 Reply Last reply Aug 3, 2016, 1:47 AM Reply Quote 0
                                • M
                                  Mark Shelton @Wayne Workman
                                  last edited by Aug 3, 2016, 1:47 AM

                                  @Wayne-Workman Thanks, yes I may move to 64 bit. However it’s good that my issue has highlighted the inconsistency in the code which sounds like it only shows up in 32 bit OS’s. I’m guessing there mustn’t be too many others with my setup out there, otherwise this would have been reported a while ago. Glad its a relatively easy fix, I’ve rebuilt these boxes a few times recently and didn’t wish to have to do it again. Regards, Mark

                                  1 Reply Last reply Reply Quote 0
                                  • 1 / 1
                                  1 / 1
                                  • First post
                                    1/15
                                    Last post

                                  156

                                  Online

                                  12.0k

                                  Users

                                  17.3k

                                  Topics

                                  155.2k

                                  Posts
                                  Copyright © 2012-2024 FOG Project