• Recent
    • Unsolved
    • Tags
    • Popular
    • Users
    • Groups
    • Search
    • Register
    • Login

    After Update to SVN 4928 web pages time out constantly

    Scheduled Pinned Locked Moved Solved
    FOG Problems
    4
    55
    33.5k
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • Joseph HalesJ
      Joseph Hales Testers
      last edited by

      Checked out revision 4146

      RTFM

      1 Reply Last reply Reply Quote 0
      • Joseph HalesJ
        Joseph Hales Testers
        last edited by

        I increased max connections in mysql and am getting some responses from the web interface but only partial and extremly slow. I am still getting a MaxRequestWorkers error so I will try increasing that some more but I think there is an underlying issue I am just kludging around by throwing resources at it.

        RTFM

        1 Reply Last reply Reply Quote 0
        • Joseph HalesJ
          Joseph Hales Testers
          last edited by

          The web interface is still down and the following is the latest apache log entries MaxWorkers is at 500 now.

          [Tue Oct 13 09:20:05.735019 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.735359 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.735730 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.736063 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.738972 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.739325 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.739662 2015] [:error] [pid 9950] [client 10.109.48.112:60149] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:05.900031 2015] [:error] [pid 9880] [client 10.41.50.221:49939] PHP Warning: mysqli::mysqli(): (HY000/2002): Connection refused in /var/www/html/fog/lib/db/MySQL.class.php on line 35
          [Tue Oct 13 09:20:05.900146 2015] [:error] [pid 9880] [client 10.41.50.221:49939] PHP Warning: mysqli::mysqli(): (HY000/2002): Connection refused in /var/www/html/fog/lib/db/MySQL.class.php on line 37
          [Tue Oct 13 09:20:05.900245 2015] [:error] [pid 9880] [client 10.41.50.221:49939] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
          [Tue Oct 13 09:20:09.267095 2015] [core:warn] [pid 9738] AH00045: child process 9843 still did not exit, sending a SIGTERM
          [Tue Oct 13 09:20:11.269473 2015] [core:warn] [pid 9738] AH00045: child process 9843 still did not exit, sending a SIGTERM
          [Tue Oct 13 09:20:13.271827 2015] [core:warn] [pid 9738] AH00045: child process 9843 still did not exit, sending a SIGTERM
          [Tue Oct 13 09:20:15.274178 2015] [core:error] [pid 9738] AH00046: child process 9843 still did not exit, sending a SIGKILL
          [Tue Oct 13 09:20:16.275460 2015] [mpm_prefork:notice] [pid 9738] AH00169: caught SIGTERM, shutting down
          [Tue Oct 13 09:22:34.694733 2015] [mpm_prefork:notice] [pid 1518] AH00163: Apache/2.4.16 (Ubuntu) OpenSSL/1.0.1f configured – resuming normal operations
          [Tue Oct 13 09:22:34.736477 2015] [core:notice] [pid 1518] AH00094: Command line: ‘/usr/sbin/apache2’
          [Tue Oct 13 09:23:17.953521 2015] [mpm_prefork:error] [pid 1518] AH00161: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting

          RTFM

          Wayne WorkmanW 1 Reply Last reply Reply Quote 0
          • Wayne WorkmanW
            Wayne Workman @Joseph Hales
            last edited by

            @Joseph-Hales Have you rebooted the fog server? Try to restart MySQL? Restart httpd (apache) ?

            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
            Daily Clean Installation Results:
            https://fogtesting.fogproject.us/
            FOG Reporting:
            https://fog-external-reporting-results.fogproject.us/

            1 Reply Last reply Reply Quote 0
            • Joseph HalesJ
              Joseph Hales Testers
              last edited by

              Yes every time I have changed one of the settings in apache or mysql I have first restarted both services and if it still fails I reboot the entire server same result.

              RTFM

              Wayne WorkmanW 1 Reply Last reply Reply Quote 0
              • Wayne WorkmanW
                Wayne Workman @Joseph Hales
                last edited by

                @Joseph-Hales Try to turn down your check-in time even further?

                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                Daily Clean Installation Results:
                https://fogtesting.fogproject.us/
                FOG Reporting:
                https://fog-external-reporting-results.fogproject.us/

                1 Reply Last reply Reply Quote 0
                • Joseph HalesJ
                  Joseph Hales Testers
                  last edited by

                  Where can I change that outside of the web interface. Also this just cropped up suddenly when I updated SVN from 4700 to 4928 and up no other changes the only reason I updated SVN at all at this point is to fix a known issue with new and updated snapins.

                  RTFM

                  Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                  • Wayne WorkmanW
                    Wayne Workman @Joseph Hales
                    last edited by Wayne Workman

                    @Joseph-Hales
                    Ignore the second circle, that’s for reboot/shutdown wait time.

                    upload-fa59282b-814b-4bd7-a718-b9c29aae3a57

                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                    Daily Clean Installation Results:
                    https://fogtesting.fogproject.us/
                    FOG Reporting:
                    https://fog-external-reporting-results.fogproject.us/

                    1 Reply Last reply Reply Quote 0
                    • Joseph HalesJ
                      Joseph Hales Testers
                      last edited by

                      The web interface is not responding that is the whole issue so I am unable to access that setting.

                      RTFM

                      Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                      • Wayne WorkmanW
                        Wayne Workman @Joseph Hales
                        last edited by

                        @Joseph-Hales Oh duh I’m sorry. Do it via CLI then.

                        mysql
                        use fog
                        update globalSettings set settingValue = 300 where settingKey = 'FOG_Service_Checkin_Time';
                        

                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                        Daily Clean Installation Results:
                        https://fogtesting.fogproject.us/
                        FOG Reporting:
                        https://fog-external-reporting-results.fogproject.us/

                        1 Reply Last reply Reply Quote 0
                        • Joseph HalesJ
                          Joseph Hales Testers
                          last edited by

                          @Wayne-Workman said:

                          update globalSettings set settingValue = 300 where settingKey = ‘FOG_Service_Checkin_Time’;

                          Thank you now my web interface is responding did a recent SVN reset this value?

                          RTFM

                          Wayne WorkmanW 1 Reply Last reply Reply Quote 1
                          • Wayne WorkmanW
                            Wayne Workman @Joseph Hales
                            last edited by

                            @Joseph-Hales I have no idea, but I seriously doubt the @Developers would write any code that would intentionally change your settings.

                            Is it possible that the installer updates this field to the default I wonder?

                            Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                            Daily Clean Installation Results:
                            https://fogtesting.fogproject.us/
                            FOG Reporting:
                            https://fog-external-reporting-results.fogproject.us/

                            1 Reply Last reply Reply Quote 0
                            • Joseph HalesJ
                              Joseph Hales Testers
                              last edited by

                              I spoke too soon after a few moments it stopped responding but I am not seeing any new errors in the apache log this time. I will try restarting the server itself instead of just the service.

                              RTFM

                              1 Reply Last reply Reply Quote 0
                              • Joseph HalesJ
                                Joseph Hales Testers
                                last edited by

                                No the web server is still not responding and I am back to getting the same apache errors.

                                [Tue Oct 13 10:58:17.303264 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.303784 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.304310 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.304799 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.305287 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.305771 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.306251 2015] [:error] [pid 7864] [client 10.1.51.37:64087] PHP Warning: mysqli::query(): Couldn’t fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                [Tue Oct 13 10:58:17.661588 2015] [mpm_prefork:notice] [pid 1518] AH00169: caught SIGTERM, shutting down
                                [Tue Oct 13 11:00:51.298115 2015] [mpm_prefork:notice] [pid 1544] AH00163: Apache/2.4.16 (Ubuntu) OpenSSL/1.0.1f configured – resuming normal operations
                                [Tue Oct 13 11:00:51.348300 2015] [core:notice] [pid 1544] AH00094: Command line: ‘/usr/sbin/apache2’
                                [Tue Oct 13 11:01:34.564492 2015] [mpm_prefork:error] [pid 1544] AH00161: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting

                                RTFM

                                Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                                • Wayne WorkmanW
                                  Wayne Workman @Joseph Hales
                                  last edited by

                                  @Joseph-Hales what does the command top show ?

                                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                  Daily Clean Installation Results:
                                  https://fogtesting.fogproject.us/
                                  FOG Reporting:
                                  https://fog-external-reporting-results.fogproject.us/

                                  1 Reply Last reply Reply Quote 0
                                  • Joseph HalesJ
                                    Joseph Hales Testers
                                    last edited by Wayne Workman

                                    top - 11:19:05 up 18 min,  1 user,  load average: 2.83, 2.84, 2.19
                                    Tasks: 463 total,   1 running, 462 sleeping,   0 stopped,   0 zombie
                                    %Cpu(s): 10.1 us,  0.8 sy,  0.0 ni, 84.6 id,  4.2 wa,  0.0 hi,  0.2 si,  0.0 st
                                    KiB Mem:  24678932 total,  2849080 used, 21829852 free,   134548 buffers
                                    KiB Swap:  4844540 total,        0 used,  4844540 free.  1368608 cached Mem
                                    
                                      PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
                                     1419 mysql     20   0 8721920 193320   7612 S 139.0  0.8  24:30.19 mysqld
                                     2647 www-data  20   0  325384  14092   5248 S   9.6  0.1   0:03.52 apache2
                                     2642 www-data  20   0  325628  14776   5684 S   1.7  0.1   0:02.77 apache2
                                     3452 www-data  20   0  325628  14324   5228 S   1.7  0.1   0:02.56 apache2
                                     2653 www-data  20   0  325628  14296   5212 S   1.3  0.1   0:02.58 apache2
                                     2975 www-data  20   0  325376  14880   6040 S   1.3  0.1   0:03.06 apache2
                                     2982 www-data  20   0  325628  14308   5224 S   1.3  0.1   0:03.38 apache2
                                     2993 www-data  20   0  325628  14324   5236 S   1.3  0.1   0:03.42 apache2
                                     3002 www-data  20   0  325628  14332   5244 S   1.3  0.1   0:03.14 apache2
                                     3439 www-data  20   0  325628  14296   5212 S   1.3  0.1   0:03.72 apache2
                                     3520 www-data  20   0  324092  13088   5532 S   1.3  0.1   0:02.69 apache2
                                     3523 www-data  20   0  325372  14092   5252 S   1.3  0.1   0:03.21 apache2
                                     3524 www-data  20   0  324348  13056   5252 S   1.3  0.1   0:03.24 apache2
                                     3532 www-data  20   0  325628  14632   5536 S   1.3  0.1   0:03.17 apache2
                                     3699 www-data  20   0  325628  14316   5232 S   1.3  0.1   0:04.04 apache2
                                     3764 www-data  20   0  325628  14352   5268 S   1.3  0.1   0:02.65 apache2
                                     3459 www-data  20   0  325628  14368   5284 S   1.0  0.1   0:02.37 apache2
                                    

                                    Mod edited to use code box.

                                    RTFM

                                    Wayne WorkmanW 1 Reply Last reply Reply Quote 0
                                    • Wayne WorkmanW
                                      Wayne Workman @Joseph Hales
                                      last edited by Wayne Workman

                                      @Joseph-Hales How many cores does this server have? How much RAM? What’s the core speed? Is the storage SSD or mechanical?

                                      I’m not sure how it’s possible for MySQL to use 139% of a CPU… 😕

                                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                                      Daily Clean Installation Results:
                                      https://fogtesting.fogproject.us/
                                      FOG Reporting:
                                      https://fog-external-reporting-results.fogproject.us/

                                      1 Reply Last reply Reply Quote 0
                                      • Tom ElliottT
                                        Tom Elliott
                                        last edited by

                                        Please update and try again, I’m trying to limit the number of sessions.

                                        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

                                        Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                                        Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                                        1 Reply Last reply Reply Quote 1
                                        • Joseph HalesJ
                                          Joseph Hales Testers
                                          last edited by

                                          updating here is lscpu output

                                          Architecture: x86_64
                                          CPU op-mode(s): 32-bit, 64-bit
                                          Byte Order: Little Endian
                                          CPU(s): 16
                                          On-line CPU(s) list: 0-15
                                          Thread(s) per core: 2
                                          Core(s) per socket: 4
                                          Socket(s): 2
                                          NUMA node(s): 2
                                          Vendor ID: GenuineIntel
                                          CPU family: 6
                                          Model: 26
                                          Stepping: 5
                                          CPU MHz: 2261.117
                                          BogoMIPS: 4521.87
                                          Virtualization: VT-x
                                          L1d cache: 32K
                                          L1i cache: 32K
                                          L2 cache: 256K
                                          L3 cache: 8192K
                                          NUMA node0 CPU(s): 0,2,4,6,8,10,12,14
                                          NUMA node1 CPU(s): 1,3,5,7,9,11,13,15

                                          RTFM

                                          1 Reply Last reply Reply Quote 1
                                          • Joseph HalesJ
                                            Joseph Hales Testers
                                            last edited by

                                            Old errors reoccur plus some new ones.

                                            
                                            [Tue Oct 13 11:32:00.141558 2015] [:error] [pid 3576] [client 10.110.50.40:65405] PHP Warning:  mysqli::query(): Couldn't fetch mysqli in /var/www/html/fog/lib/db/MySQL.class.php on line 62
                                            [Tue Oct 13 11:32:01.035167 2015] [:error] [pid 3579] [client 10.117.50.11:53325] PHP Fatal error:  Uncaught exception 'ReflectionException' with message 'Class EventManager does not exist' in /var/www/html/fog/lib/fog/FOGBase.class.php:64\nStack trace:\n#0 /var/www/html/fog/lib/fog/FOGBase.class.php(64): ReflectionClass->__construct('EventManager')\n#1 /var/www/html/fog/commons/init.php(196): FOGBase->getClass('EventManager')\n#2 /var/www/html/fog/commons/base.inc.php(3): require_once('/var/www/html/f...')\n#3 /var/www/html/fog/service/servicemodule-active.php(2): require_once('/var/www/html/f...')\n#4 {main}\n  thrown in /var/www/html/fog/lib/fog/FOGBase.class.php on line 64
                                            [Tue Oct 13 11:32:01.089682 2015] [:error] [pid 3667] [client 10.1.50.220:53541] PHP Fatal error:  Uncaught exception 'ReflectionException' with message 'Class ServiceManager does not exist' in /var/www/html/fog/lib/fog/FOGBase.class.php:64\nStack trace:\n#0 /var/www/html/fog/lib/fog/FOGBase.class.php(64): ReflectionClass->__construct('ServiceManager')\n#1 /var/www/html/fog/lib/fog/FOGCore.class.php(14): FOGBase->getClass('ServiceManager')\n#2 /var/www/html/fog/lib/fog/FOGCore.class.php(217): FOGCore->getSetting('FOG_THEME')\n#3 /var/www/html/fog/commons/init.php(192): FOGCore->setSessionEnv()\n#4 /var/www/html/fog/commons/base.inc.php(3): require_once('/var/www/html/f...')\n#5 /var/www/html/fog/service/servicemodule-active.php(2): require_once('/var/www/html/f...')\n#6 {main}\n  thrown in /var/www/html/fog/lib/fog/FOGBase.class.php on line 64
                                            [Tue Oct 13 11:32:01.230274 2015] [:error] [pid 5538] [client 10.113.50.91:50426] PHP Fatal error:  Uncaught exception 'ReflectionException' with message 'Class ServiceManager does not exist' in /var/www/html/fog/lib/fog/FOGBase.class.php:64\nStack trace:\n#0 /var/www/html/fog/lib/fog/FOGBase.class.php(64): ReflectionClass->__construct('ServiceManager')\n#1 /var/www/html/fog/lib/fog/FOGCore.class.php(14): FOGBase->getClass('ServiceManager')\n#2 /var/www/html/fog/lib/fog/FOGCore.class.php(217): FOGCore->getSetting('FOG_THEME')\n#3 /var/www/html/fog/commons/init.php(192): FOGCore->setSessionEnv()\n#4 /var/www/html/fog/commons/base.inc.php(3): require_once('/var/www/html/f...')\n#5 /var/www/html/fog/service/snapins.checkin.php(2): require_once('/var/www/html/f...')\n#6 {main}\n  thrown in /var/www/html/fog/lib/fog/FOGBase.class.php on line 64
                                            [Tue Oct 13 11:34:49.125571 2015] [mpm_prefork:error] [pid 5892] AH00161: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting```

                                            RTFM

                                            1 Reply Last reply Reply Quote 0
                                            • 1
                                            • 2
                                            • 3
                                            • 1 / 3
                                            • First post
                                              Last post

                                            188

                                            Online

                                            12.0k

                                            Users

                                            17.3k

                                            Topics

                                            155.2k

                                            Posts
                                            Copyright © 2012-2024 FOG Project