• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Apache Issue

Scheduled Pinned Locked Moved Solved
Linux Problems
5
12
2.3k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • A
    Avaryan
    last edited by Avaryan Oct 4, 2017, 11:09 AM Oct 4, 2017, 4:59 PM

    Ubuntu 14.04
    FOG 1.4.2

    Apache is starting a ton of processes… needless to say, it’s slowing everything down significantly.
    alt text

    MySQL cpu usage was also very high.

    The CPU usage for this VM is capped at 3 Ghz. At idle with no tasks running it was at 2.9.
    There’s a few thousand clients registered.

    1 Reply Last reply Reply Quote 0
    • A
      Avaryan
      last edited by Oct 5, 2017, 1:40 PM

      Changed the checking time from 60 to 180. After a few minutes, the web interface became responsive again. I can switch between pages easily now.

      G 1 Reply Last reply Oct 5, 2017, 2:19 PM Reply Quote 0
      • G
        george1421 Moderator
        last edited by Oct 4, 2017, 9:04 PM

        I guess I would have to ask you can you update to FOG 1.4.4?

        Also lets collect some background information here

        How many client computers are contacting this fog server?
        What is your client check in time/interval?

        Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

        1 Reply Last reply Reply Quote 2
        • S
          Sebastian Roth Moderator
          last edited by Oct 4, 2017, 10:12 PM

          Just wanna add, what fog-client version do you use?

          Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

          Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

          1 Reply Last reply Reply Quote 1
          • A
            Avaryan
            last edited by Oct 5, 2017, 12:39 AM

            I’ll look into updating to 1.4.4 tomorrow.

            The FOG client is version 0.11.12. It’s running on all our Windows computers. The check in time is the default setting.

            As for number of devices, maybe around 1,000 online at once. Hard to say. Sent an email to our network admin regarding that.

            T 1 Reply Last reply Oct 5, 2017, 12:45 AM Reply Quote 0
            • T
              Tom Elliott @Avaryan
              last edited by Oct 5, 2017, 12:45 AM

              @avaryan is it possible the fog server has run out of disk space? This would, potentially, cause high cpu as it gets caught waiting for a new file to be opened up. Normally things just crash hard in these cases, but that doesn’t mean it happens all the time.

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.

              Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

              Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

              1 Reply Last reply Reply Quote 0
              • A
                Avaryan
                last edited by Oct 5, 2017, 2:06 AM

                No, there’s about 700GB of free space on it.

                W 1 Reply Last reply Oct 5, 2017, 4:10 AM Reply Quote 0
                • W
                  Wayne Workman @Avaryan
                  last edited by Wayne Workman Oct 4, 2017, 10:12 PM Oct 5, 2017, 4:10 AM

                  @avaryan Please be sure to check all the partitions, not just the big one. Use this command: df -h and look for partitions that have 100% usage.

                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
                  Daily Clean Installation Results:
                  https://fogtesting.fogproject.us/
                  FOG Reporting:
                  https://fog-external-reporting-results.fogproject.us/

                  A 1 Reply Last reply Oct 5, 2017, 12:31 PM Reply Quote 0
                  • S
                    Sebastian Roth Moderator
                    last edited by Sebastian Roth Oct 5, 2017, 12:10 AM Oct 5, 2017, 6:08 AM

                    @avaryan said in Apache Issue:

                    The FOG client is version 0.11.12. It’s running on all our Windows computers. The check in time is the default setting.

                    That’s good you have the latest client version running.

                    As for number of devices, maybe around 1,000 online at once.

                    Well then there are always a dozen or so clients talking to the FOG server at any given time. So I don’t really wonder about the top output you posted. I am wondering if it got to the point where the number of concurrent clients do actually cause the server to slow down. One solution would be to increase checkin time for the clients. But that would be to the cost of having a longer time to wait till clients do the jobs scheduled for them.

                    Possibly start by looking at the apache access log to see if this is really clients causing this: tail -f /var/log/apache/access.log

                    As well you wanna read this excellent post: https://forums.fogproject.org/topic/10717/can-php-fpm-make-fog-web-gui-fast

                    Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)

                    Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG

                    1 Reply Last reply Reply Quote 0
                    • A
                      Avaryan @Wayne Workman
                      last edited by Avaryan Oct 5, 2017, 7:32 AM Oct 5, 2017, 12:31 PM

                      @wayne-workman said in Apache Issue:

                      @avaryan Please be sure to check all the partitions, not just the big one. Use this command: df -h and look for partitions that have 100% usage.

                      alt text

                      @sebastian-roth said in Apache Issue:

                      Possibly start by looking at the apache access log to see if this is really clients causing this: tail -f /var/log/apache/access.log

                      I get no output. I let it sit for about 10 minutes.
                      alt text

                      edit: Updated to 1.4.4. Still increadibly laggy, but tail is showing some output now… kinda.

                      127.0.0.1 - - [05/Oct/2017:09:26:27 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:26:29 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:26:30 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:26:31 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:26:32 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:26:33 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:26:51 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:29:13 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      127.0.0.1 - - [05/Oct/2017:09:29:16 -0400] "OPTIONS * HTTP/1.0" 200 126 "-" "Apache/2.4.27 (Ubuntu) OpenSSL/1.1.0f (internal dummy connection)"
                      

                      ^ Notice that it gets a hit every 1-2 seconds, then stops for about 20 seconds, then over 2 minutes before the next to. Haven’t gotten anymore since that last one.

                      1 Reply Last reply Reply Quote 0
                      • A
                        Avaryan
                        last edited by Oct 5, 2017, 1:40 PM

                        Changed the checking time from 60 to 180. After a few minutes, the web interface became responsive again. I can switch between pages easily now.

                        G 1 Reply Last reply Oct 5, 2017, 2:19 PM Reply Quote 0
                        • G
                          george1421 Moderator @Avaryan
                          last edited by Oct 5, 2017, 2:19 PM

                          @avaryan Interesting, how many computers do you have checking into this FOG server?

                          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                          A 1 Reply Last reply Oct 5, 2017, 5:31 PM Reply Quote 0
                          • A
                            Avaryan @george1421
                            last edited by Avaryan Oct 5, 2017, 11:32 AM Oct 5, 2017, 5:31 PM

                            @george1421 said in Apache Issue:

                            @avaryan Interesting, how many computers do you have checking into this FOG server?

                            I don’t know the exact number, but likely more than a thousand. There’s over 2,500 Windows computers in AD that would have the client on it.

                            Anyway, it’s been about 4 hours now and the web ui is still running well. I’d say that solved the issue.
                            Bonus: Got the FOG server updated.

                            1 Reply Last reply Reply Quote 0
                            • 1 / 1
                            1 / 1
                            • First post
                              4/12
                              Last post

                            195

                            Online

                            12.0k

                            Users

                            17.3k

                            Topics

                            155.2k

                            Posts
                            Copyright © 2012-2024 FOG Project