Gui not responsive
-
Server
- Version: RC10 v5955
- OS: Ubuntu 14.04
Client
- Version:
- OS:
Description
In RC8 my server was overwhelmed with the load from all the student systems. Now at RC10 the load is better but the Gui will often time out. Here are some of the new errors I’m getting in the apache log:
[client ] PHP Warning: PDO::__construct(): MySQL server has gone away in /var/www/html/fog/lib/db/pdodb.class.php on line 152
[Mon Sep 12 07:53:55.853195 2016] [mpm_prefork:notice] [pid 10405] AH00169: caught SIGTERM, shutting down
[Mon Sep 12 07:54:15.715773 2016] [mpm_prefork:notice] [pid 1329] AH00163: Apache/2.4.7 (Ubuntu) PHP/5.6.23-1+deprecated+dontuse+deb.sury.org~trusty+1 OpenSSL/1.0.1f configured – resuming normal operations
[Mon Sep 12 07:54:15.721722 2016] [core:notice] [pid 1329] AH00094: Command line: ‘/usr/sbin/apache2’
[Mon Sep 12 07:54:27.699003 2016] [mpm_prefork:error] [pid 1329] AH00161: server reached MaxRequestWorkers setting, consider raising the MaxRequestWorkers setting -
-
The system hasn’t been changed in how it loads files. Not since mid version 4000 at least, minus a few changes to the way they’re ordered. How many hosts do you have? How long has load been an issue?
-
You could raise the memory limits, and also decrease how often the fog client checks in.
-
@Tom-Elliott
We have over 10k hosts. Load was an issue in RC7, and you suggested I apply (https://github.com/FOGProject/fogproject/commit/f39a26a27814a3d50333174fc461a0326d646d4a)…and that worked.
Now since RC9 load isn’t an issue, but the http response has changed dramatically.
I’ve adjusted the fog client response time from 60 sec to 300 sec, but it doesn’t seem to have much of an impact.
More apache error log:
AH00558: apache2: Could not reliably determine the server’s fully qualified domain name, using 127.0.1.1. Set the ‘ServerName’ directive globally to suppress this message
[Mon Sep 12 12:56:50.109890 2016] [mpm_prefork:notice] [pid 1329] AH00163: Apache/2.4.7 (Ubuntu) PHP/5.6.23-1+deprecated+dontuse+deb.sury.org~trusty+1 OpenSSL/1.0.1f configured – resuming normal operations
[Mon Sep 12 12:56:50.109910 2016] [core:notice] [pid 1329] AH00094: Command line: ‘/usr/sbin/apache2’
[Mon Sep 12 13:02:27.922592 2016] [core:notice] [pid 1329] AH00051: child pid 14456 exit signal Segmentation fault (11), possible coredump in /etc/apache2 -
@ablohowiak said in Gui not responsive:
I’ve adjusted the fog client response time from 60 sec to 300 sec, but it doesn’t seem to have much of an impact.
It’s not an immediate thing. All hosts must have valid authentication, otherwise they will continue to hammer away. 2nd, the clients have to check in to get the new settings. In your case, this shouldn’t take over 2 minutes. I’d also suggest clearing the encryption for all hosts as a preventative. Use groups to do this.
Are you sure you’re on rc-9?
-
@Wayne-Workman
I’m on RC10 v 5955, but the symptoms have been there since RC9. -
@ablohowiak can you try a clean GUI install? Remove /var/www/fog and /var/www/html/fog and /home/*.BACKUP and rerun installer
-
@ablohowiak a bit out of norm but can you change the config.class.php filr to use 127.0.01? I suspect the sockets are dropping to make room for other sockets, causing some portions to just drop php code. So because the socket is lost mid stream it causes the GUI to crash. Again this is all theoretical but it files like an issue I’ve seen before, which was why I switched from a socket connection to a TCP connection
-
@Tom-Elliott
Actually, the client response setting is having an impact for our techs with a lot fewer timeouts. I’m going to leave things as is and see what sort of feedback I get from a full day with these settings. -
@ablohowiak I’d even suggest a higher checkin time for so many hosts. 15 minutes, 20 minutes even. 900 or 1200 seconds.
There’s two settings, one is how long to wait to check in after boot, and another for how often to periodically check in afterwards.
I’d suggest leaving the boot check in time as default, and raising the other to 20 minutes. Just because 10,000 hosts is a lot. -
@ablohowiak Can you get us the client log from one of the hosts? It’s
C:\fog.logPlease help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!
Daily Clean Installation Results:
https://fogtesting.fogproject.us/
FOG Reporting:
https://fog-external-reporting-results.fogproject.us/ -
For @ablohowiak
Log for 11.5
------------------------------------------------------------------------------ ---------------------------------ClientUpdater-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response Success ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ----------------------------------TaskReboot---------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response Success ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------HostnameChanger------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response Success 9/14/2016 3:15 PM HostnameChanger Checking Hostname 9/14/2016 3:15 PM HostnameChanger Hostname is correct 9/14/2016 3:15 PM HostnameChanger Attempting to join domain 9/14/2016 3:15 PM HostnameChanger Host is already joined to target domain ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ---------------------------------SnapinClient--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response No snapins ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------PrinterManager-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response Module is disabled on the host 9/14/2016 3:15 PM PrinterManager Getting installed printers ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------PowerManagement------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response Success 9/14/2016 3:15 PM PowerManagement Calculating tasks to unschedule 9/14/2016 3:15 PM PowerManagement Calculating tasks to schedule ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ----------------------------------UserTracker--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Client-Info Client Version: 0.11.5 9/14/2016 3:15 PM Client-Info Client OS: Windows 9/14/2016 3:15 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:15 PM Middleware::Response Success ------------------------------------------------------------------------------ 9/14/2016 3:15 PM Middleware::Communication URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&configure&newService&json 9/14/2016 3:16 PM Middleware::Response Success 9/14/2016 3:16 PM Service Sleeping for 328 seconds 9/14/2016 3:21 PM Middleware::Communication URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&mac=10:60:4B:87:83:7B||00:00:00:00:00:00:00:E0&newService&json 9/14/2016 3:21 PM Middleware::Response Success 9/14/2016 3:21 PM Middleware::Communication URL: http://fogserver/fog/service/getversion.php?clientver&newService&json 9/14/2016 3:21 PM Middleware::Communication URL: http://fogserver/fog/service/getversion.php?newService&json 9/14/2016 3:21 PM Service Creating user agent cache 9/14/2016 3:21 PM Middleware::Response Module is disabled globally on the FOG server 9/14/2016 3:21 PM Middleware::Response Module is disabled on the host 9/14/2016 3:21 PM Middleware::Response Module is disabled on the host ------------------------------------------------------------------------------ ---------------------------------ClientUpdater-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response Success ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ----------------------------------TaskReboot---------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response Success ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------HostnameChanger------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response Success 9/14/2016 3:21 PM HostnameChanger Checking Hostname 9/14/2016 3:21 PM HostnameChanger Hostname is correct 9/14/2016 3:21 PM HostnameChanger Attempting to join domain 9/14/2016 3:21 PM HostnameChanger Host is already joined to target domain ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ---------------------------------SnapinClient--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response No snapins ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------PrinterManager-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response Module is disabled on the host 9/14/2016 3:21 PM PrinterManager Getting installed printers ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------PowerManagement------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response Success 9/14/2016 3:21 PM PowerManagement Calculating tasks to unschedule 9/14/2016 3:21 PM PowerManagement Calculating tasks to schedule ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ----------------------------------UserTracker--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:21 PM Client-Info Client Version: 0.11.5 9/14/2016 3:21 PM Client-Info Client OS: Windows 9/14/2016 3:21 PM Client-Info Server Version: 1.3.0-RC-10 9/14/2016 3:21 PM Middleware::Response Success 9/14/2016 3:21 PM Middleware::Communication URL: http://fogserver/fog/service/usertracking.report.php?action=login&user=228-LAB-111385\t711933-228&mac=10:60:4B:87:83:7B||00:00:00:00:00:00:00:E0&newService&jsonLog for 11.2 (Our current image has this version on it, so a fresh image would start at 11.2 then self update to 11.5 before)
------------------------------------------------------------------------------ ----------------------------------UserTracker--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 8:49 AM Client-Info Client Version: 0.11.2 9/14/2016 8:49 AM Client-Info Client OS: Windows 9/14/2016 8:49 AM Client-Info Server Version: 9/14/2016 8:49 AM Middleware::Response Success ------------------------------------------------------------------------------ 9/14/2016 8:49 AM Middleware::Communication URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&configure&newService&json 9/14/2016 8:49 AM Middleware::Response Success 9/14/2016 8:49 AM Service Sleeping for 335 seconds 9/14/2016 3:26 PM Main Overriding exception handling 9/14/2016 3:26 PM Main Bootstrapping Zazzles 9/14/2016 3:26 PM Controller Initialize 9/14/2016 3:26 PM Entry Creating obj 9/14/2016 3:26 PM Controller Start 9/14/2016 3:26 PM Service Starting service 9/14/2016 3:27 PM Bus Became bus server 9/14/2016 3:27 PM Bus { "self": true, "channel": "Status", "data": "{\r\n \"action\": \"load\"\r\n}" } 9/14/2016 3:27 PM Bus Emmiting message on channel: Status ------------------------------------------------------------------------------ --------------------------------Authentication-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Version: 0.11.2 9/14/2016 3:27 PM Client-Info OS: Windows 9/14/2016 3:27 PM Middleware::Authentication Waiting for authentication timeout to pass 9/14/2016 3:27 PM Middleware::Communication Download: http://fogserver/fog/management/other/ssl/srvpublic.crt 9/14/2016 3:27 PM Data::RSA FOG Server CA cert found 9/14/2016 3:27 PM Middleware::Authentication Cert OK 9/14/2016 3:27 PM Middleware::Communication POST URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&authorize&newService 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM Middleware::Authentication Authenticated 9/14/2016 3:27 PM Bus Registering ParseBus in channel Power 9/14/2016 3:27 PM Middleware::Communication URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&mac=00:24:81:98:23:94||00:00:00:00:00:00:00:E0&newService&json 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM Middleware::Communication URL: http://fogserver/fog/service/getversion.php?clientver&newService&json 9/14/2016 3:27 PM Middleware::Communication URL: http://fogserver/fog/service/getversion.php?newService&json 9/14/2016 3:27 PM Service Creating user agent cache 9/14/2016 3:27 PM Middleware::Response Module is disabled globally on the FOG server 9/14/2016 3:27 PM Middleware::Response Module is disabled on the host 9/14/2016 3:27 PM Middleware::Response Module is disabled on the host ------------------------------------------------------------------------------ ---------------------------------ClientUpdater-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM Middleware::Communication Download: http://fogserver/fog/client/SmartInstaller.exe 9/14/2016 3:27 PM Data::RSA FOG Project cert found 9/14/2016 3:27 PM Data::RSA ERROR: Certificate validation failed 9/14/2016 3:27 PM Data::RSA ERROR: Trust chain did not complete to the known authority anchor. Errors: A required certificate is not within its validity period when verifying against the current system clock or the timestamp in the signed file. (NotTimeValid) 9/14/2016 3:27 PM ClientUpdater ERROR: Update file is not authentic ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ----------------------------------TaskReboot---------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response Success ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------HostnameChanger------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM HostnameChanger Checking Hostname 9/14/2016 3:27 PM HostnameChanger Hostname is correct 9/14/2016 3:27 PM HostnameChanger Attempting to join active directory 9/14/2016 3:27 PM HostnameChanger Host is already joined to target domain ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ---------------------------------SnapinClient--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response No snapins ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------PrinterManager-------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response Module is disabled on the host 9/14/2016 3:27 PM PrinterManager Getting installed printers ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ --------------------------------PowerManagement------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM PowerManagement Calculating tasks to unschedule 9/14/2016 3:27 PM PowerManagement Calculating tasks to schedule ------------------------------------------------------------------------------ ------------------------------------------------------------------------------ ----------------------------------UserTracker--------------------------------- ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Client-Info Client Version: 0.11.2 9/14/2016 3:27 PM Client-Info Client OS: Windows 9/14/2016 3:27 PM Client-Info Server Version: 9/14/2016 3:27 PM Middleware::Response Success ------------------------------------------------------------------------------ 9/14/2016 3:27 PM Middleware::Communication URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&configure&newService&json 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM Service Sleeping for 329 seconds -
@UWPVIOLATOR said in Gui not responsive:
9/14/2016 3:27 PM Middleware::Communication URL: http://fogserver/fog/management/index.php?sub=requestClientInfo&configure&newService&json 9/14/2016 3:27 PM Middleware::Response Success 9/14/2016 3:27 PM Service Sleeping for 329 secondsSo that particular system is off time a bit. But why?
Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG! Get in contact with me (chat bubble in the top right corner) if you want to join in.
Web GUI issue? Please check apache error (debian/ubuntu: /var/log/apache2/error.log, centos/fedora/rhel: /var/log/httpd/error_log) and php-fpm log (/var/log/php*-fpm.log)
Please support FOG if you like it: https://wiki.fogproject.org/wiki/index.php/Support_FOG
-
@UWPVIOLATOR said in Gui not responsive:
---------------------------------ClientUpdater--------------------------------
9/14/2016 3:27 PM Client-Info Client Version: 0.11.2
9/14/2016 3:27 PM Client-Info Client OS: Windows
9/14/2016 3:27 PM Client-Info Server Version:
9/14/2016 3:27 PM Middleware::Response Success
9/14/2016 3:27 PM Middleware::Communication Download: http://fogserver/fog/client/SmartInstaller.exe
9/14/2016 3:27 PM Data::RSA FOG Project cert found
9/14/2016 3:27 PM Data::RSA ERROR: Certificate validation failed
9/14/2016 3:27 PM Data::RSA ERROR: Trust chain did not complete to the known authority anchor. Errors: A required certificate is not within its validity period when verifying against the current system clock or the timestamp in the signed file. (NotTimeValid)
9/14/2016 3:27 PM ClientUpdater ERROR: Update file is not authentic@Tom-Elliott this is exactly what is being seen here, I believe these two threads are suffering from the same thing.
-
@UWPVIOLATOR Crosslinking similar threads:
https://forums.fogproject.org/topic/8561/rc10-broken-items-on-upgrade/82 -
@Tom-Elliott said in Gui not responsive:
So that particular system is off time a bit. But why?
I don’t think it is. He posted the log 2 hours ago. 2 hours ago was 3:30, and the log says about 3:30. There’s something going on with the installer. I’m going to test client updating myself and see if I have the issue.
-
@Tom-Elliott said in Gui not responsive:
@ablohowiak a bit out of norm but can you change the config.class.php filr to use 127.0.01? I suspect the sockets are dropping to make room for other sockets, causing some portions to just drop php code. So because the socket is lost mid stream it causes the GUI to crash. Again this is all theoretical but it files like an issue I’ve seen before, which was why I switched from a socket connection to a TCP connection
So changing the client communication to 900 sec didn’t improve the gui performance, nor did disabling the client auto updater. Do you still suggest changing the config.class.php, and if so are there particular line or every instance of the server IP address?
Thanks. -
Auto update client is found in fog configuration font settings please disable app if it’s not already done stop web services for probably 5 minutes or so and all your clients should stop trying to download any file because there will be nothing to download then start web services do you still see the clients trying to update
-
@Tom-Elliott
Now with the client communication set to 900 and finding the second client update checkbox things are behaving better.
-
We were having this issue to. However, I haven’t had the time to dive into why the clients were failing to updated. But Wayne stated that the clients kept downloading from the server, which with a couple thousand hosts, this was flooding the pipe, and basically making the GUI unusable because the NIC was pegged. Once I unchecked those boxes things have been great. Maybe one day I will get that magical thing called time to dive into it with someone.
