Slow UI High RAM usage.

Kagashe

Hi guys have had fog running for a few months now, loving so far of late though the Web UI is very slow in loading sometimes taking up to 5 minutes to load have also noticed ram usage is always high using all 16 GB of ram even when not imaging or replicating, any idea on how I can solve this?

Wayne Workman

@kagashe Some things:

What version of FOG?
What OS & version is your FOG Server?
Are you using the FOG Client, if so which version?
Please provide a screenshot from the output of the command top

Kagashe

I was running fog 1.5.0 RC 10 I think not sure now because the web ui isn’t even loading up anymore. OS was Ubuntu 16.04 LTS Fog clients used were 0.11.12.

Here is the output of top

top - 14:36:05 up 2 min,  1 user,  load average: 0.98, 0.71, 0.29
Tasks: 177 total,   1 running, 176 sleeping,   0 stopped,   0 zombie
%Cpu(s):  4.5 us,  4.2 sy,  0.0 ni, 91.3 id,  0.0 wa,  0.0 hi,  0.0 si,  0.0 st
KiB Mem : 16301456 total, 14480044 free,   464332 used,  1357080 buff/cache
KiB Swap:  4061180 total,  4061180 free,        0 used. 15494376 avail Mem

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
 1344 www-data  20   0  460980  21300  13144 S   7.3  0.1   0:01.37 apache2
 2981 www-data  20   0  460984  21120  12960 S   5.3  0.1   0:00.64 apache2
 1170 mysql     20   0 1795904 197548  23628 S   2.0  1.2   0:04.07 mysqld
  996 root      20   0   24044   2432   2068 S   0.3  0.0   0:00.01 vsftpd
 1316 root      20   0  430756  23568  13752 S   0.3  0.1   0:00.40 FOGMulticastMan
 1318 root      20   0  430756  23680  13864 S   0.3  0.1   0:00.09 FOGTaskSchedule
 1320 root      20   0  430756  23668  13856 S   0.3  0.1   0:00.36 FOGImageReplica
 3379 al        20   0   41804   3832   3192 R   0.3  0.0   0:00.04 top

Kagashe

Tried to do an upgrade but seems to be failing right at the end.

root@fogserver:~/fogproject/bin# ./installfog.sh
Installing LSB_Release as needed
 * Attempting to get release information.......................Done
systemd


   +------------------------------------------+
   |     ..#######:.    ..,#,..     .::##::.  |
   |.:######          .:;####:......;#;..     |
   |...##...        ...##;,;##::::.##...      |
   |   ,#          ...##.....##:::##     ..:: |
   |   ##    .::###,,##.   . ##.::#.:######::.|
   |...##:::###::....#. ..  .#...#. #...#:::. |
   |..:####:..    ..##......##::##  ..  #     |
   |    #  .      ...##:,;##;:::#: ... ##..   |
   |   .#  .       .:;####;::::.##:::;#:..    |
   |    #                     ..:;###..       |
   |                                          |
   +------------------------------------------+
   |      Free Computer Imaging Solution      |
   +------------------------------------------+
   |  Credits: http://fogproject.org/Credits  |
   |       http://fogproject.org/Credits      |
   |       Released under GPL Version 3       |
   +------------------------------------------+


   Version: 1.5.2 Installer/Updater


 * Found FOG Settings from previous install at: /opt/fog/.fogsettings

 * Performing upgrade using these settings


  Starting Debian based Installation



   ######################################################################
   #     FOG now has everything it needs for this setup, but please     #
   #   understand that this script will overwrite any setting you may   #
   #   have setup for services like DHCP, apache, pxe, tftp, and NFS.   #
   ######################################################################
   # It is not recommended that you install this on a production system #
   #        as this script modifies many of your system settings.       #
   ######################################################################
   #             This script should be run by the root user.            #
   #      It will prepend the running with sudo if root is not set      #
   ######################################################################
   #           ** Notice ** FOG is difficult to setup securely          #
   #        SELinux and IPTables are usually asked to be disabled       #
   #           There have been strides in adding capabilities           #
   #          The recommendations would now be more appropriate         #
   #    to set SELinux to permissive and to disable firewall for now.   #
   #  You can find some methods to enable SELinux and maintain firewall #
   #   settings and ports. If you feel comfortable doing so please do   #
   ######################################################################
   #            Please see our wiki for more information at:            #
   ######################################################################
   #             https://wiki.fogproject.org/wiki/index.php             #
   ######################################################################

 * Here are the settings FOG will use:
 * Base Linux: Debian
 * Detected Linux Distribution: Ubuntu
 * Server IP Address: 192.168.1.7
 * Server Subnet Mask: 255.255.255.0
 * Interface: enp3s0
 * Installation Type: Normal Server
 * Internationalization: 0
 * Image Storage Location: /images
 * Using FOG DHCP: No
 * DHCP will NOT be setup but you must setup your
 | current DHCP server to use FOG for PXE services.

 * On a Linux DHCP server you must set: next-server and filename

 * On a Windows DHCP server you must set options 066 and 067

 * Option 066/next-server is the IP of the FOG Server: (e.g. 192.168.1.7)
 * Option 067/filename is the bootfile: (e.g. undionly.kpxe)


 * Are you sure you wish to continue (Y/N) y

 * Installation Started

 * Installing required packages, if this fails
 | make sure you have an active internet connection.

 * Adding needed repository....................................OK
 * Preparing Package Manager...................................OK
 * Packages to be installed:

        apache2 bc build-essential cpp curl g++ gawk gcc genisoimage gzip htmldoc isolinux lftp libapache2-mod-php7.1 libc6 libcurl3 liblzma-dev m4 mysql-client mysql-server net-tools nfs-kernel-server openssh-server php7.1 php7.1-bcmath php7.1-cli php7.1-curl php7.1-fpm php7.1-gd php7.1-json php7.1-ldap php7.1-mbstring php7.1-mcrypt php7.1-mysql php-gettext sysv-rc-conf tar tftpd-hpa tftp-hpa unzip vsftpd wget xinetd zlib1g


 * Skipping package:   apache2.................................(Already Installed)
 * Skipping package:   bc......................................(Already Installed)
 * Skipping package:   build-essential.........................(Already Installed)
 * Skipping package:   cpp.....................................(Already Installed)
 * Skipping package:   curl....................................(Already Installed)
 * Skipping package:   g++.....................................(Already Installed)
 * Skipping package:   gawk....................................(Already Installed)
 * Skipping package:   gcc.....................................(Already Installed)
 * Skipping package:   genisoimage.............................(Already Installed)
 * Skipping package:   gzip....................................(Already Installed)
 * Skipping package:   htmldoc.................................(Already Installed)
 * Skipping package:   isolinux................................(Already Installed)
 * Skipping package:   lftp....................................(Already Installed)
 * Skipping package:   libapache2-mod-php7.1...................(Already Installed)
 * Skipping package:   libc6...................................(Already Installed)
 * Skipping package:   libcurl3................................(Already Installed)
 * Skipping package:   liblzma-dev.............................(Already Installed)
 * Skipping package:   m4......................................(Already Installed)
 * Skipping package:   mysql-client............................(Already Installed)
 * Skipping package:   mysql-server............................(Already Installed)
 * Skipping package:   net-tools...............................(Already Installed)
 * Skipping package:   nfs-kernel-server.......................(Already Installed)
 * Skipping package:   openssh-server..........................(Already Installed)
 * Skipping package:   php7.1..................................(Already Installed)
 * Skipping package:   php7.1-bcmath...........................(Already Installed)
 * Skipping package:   php7.1-cli..............................(Already Installed)
 * Skipping package:   php7.1-curl.............................(Already Installed)
 * Skipping package:   php7.1-fpm..............................(Already Installed)
 * Skipping package:   php7.1-gd...............................(Already Installed)
 * Skipping package:   php7.1-json.............................(Already Installed)
 * Skipping package:   php7.1-ldap.............................(Already Installed)
 * Skipping package:   php7.1-mbstring.........................(Already Installed)
 * Skipping package:   php7.1-mcrypt...........................(Already Installed)
 * Skipping package:   php7.1-mysql............................(Already Installed)
 * Skipping package:   php-gettext.............................(Already Installed)
 * Skipping package:   sysv-rc-conf............................(Already Installed)
 * Skipping package:   tar.....................................(Already Installed)
 * Skipping package:   tftpd-hpa...............................(Already Installed)
 * Skipping package:   tftp-hpa................................(Already Installed)
 * Skipping package:   unzip...................................(Already Installed)
 * Skipping package:   vsftpd..................................(Already Installed)
 * Skipping package:   wget....................................(Already Installed)
 * Skipping package:   xinetd..................................(Already Installed)
 * Skipping package:   zlib1g..................................(Already Installed)
 * Updating packages as needed.................................OK

 * Confirming package installation

 * Checking package: apache2...................................OK
 * Checking package: bc........................................OK
 * Checking package: build-essential...........................OK
 * Checking package: cpp.......................................OK
 * Checking package: curl......................................OK
 * Checking package: g++.......................................OK
 * Checking package: gawk......................................OK
 * Checking package: gcc.......................................OK
 * Checking package: genisoimage...............................OK
 * Checking package: gzip......................................OK
 * Checking package: htmldoc...................................OK
 * Checking package: isolinux..................................OK
 * Checking package: lftp......................................OK
 * Checking package: libapache2-mod-php7.1.....................OK
 * Checking package: libc6.....................................OK
 * Checking package: libcurl3..................................OK
 * Checking package: liblzma-dev...............................OK
 * Checking package: m4........................................OK
 * Checking package: mysql-client..............................OK
 * Checking package: mysql-server..............................OK
 * Checking package: net-tools.................................OK
 * Checking package: nfs-kernel-server.........................OK
 * Checking package: openssh-server............................OK
 * Checking package: php7.1....................................OK
 * Checking package: php7.1-bcmath.............................OK
 * Checking package: php7.1-cli................................OK
 * Checking package: php7.1-curl...............................OK
 * Checking package: php7.1-fpm................................OK
 * Checking package: php7.1-gd.................................OK
 * Checking package: php7.1-json...............................OK
 * Checking package: php7.1-ldap...............................OK
 * Checking package: php7.1-mbstring...........................OK
 * Checking package: php7.1-mcrypt.............................OK
 * Checking package: php7.1-mysql..............................OK
 * Checking package: php-gettext...............................OK
 * Checking package: sysv-rc-conf..............................OK
 * Checking package: tar.......................................OK
 * Checking package: tftpd-hpa.................................OK
 * Checking package: tftp-hpa..................................OK
 * Checking package: unzip.....................................OK
 * Checking package: vsftpd....................................OK
 * Checking package: wget......................................OK
 * Checking package: xinetd....................................OK
 * Checking package: zlib1g....................................OK

 * Configuring services

 * Setting up fog user.........................................Already setup
 * Setting up fog password.....................................OK
 * Stopping FOGMulticastManager.service Service................OK
 * Stopping FOGImageReplicator.service Service.................OK
 * Stopping FOGSnapinReplicator.service Service................OK
 * Stopping FOGScheduler.service Service.......................OK
 * Stopping FOGPingHosts.service Service.......................OK
 * Stopping FOGSnapinHash.service Service......................OK
 * Stopping FOGImageSize.service Service.......................OK
 * Setting up and starting MySQL...............................OK
 * Backing up user reports.....................................Done
 * Stopping web service........................................OK
 * Stopping FOGMulticastManager.service Service................OK
 * Stopping FOGImageReplicator.service Service.................OK
 * Stopping FOGSnapinReplicator.service Service................OK
 * Stopping FOGScheduler.service Service.......................OK
 * Stopping FOGPingHosts.service Service.......................OK
 * Stopping FOGSnapinHash.service Service......................OK
 * Stopping FOGImageSize.service Service.......................OK
 * Setting up and starting MySQL...............................OK
 * Setting up Apache and PHP files.............................OK
 * Testing and removing symbolic links if found................OK
 * Backing up old data.........................................OK
 * Copying new files to web folder.............................OK
 * Creating config file........................................OK
 * Unzipping the binaries......................................Done
 * Copying binaries where needed...............................Failed!

Wayne Workman

@kagashe said in Slow UI High RAM usage.:

Copying binaries where needed…Failed!

@Tom-Elliott this is the second recent occurrence of this error.

george1421

In your case its right to actually move off FOG 1.5.0 to 1.5.2 to eliminate the high CPU usage. BUT if you are still on 1.5.0 and its kind of working for you, please wait until 1.5.3 is released (in the next few days) there are some annoying issues with 1.5.2 that are already addressed in 1.5.3 (dev). The developers said that 1.5.3 should drop very soon.

Kagashe

Thanks @george1421 will give it a go, hopefully will fix the error highlighted by @Wayne-Workman.

Tom Elliott

@wayne-workman no change in how this works. Considering the number of people who updated and/or installed 1.5.2, 2 people having this issues does not mean there’s something wrong with the installer handling this.

Kagashe

@tom-elliott Any way to resolve the issue before the new version is out as I’ve got a bunch machines arriving that will need to be imaged?

Tom Elliott

@kagashe this is most likely something on your network preventing the download of the file. You could try deleting the current binaries1.5.2.zip file and rerun the installer. Are you behind a proxy?

Tom Elliott

This in regards to the downloading of the binaries file of course

Kagashe

@tom-elliott there was a 1.5.0 binaries folder sitting there which I deleted and that solved the binaries error, thanks for that, will monitor the ram usage as have upgraded to 1.5.2 and feedback the results.

Kagashe

Just an Update,

Ram Usage remains high however the UI has gone back to normal loading times so happy with that. One other issue I ran into is when adding or editing a snapin FOG says a name is required even though I have entered a name?

mp12

@kagashe check this thread. https://forums.fogproject.org/topic/5300/cant-upload-snapins-anymore

maybe it has something to do with the configuration of your php.ini file. post_max_size upload_max_filesize

what does apache error.log say?

Slow UI High RAM usage.

119

12.1k

17.3k

155.3k