@george1421 George, I think I did reply to the proper thread… it is just a little confusing since someone else with a similar problem seems to have popped in!

Fog is version 1.5.4. This same server has been updated through many, many versions for 4 years or mo so maybe it has some lingering old stuff!

My phpinfo page does not indicate that I have FastCGI enabled. I’m reading through this thread ( https://forums.fogproject.org/topic/10717/can-php-fpm-make-fog-web-gui-fast/4 ) now to see whether there is information about getting mpm working.

@george1421 Huh. I’ve got Apache 2.0 Handler here. Should I follow the steps in the link or is there something else that I should do?

@wayne-workman I added those to mpm_event.conf which seemed like the right place to put them, but I’m not entirely sure!

I can’t really see any difference… maybe it is a tad more stable? What I’ve noticed more than anything with this testing though is that when I restart apache, it runs way, way better for a while. Like this morning, each page in the Fog UI was taking about a minute to load; I restarted apache and it was down to 5 seconds per page even when opening multiple pages at once.

@quazz Yes, 24.5GB of RAM.

Sitting idle, there are 25 apache2 processes using a total of 17% of the available memory. Apache is also using a lot of the cpu percentage as well - 64%.

php-fpm also has about 3 processes, but looks to be taking up only about 1.5% of the RAM.

I think a few things have likely been changed in the apache settings. The server was upgraded from Debian 7 last year which necessitated a few changes I think.

apache2ctl -l shows: core.c, mod_so.c, mod_watchdog.c, http_core.c, mod_log_config.c, mod_logio.c mod_version.c, and mod_unixd.c

@george1421 It has dynamic memory in a range from 4096 MB - 24576 MB.

For the vCPU, I just went with the defaults from Hyper-V I think - this was setup about 4 years ago. The description in the settings says:
Processors: 1
NUMA nodes: 1
Sockets: 1
Numa Topology:
Maximum number of processors: 12
Maximim amount of memory 13348 MB

We’ve got right around 500 clients.

OK, I’ve updated to 1.5.4, and I’d say it is at least marginally better. In the web interface, I tried opening 10 host pages, and it immediately bogged down again and wouldn’t load anything for a minute or two.

I can’t really say whether the problem is resolved yet since it always runs a bit better after restarting apache.

I’ll check it throughout the day and post back if there are continued problems.

Thanks!

I’ve been seeing a lot of sluggishness in the web UI for the past several updates, but didn’t think much of it. I updated to 1.5.3 earlier this week, and the memory usage from Fog is huge, and seems to now be effecting not just the web UI but also the base Fog functions - imaging is slower, tftp connections are timing out, etc.

I’ve assigned the Debian virtual machine that is running Fog 24576 MB of memory, and even with that much it is still trying to use more. Looking in top, apache2 has dozens of processes running and is sucking up all the memory. This is just when the server is sitting idle.

Any suggestions on how to troubleshoot this problem?

@sebastian-roth Following your steps, I get this:

ftp> mkdir /var/www/fog/service/ipxe/backup
550 Create directory operation failed.

It seems that I am able to rename the files though.

I also notice that all of the other files in the ipxe folder are owned by fog:www-data; however, the files the Fog is trying to create for the new kernel are owned by fog:fog. Could this be part of the problem?

One more observation: the fog GUI is reporting that the operation failed to ftp_mkdir and ftp_rename, however the file exists in the ipxe directory and has 8069680 bytes which is probably about right, right? Is the file being copied elsewhere also and failing there? Or, is the GUI error… in error?

@sebastian-roth I’ve gotten the same thing on 1.4.2, 1.4.4 and now on 1.5.0-RC-11

I’m having the exact same trouble. I’ve also worked through all of the steps in Troubleshoot FTP, and I also updated Fog today and applied all updates to the server OS (Debian Jesse with kernel 3.16.51-3).

I noticed the problem updating the kernel from the web interface where I get these errors:
Warning: ftp_mkdir(): Create directory operation failed. in /var/www/html/fog/lib/fog/fogftp.class.php on line 492

Warning: ftp_rename(): Rename failed. in /var/www/html/fog/lib/fog/fogftp.class.php on line 769
##OK##

All of my permissions look fine - fog has access to everything it needs to as far as I can tell! - and the password for the fog account is the same in all locations.