Fog web interface times out loading almost any page

[Wayne Workman]

@Joseph-Hales That’s a lot of Apache2 there, Joe…

How many clients do you have running the fog client? what’s your check-in time set to?

[Joseph Hales]

FOG_SERVICE_CHECKIN_TIME 60
Hosts found 6781
I updated to SVN 4666 this morning I don’t see the failure to load issue so far but not many users are logged in yet but page load times are about 5 seconds on the host search page when searching for one host and listing all hosts takes about 50 seconds I also get the install database upgrade page occasionally at random times.

[Joseph Hales]

I also am only running the legacy client at this time. Finally the home page is always displaying that there are pending MAC’s that need approval but when I go to approve it fails to find any.

[Wayne Workman]

@Joseph-Hales said:

I also am only running the legacy client at this time. Finally the home page is always displaying that there are pending MAC’s that need approval but when I go to approve it fails to find any.

Is your setup virtualized and do you have a snapshot ? Do you have DB backups available ?

For example, I take a snapshot before every update, and export my DB stuff before every update. I keep the last two snapshots and ALL the DB backups. Plus I use samba to easily backup my images too.

I only ask about the backups because of this https://forums.fogproject.org/topic/5716/some-clients-disappear-from-web-interface-but-are-still-present-in-databse

[Joseph Hales]

No its not virtualized and if I loose some client records its not the end of the world I may be seeing this issues as well if the mac address’s are deleted should I clean out the database of these records. If so can you give me the mysql command to do this

[Wayne Workman]

@Joseph-Hales said:

No its not virtualized and if I loose some client records its not the end of the world I may be seeing this issues as well if the mac address’s are deleted should I clean out the database of these records. If so can you give me the mysql command to do this

I’m 100% sure we can give you a command to do that, but if you have a host export you can just re import the data.

I have not tested this so be forewarned… backup your DB before hand.
FOG Configuration -> Configuration Save -> Export

DELETE FROM hosts WHERE hostID NOT IN (SELECT hmhostID FROM hostMAC);

[Joseph Hales]

I thought that command just saved the fog settings not the hosts and images?

[Joseph Hales]

When I try to connect to mysql it errors out with error too many connections I will update svn, reboot and try again.

[Joseph Hales]

Still run into the error ERROR 1040 (HY000): Too many connections

[Wayne Workman]

@Joseph-Hales said:

Still run into the error ERROR 1040 (HY000): Too many connections

I know what your issue is… you have tons of hosts… you need to increase your maximum connections!!!

There’s a section in this about just that https://wiki.fogproject.org/wiki/index.php/Troubleshoot_MySQL

[Wayne Workman]

@Joseph-Hales said:

I thought that command just saved the fog settings not the hosts and images?

That feature exports the entire DB. Everything.

[Joseph Hales]

Ok if someone could make a note in the wiki the my.cnf in ubuntu 14 seems to be located in /etc/mysql/ not the root of /etc/ that fixed my too many connections. It seems the update to 14 deleted my old my.cnf and reverted to the default 100 max connections. after clearing the bad records it seems I lost 1050 records. If I import an older backup made from the web page will it only add records that no longer exist or will it overwrite and delete the new records added since the backup?

[Joseph Hales]

Ok pages seem better and server load is down but my Task Management page fails to load at all, every other menu option loads normally.

[Wayne Workman]

@Joseph-Hales said:

If I import an older backup made from the web page will it only add records that no longer exist or will it overwrite and delete the new records added since the backup?

An import will blast your DB and place the import in place. You will loose all changes made since that backup was made.
Of course this doesn’t affect the ACTUAL images made since then, it just affects the image definitions in the DB. Those can be recreated manually via the Web UI. But you have to create them exactly as they were (image type, OS, Exact path and the path is case sensitive).

And I’ll make note in the WiKi about Ubuntu 14.

[Joseph Hales]

So the main fog page shows active and pending tasks but going to task management loads a blank page and truncate jobs and snapins affects 0 rows any ideas this seems to be the only show stopper issue I still have.

[Joseph Hales]

Ok bit the bullet and restored a backup of the database seems to have fixed the issue I will keep an eye on how it behaves under load today.