@Wayne-Workman @george1421 thank you both so much. you’ve been incredibly helpful!

it appears to have fixed itself, i tried again on a whim today and im no longer having issues with the locations plugin. sooo problem solved i guess.

@jherron

I was able to resolve my own issue. ID10T error.

After reinstalling the storage servers at the respective sites and reassigning them to their groups, i had forgotten to set the locations plugin. After i set the servers in the location plugin everything resumed working as normal.

i have two storage nodes that i replaced at the beginning of the summer. everything seemed fine came up in the server, images replicated to them thought everything was good. if i try to image from them i get a chainloading error after the initial fog menu. i checked some logs and they both have some PHP-FPM error logs that repeat the same lines:

[23-Jul-2021 18:06:18 UTC] PHP Fatal error: Uncaught Exception: No valid storage nodes found in /var/www/html/fog/lib/fog/bootmenu.class.php:1495
Stack trace:
#0 /var/www/html/fog/lib/fog/bootmenu.class.php(434): BootMenu->getTasking()
#1 /var/www/html/fog/service/ipxe/boot.php(52): BootMenu->__construct()
#2 {main}
thrown in /var/www/html/fog/lib/fog/bootmenu.class.php on line 1495

i tried re-running the installer on one that wasnt working but nothign seemes to have changed. so i feel like i must have messed up a setting somewhere but im not sure where or what to look for.

server and nodes are all running 1.5.9 on cent os 7

@Sebastian-Roth on the fog server itself. it is not relevant to the error previosly posted sorry. i saw it when i logged into my vm server.

@Sebastian-Roth Thanks! i tried new tasks and it seems to be back in working order. is there a recommended amount of ram i should be using, i have it set to 10gigs and its using almost all of it.

https://imgur.com/KZcLjI5

picture to help out

i feel like im just a little off now. a successful pxe boot. but now if i deploy and image from the pxe menu it seems to start the task, but sits at a black screen where it occasionally tells me about how its missing some jiffies.

My fog server was running well on version 1.5.0. However we are moving offices, and we were 5 revisions behind so i decided i would migrate the fog server to a newer Vm server at the new building.

i Followed this guide :
https://wiki.fogproject.org/wiki/index.php?title=Migrate_FOG
everything seemed to go smoothly. i changed the ip address of the new server to the ip of the old server after turning the old one off. After upgrading my storage nodes there was a db connection issue, that after resetting the fogstorage password on the server seemed to get fixed. but im currently having two issues:

the first problem comes when i try to pxe boot a client. it looks to the correct Ip for tftp but it looks to its old address for http and then fails.
https://imgur.com/4ZqHn7D

the second issue is when i look at the logs for replication, all of the storage nodes continually say " waiting for mysql to become availiable" and im not sure what to do with that or if that is normal now.

@Sebastian-Roth
apparently i did not put the mac in properly. after hacing unintsalled the one who ip address was in the error log ther is still one in the DB

Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 14046881
Server version: 5.5.56-MariaDB MariaDB Server

Copyright (c) 2000, 2017, Oracle, MariaDB Corporation Ab and others.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

MariaDB [(none)]> use fog;
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A

Database changed
MariaDB [fog]> SELECT * FROM hostMAC WHERE hmMAC LIKE '%C8:D7:19:C2:E3:24%';
+------+----------+-------------------+--------+-----------+-----------+----------------+-----------------+
| hmID | hmHostID | hmMAC             | hmDesc | hmPrimary | hmPending | hmIgnoreClient | hmIgnoreImaging |
+------+----------+-------------------+--------+-----------+-----------+----------------+-----------------+
| 1317 |     1272 | c8:d7:19:c2:e3:24 |        | 1         |           |                |                 |
+------+----------+-------------------+--------+-----------+-----------+----------------+-----------------+
1 row in set (0.01 sec)

MariaDB [fog]>

how would i go removing it from the DB? quickly looking through i might have others as well

@Sebastian-Roth said in CPU maxed when Storage nodes go down:

SELECT * FROM hostMAC WHERE hmMAC LIKE ‘%aa:bb:cc:dd:ee:ff%’;

i ran the command and it comes up empty set again. the only thing different between now and then was i had uninstalled the client on that machine. its still maxed out utilization though.

i have also noticed that during the hours when no one is in CPU utilization is really low. am i just not throwing enough resources at this or is something fundamentally wrong with my setup?