Disappearing hosts from host list

Tom Elliott

This can happen if the same mac exists across multiple hosts. This would leave the entry in the host table, but there would be no MAC Address associated with that host. If there’s no mac (in particular a primary mac address) then the host entry will exist in the host table (giving the hostname exists issue you’re referring to) but not appearing within the GUI as, for all intents and purposes, the host has become “invalid”.

Foglalt

I see. And how can i recover it? As if i dont see, i cant delete. (btw the new search function for me is strange a bit; i will post question in that regard if i have time to see if other info on that helps )

Wayne Workman

@Foglalt Try these first: https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_MySQL#Hosts_think_they_are_not_registered_.2F_can.27t_register_.2F_Already_Registered_.2F_other_weirdness

Foglalt

Hm that article part for me was new, thanks, it helped (i checked some and they are gone now normally). How can it happen anyway?

Wayne Workman

@Foglalt some of the trunk versions between 1.2.0 and 1.3.0 had serious issues. We’re confident those are resolved now in 1.3.0 onwards. You probably had the issue for a long time (junk data in your database) without even noticing an issue until just now.

cajos001

I upgraded from 1.2.0 to 1.3.0 yesterday and have the same problem as Foglalt. The hosts and printers are in the database but cannot be listed in the FOG web application. I’ve also done the steps detailed here https://wiki.fogproject.org/wiki/index.php?title=Troubleshoot_MySQL#Hosts_think_they_are_not_registered_.2F_can.27t_register_.2F_Already_Registered_.2F_other_weirdness
without success.

I would now like to try to get a fresh start as my database began it’s life in 2009. I’ve backed up my database and exported my hosts, printers etc to csv files so I can copy paste the information back into the FOG GUI. How do I make a fresh empty FOG database but keep my settings?

Wayne Workman

@cajos001 said in Disappearing hosts from host list:

I’ve backed up my database and exported my hosts, printers etc to csv files so I can copy paste the information back into the FOG GUI. How do I make a fresh empty FOG database but keep my settings?

I know you said you have copies of your data, but the instructions I give you will also include taking another backup.

SSH to your fog server (or log into it and open terminal). Become root with sudo -i

backup the fog db with mysqldump -D fog > /root/fogdbbackup.sql
Then just drop the fog database as so:

mysql
drop database fog;
exit

Then re-run the fog 1.3.0 installer. It’ll rebuild the DB for you.

If this goes south, you can always import the old db like this:

mysql -D fog < /root/fogdbbackup.sql

cajos001

@Wayne-Workman Thanks Wayne, I have followed your instructions and have a new fresh installation to work with.

cajos001

@Wayne-Workman It worked perfectly, Thanks.

Foglalt

Case reopened. I still use version 1.3.0 (well, have no time to test all versions in the last few subversions were fast to come out). Last time i could not register new host cos it said mac already used. not it says hostname exists, but i cant find it. (well, the new host lister part in gui is strange for me, but other hosts it list i search for but not this particular one).

Do you maybe have another tip what is it? (i did what you suggested last time, but now it “affected zero rows” now).

Wayne Workman

@Foglalt said in Disappearing hosts from host list:

Do you maybe have another tip what is it? (i did what you suggested last time, but now it “affected zero rows” now).

1.3.0 was such a massive improvement, but it does have issues. 1.3.4 is the current stable and it’s pretty good. I would first recommend upgrading to 1.3.4 to see if this solves your issue.

Foglalt

@Wayne-Workman

I did upgrade, but sadly it says that “hostname exists already”. as i am not an sql pro, can you pls tell me what else can be done to find reason fo it?

one more thing. as it first occured the colleague who found this issue uses his own “clone hosts” and when imaging comes, he only renew MAC of the new hw, changes image if needed, but hostname or host “item” is not deleted. it sounded absolutely working, but does it any wrong? (in my logic it doesnt, but pls confirm me)

Foglalt

Additional information, until you can suggest me anything how to remove the unwanted “already registered” host i watched the database with a browser to see manually under the hood. host is actually there in hosts table. as i dont know the links of tables i wont delete it but it may help if u need more info on this issue.

so, @Wayne-Workman or @Tom-Elliott (or anyone ofc) what can i do with this “lost” host in the database?

Wayne Workman

@Foglalt

So, the only reason why a host would exist in the hosts table but not appear in the web interface is if it doesn’t have a MAC address or if it’s pending. Time to dig in.

Jot down the exact hostname on paper, case sensitive. Then do the below, replacing the hostname with the one you wrote down and later the hostID, at the CLI:

mysql -D fog
select * from hosts where hostname='theHostname';

Note the hostID of the data returned (if any). Take that ID and then do this query:

select * from hostMAC where hmHostID='numberHere';

Anything returned? Please share what you find, if you copy/paste then use the code tool when posting here, the button looks like this in the editing area: </>

You exit MySQL CLI with the command quit

Foglalt

sorry for ugly output, from phone it is hard seems it has mac associated. what does pending means in this context?

+------+----------+-------------------+--------+-----------+-----------+--------                                                                                                                                                             --------+-----------------+
| hmID | hmHostID | hmMAC             | hmDesc | hmPrimary | hmPending | hmIgnor                                                                                                                                                             eClient | hmIgnoreImaging |
+------+----------+-------------------+--------+-----------+-----------+--------                                                                                                                                                             --------+-----------------+
|  414 |      107 | 9c:5c:8e:93:ac:dc |        | 0         | 0         | 0                                                                                                                                                                           | 0               |
+------+----------+-------------------+--------+-----------+-----------+--------                                                                                                                                                             --------+-----------------+
1 row in set (0.00 sec)

george1421

@Foglalt I fixed your ugly output.

Tom Elliott

Pending means the mac address has been registered, but is not “official” yet.

Foglalt

@george1421 thx for helping me out!

@Tom-Elliott and what does “not official” means?

Btw if zero means it is not pending, how can i get rid of this host? As it has mac, mac is not pending is it a legit host playing hide and seek somehow? Anyway i see one interesting thing. the problematic host’s mac has no primary flag. Can it be the problem? if i modify that from 0 to 1 maybe it comes back to visible? (can it be done with database browser anyway, or is it “rape” of the database integrity?

Wayne Workman

@Foglalt I just set all my MACs hmPending field to 0, everything is fine.

I need to see your problem myself. If you would message me via the forums messaging system, I can give you my email address and if you trust me enough, you can email me a copy of your database for me to look at. I should be able to very quickly figure out what’s wrong if I had a copy of your DB.

Wayne Workman

@Foglalt shared a copy of his DB with me, I have this figured out. It was related to the hmPrimary field in the hostMAC table.

FOG requires that each host have at least one MAC that is set to the primary. This host that is disappearing - for whatever reason - had a MAC associated to it that was not set as primary.

You can find all hosts that don’t have a primary MAC set with this command:

SELECT * FROM `hosts` WHERE `hostID` NOT IN (SELECT `hmHostID` FROM `hostMAC` WHERE `hmPrimary` = '1');

And you can delete them with these commands:

DELETE FROM `hosts` WHERE `hostID` NOT IN (SELECT `hmHostID` FROM `hostMAC` WHERE `hmPrimary` = '1');
DELETE FROM `hostMAC` WHERE `hmhostID` NOT IN (SELECT `hostID` FROM `hosts`);

I’ve updated the wiki with this maintenance command

Also - I don’t know how you got a clear-text password into the hostADPass field inside the hosts table - that shouldn’t even be possible. I’m suspecting someone did some manual work in the database and did that.

Disappearing hosts from host list

225

11.6k

17.1k

154.6k