Some clients disappear from web interface but are still present in databse

Matthieu Jacquart · Sep 14, 2015, 5:05 PM

I’ll paste log in chat, because on forum I’ve this error message :

Post content was flagged as spam by Akismet.com

Brian David · Sep 14, 2015, 11:00 PM

I experienced this issue today, currently working from git version 4644 (so it’s a few days old). I’ve had about five computers disappear from the web interface throughout the day, but they remain in the database.

Also, and I’m not sure it’s related, but the service settings on some of my hosts are being changed regularly. I have one computer in particular that will regularly have all of it’s services turned off for some reason. I then turn them back on, and it’s good for a few hours before the settings get wiped again.

I’m leaving work for the day and have the next two days off, but when I get back I’ll make a separate thread for the services issue if it’s still a problem.

Tom Elliott · Sep 14, 2015, 5:31 PM

Please update to stop the disappearing hosts. I’d even state, if you’re running trunk and the new client, UPGRADE IMMEDIATELY please.

I’m sorry it’s been so difficult to track down. Hopefully it is now corrected for. Please test.

We did patch a bug on the mac address, though, but apparently it made hosts disappear even faster. Jbob and I have narrowed it down to one thing. There is a load function that was occurring, but deleting the host primary mac. I’m so sorry…
Please forgive me?

Matthieu Jacquart · Sep 15, 2015, 1:45 AM

I updated and restore database from last save (last week-end), and 1 hour later at least 3 hosts disappear, on 3 different groups, I made no changes…

edit : we forgive you, you all make great job

Claude Girard · Sep 15, 2015, 1:00 PM

@Matthieu-Jacquart said:

I updated and restore database from last save (last week-end), and 1 hour later at least 3 hosts disappear, on 3 different groups, I made no changes…

edit : we forgive you, you all make great job

I can confirm this bad news.
I wanted to control my database, and I made this request in phpmyadmin:
SELECT * FROM hosts WHERE hostID NOT IN (SELECT hmhostID FROM hostMAC)
It returned 93 results
10 minutes later, the same request returned 101 results.
No operation made on fog interface between the requests.

Do I need to upgrade client too ? I don’t think so, some disappeared computers have legacy client installed

Wayne Workman · Sep 15, 2015, 7:02 AM

@Claude-Girard said:

@Matthieu-Jacquart said:

I updated and restore database from last save (last week-end), and 1 hour later at least 3 hosts disappear, on 3 different groups, I made no changes…

edit : we forgive you, you all make great job

I can confirm this bad news.
I wanted to control my database, and I made this request in phpmyadmin:
SELECT * FROM hosts WHERE hostID NOT IN (SELECT hmhostID FROM hostMAC)
It returned 93 results
10 minutes later, the same request returned 101 results.
No operation made on fog interface between the requests.

Do I need to upgrade client too ? I don’t think so, some disappeared computers have legacy client installed

That returned 41 rows for me… and I’m using the legacy client…

I’m going to restore a previous snapshot and see if that number decreases.

Yes, I’ve confirmed that the snapshot I just restored - when I ran that command, i got an empty set returned… ouch.

I’m not updating till we know this is fixed.

However I’m happy to update as much as the @Developers would like at home.

Trevelyan · Sep 15, 2015, 1:39 PM

Oops, just seen this - I guess I was searching for the wrong things - although I ended up doing everything else mentioned here…

I’ll watch with intrigue…

Joe Schmitt · Sep 15, 2015, 2:05 PM

@Claude-Girard @Matthieu-Jacquart @Wayne-Workman @Trevelyan @Brian-David
I need the fog.log file from disappeared hosts (preferably relatively soon after they vanished). Logs from the new client will be most helpful.

Claude Girard · Sep 15, 2015, 3:32 PM

How do I send it ? MP ?

Wayne Workman · Sep 15, 2015, 3:42 PM

@Claude-Girard said:

How do I send it ? MP ?

Just upload it to the forums, @Jbob can get it that way.

Matthieu Jacquart · Sep 16, 2015, 7:24 AM

Ok, I’m making a test : I empty database from all hosts and everything associated to hosts.
After that, I import all hosts with a csv file, and I’m putting them in their groups to modify parameters.
I started around 1 hour, for the moment all my hosts are still present…

Claude Girard · Sep 16, 2015, 8:26 AM

@Matthieu-Jacquart said:

I started around 1 hour, for the moment all my hosts are still present…

After restoring backup:
I deleted groups, and recreate them, include hosts in groups.
After 2 hours, hosts are still present.
But now some hosts dissapear from some groups.

Tom Elliott · Sep 16, 2015, 10:18 AM

@Claude-Girard So what you’re saying is, everything was fine for nearly 2 hours, then they just started removing themselves? Do you have multiple nodes? If you do have multiples, are they all on the same revision?

Claude Girard · Sep 16, 2015, 10:34 AM

@Tom-Elliott said:

@Claude-Girard So what you’re saying is, everything was fine for nearly 2 hours, then they just started removing themselves? Do you have multiple nodes? If you do have multiples, are they all on the same revision?

No, hosts are presents and stay presents, but some groups are modified, hosts disappear from group members only

Tom Elliott · Sep 16, 2015, 4:35 AM

@Claude-Girard WHEW

Thank you,

While that is an issue on it’s own, at least the host’s (themselves) are still in tact.

Tom Elliott · Sep 16, 2015, 10:35 AM

What are the steps I can take to attempt reproducing hosts losing their group associations?

Claude Girard · Sep 16, 2015, 2:20 PM

@Tom-Elliott said:

@Claude-Girard WHEW

Thank you,

While that is an issue on it’s own, at least the host’s (themselves) are still in tact.

Yes that’s the most important
No time today but tomorrow I’ll give more infos about group issue.
I’ll do more tests because after my restore, I prefered clean database by deleting some hosts and recreating them.
The ones that leave group were not.
I’ll try to delete them and see if after recreate problem pesist.

Claude Girard · Sep 16, 2015, 2:25 PM

@Claude-Girard And good news:
My sql request:
SELECT * FROM hosts WHERE hostID NOT IN (SELECT hmhostID FROM hostMAC)
hours ago !!!
returns 0 rows since last fog update,

Matthieu Jacquart · Sep 17, 2015, 4:26 AM

24 hours later, my 312 hosts are still in database and in web interface

Tom Elliott · Sep 17, 2015, 4:30 AM

I did make a commit earlier did reinsert the same type of problem. When informed, I reverted the code. I have re-reverted the code after testing many potential opportunities of the random delete issue. i’m not 100% it’s good to say, yay or nay, but from the limited potential I could test within, all seems to be normal.

This I have tried to “see it”

Add hosts to a group, with many updates at random times and settings.

Falsely having the client run tasks.

Properly having a client run tasks.

Updating the host directly (as well as others).

From different pages, insert the host or hosts as seen fit.

I’m not even seeing modules randomly appear or disappear.

Hopefully by the time i get in to work tomorrow I can put a solve setting on this thread.

Some clients disappear from web interface but are still present in databse

227

12.0k

17.3k

155.2k