@george1421 said:
FOG Configuration->FOG Settings->FOG Service->FOG_SERVICE_CHECKIN_TIME
cheers George!
@george1421 said:
FOG Configuration->FOG Settings->FOG Service->FOG_SERVICE_CHECKIN_TIME
cheers George!
@Wayne-Workman @george1421 Hi Wayne/George
Where do I find the client checkin time setting? I’ve checked fog settings and nothing shows up there. Could you point me in the right direction please?
cheers Kiweegie
@Tom-Elliott Morning Tom not sure if related to changes you made for me late last week or a new issue but since the teamviewer session we had, deployment of images fails with error below:
The offending line in path /var/www/html/fog/lib/fog/fogftpclass.php is on line 104
if (@ftp_login(self::$link,$username,$password) === false) self::ftperror();
no credentials have changed at all. Snapins deploy fine, only images are affected and we have tried with multiple images.
regards, Kiweegie.
@Tom-Elliott Nope, not without vpn to our corporate network
Possible red-herring but worthwhile raising the question I think.
watching connections via
ss -tp
throws up amongst a host of other connections
CLOSE-WAIT 1 0 Fog-server-IP:45260 54.93.153.156:http
CLOSE-WAIT 1 0 Fog-server-IP:45856 54.93.153.156:http
C:\Windows\System32>nslookup 54.93.153.156
Server: my_AD_Domain controller
Address: my_AD_Domain controller_IP
Name: ec2-54-93-153-156.eu-central-1.compute.amazonaws.com
Address: 54.93.153.156
for what reason would FOG be looking to connect to an Amazon IP??? I’m seeing a similar connection attempt to 52.28.249.93 which is another Amazon IP.
There are a load of ESTABLISHED connections showing like below which I believe to be the actual httpd processes though.
Proto Recv-Q Send-Q Local Address Foreign Address State
tcp 0 0 ::ffff:Fof_Server_IP:80 ::ffff:Client-IP:64981 ESTABLISHED
If you need any other logs etc to help get to the bottom of this I’m more than happy to oblige.
cheers Kiweegie.
@Tom-Elliott Sorry got sidetracked by lunch
Still several (40+) httpd processes running. FOGScheduler service is off.
Checking /var/log/httpd/access_log shows the following connections from multiple clients
10.***.***.*** - - [11/Mar/2016:14:26:50 +0000] "GET /fog/service/snapins.checkin.php?mac=D4:3D:7E:25:49:7F%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 4 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:50 +0000] "GET /fog/service/Printers.php?mac=D4:3D:7E:38:FE:60%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 12 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:50 +0000] "GET /fog/service/greenfog.php?mac=74:27:EA:AD:AC:0A%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 73 "-" "-"
10.***.***.***- - [11/Mar/2016:14:26:50 +0000] "GET /fog/service/autologout.php?mac=A4:1F:72:86:3A:A4%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 6 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:50 +0000] "GET /fog/service/autologout.php?mac=74:27:EA:CF:9A:FA%7C%7C00:00:00:00:00:00:00:E0%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 6 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:50 +0000] "GET /fog/service/servicemodule-active.php?moduleid=taskreboot&mac=A4:1F:72:86:5C:CB%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:51 +0000] "GET /fog/service/autologout.php?mac=A4:1F:72:86:5C:CB%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 6 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:53 +0000] "GET /fog/status/bandwidth.php?dev=eth0 HTTP/1.1" 200 47 "-" "-"
10.***.***.*** - - [11/Mar/2016:14:26:51 +0000] "GET /fog/service/printerlisting.php?newService=1 HTTP/1.1" 200 5 "-" "-"
And in /var/log/httpd/error_log seeing this
[Fri Mar 11 13:11:46 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::real_connect(): (08004/1040): Too many connections in /var/www/html/fog/lib/db/mysql.class.php on line 30
[Fri Mar 11 13:11:46 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::set_charset(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 31
[Fri Mar 11 13:11:46 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::select_db(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 40
[Fri Mar 11 13:11:46 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::select_db(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 40
[Fri Mar 11 13:11:46 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::query(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 52
[Fri Mar 11 13:11:48 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::real_connect(): (08004/1040): Too many connections in /var/www/html/fog/lib/db/mysql.class.php on line 30
[Fri Mar 11 13:11:48 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::set_charset(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 31
[Fri Mar 11 13:11:48 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::select_db(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 40
[Fri Mar 11 13:11:48 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::select_db(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 40
[Fri Mar 11 13:11:48 2016] [error] [client 10.***.***.***] PHP Warning: mysqli::query(): invalid object or resource mysqli\n in /var/www/html/fog/lib/db/mysql.class.php on line 52
df: `/home/fog/images': Permission denied
df: no file systems processed
[Fri Mar 11 13:22:15 2016] [warn] child process 2991 still did not exit, sending a SIGTERM
[Fri Mar 11 13:22:17 2016] [warn] child process 2991 still did not exit, sending a SIGTERM
[Fri Mar 11 13:22:19 2016] [warn] child process 2991 still did not exit, sending a SIGTERM
[Fri Mar 11 13:22:21 2016] [error] child process 2991 still did not exit, sending a SIGKILL
[Fri Mar 11 13:22:22 2016] [notice] caught SIGTERM, shutting down
[Fri Mar 11 13:23:30 2016] [notice] suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Fri Mar 11 13:23:30 2016] [notice] Digest: generating secret for digest authentication ...
[Fri Mar 11 13:23:30 2016] [notice] Digest: done
[Fri Mar 11 13:23:31 2016] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.6.19 mod_ssl/2.2.15 OpenSSL/1.0.1e-fips configured -- resuming normal operations
df: `/home/fog/images': Permission denied
df: no file systems processed
From another post I’ve looked at max connections in mysql (this is a CentOS 6.7 server)
su mysql
ulimit -n
1024
ulimit -a
core file size (blocks, -c) 0
data seg size (kbytes, -d) unlimited
scheduling priority (-e) 0
file size (blocks, -f) unlimited
pending signals (-i) 7414
max locked memory (kbytes, -l) 64
max memory size (kbytes, -m) unlimited
open files (-n) 1024
pipe size (512 bytes, -p) 8
POSIX message queues (bytes, -q) 819200
real-time priority (-r) 0
stack size (kbytes, -s) 10240
cpu time (seconds, -t) unlimited
max user processes (-u) 1024
virtual memory (kbytes, -v) unlimited
file locks (-x) unlimited
Does this look ok? Should I look to increase the max connections above 1024?
regards Kiweegie.
@Tom-Elliott HI Tom - I’ve restarted the server entirely twice which didn’t help. I’ve stopped the FOGScheduler service now and watching top to see if the httpd processes disappear but so far not happening.
Will post back in 10 with further report of above.
cheers Kiweegie.
Hi all
running version 5800 - noticed today loads of httpd processes running on my main FOG server and CPU was overloading. Similar to this post I noticed it due to alarms in VMWare.
I’ve updated to latest git version (6679) but still showing the same high CPU/multiple httpd processes.
I have a second FOG server which was on same version which does not exhibit this issue.
Is this linked in some way to the new FOG client calling the server? I have 4 users in our Service Desk who access the web GUI and even with no-one connected to the GUI I’m still seeing all these httpd connections.
httpd access and error logs not telling me much, anywhere else I can look to try and diagnose this issue?
cheers, Kiweegie.
@Tom-Elliott Well I’m officially a twat. Sorry for wasting your time… I shall be booking myself into an Alzheimers clinic immediately!
@Tom-Elliott thats what I thought Tom. Positive I installed it as part of base image, remember doing so.but have reinstalled on pre-sysprep again and uploading, Should know again in about 20 mins
I’ve had to fire up a new Win7 image for my service desk team to deploy over the weekend. I have created 2 images, a pre-sysprep and post-sysprep image.
This is using FOG version trunk@4617 based on command
git log
Image uploads and deploys fine but the post-sysprep image is missing the FOG service and there is no c:\fog.log file
Anyone seeing similar or can point me to workaround/fix?
regards Kiweegie
@Wayne-Workman HI Wayne, we’re all good.
Only steps needed to get this operational above and beyond your suggestions were to run exportfs -a after editing path in etc/exports and then making sure a .mntcheck file existed in each locaton /home/fog/images and /home/fog/images/dev
regards Kiweegie
@Rusty Hi Rusty for the host to which the snapin is not being deployed make sure it has an image associated with it and try redeploying. Thats another of the gotchas I’ve found.
Re the missing snapins, have you checked the server to see if the files exist at /opt/fog/snapins?
If not then just use the GUI to update the snapin and upload the file again.
regards Kiweegie.
@Wayne-Workman ok I’ve tried moving per your suggestions. Will need to wait til I’m back in the office monday to test. I have made this change on the 2 master nodes - the storage nodes all run ubuntu and have a more “regular” partition scheme (to me at least )
I am assuming I don’t need to alter the storage nodes to /home/images also and that the master will still transfer via replication from /home/images on the master to /images on the storage node?
Red the bigger drive suggestion our vmware storage at the remote sites is limited so that is the governing factor in the smaller hdd being used. The amount we have set is enough for the number of images we’re dealing with for now at least
regards Kiweegie
Image is still copying this morning but is being accurately limited to the 500kbps setting set on the storage node. Not sure what the issue was but suspect it may even have been erroneous reporting within our monitoring tool PRTG. Marking as resolved.
cheers, Kiweegie.
FOG Storage node now rebuilt and iftop on the master node shows traffic to the storage node sitting at around 520Kb. I’ll check again in the morning to make sure once image has transferred in full the traffic dies off and doesn’t keep firing packets over.
regards Kiweegie.
@Wayne-Workman Thanks Wayne will give that a go shortly. Im not opposed to rebuilding a server (I’m doing a storage node now) and I can easily expand the VM disk if needed. I was just hoping to save time as I’d already spent a fair bit of time rebuilding this particular machine and Tom Elliot chimed in with some assistance as the installer had some glitches.
I’m curious as to why Centos suddenly (?) has this particular partition scheme. Or have I just had my eyes closed all this time? Entirely possible.
cheers Kiweegie.
Well the server was still hogging a boat-load of bandwidth so I’m in the process of rebuilding it from scratch. Should know in about an hour or so if the bandwidth issue is sorted.
regards Kiweegie.
Evening all
I had an issue with the MySQL crashing which transpired to be due to disk filling up. I’m using CentOS 6.7 on VMWare 6.0 and the default partition scheme seems to be as follows.
I’ve done a test on brand new VM and the same partition scheme as what I have shows.
/images by default is on the root partition so I’ve only got 50GB to play with. Rather than wipe the machine and redo partitioning manually, can I move the /images folder to /home/images?
I found this post which mentions symlinking which is one approach but wondering if the FOG team have a recommended method for handling this?
In fact just now looking at the StorageManagement > DefaultMember settings the /images path is set there, is it as simple as editing the GUI here to the new path???
regards Kiweegie.
@Tom-Elliott Thanks Tom - checked this morning when I came into work and while the bandwidth wasn’t spiking above the 500Kbps limit it was still copying to the same storage node even though image was there already. Server and disk appear ok so I’m running with the theory (courtesy of your suggestion) that the image on node was corrupt. Binned that and allowing replication to repeat clean upload and will check how that goes.