Posts made by Kiweegie

Hi folks been a while but we’re back using FOG again I’ve setup a multiple server/location setup all running on Ubuntu 18.04 and FOG 1.55. with a management node and storage node in our main site both set as Master, with the Storage node being Master for all bar one of 11 remote storage nodes.

Using location, WOL broadcast and LDAP plugins.

We had been deploying and capturing images fine after initial setup this week but today started getting this error.

Nothing has changed far as I can see and I’m not in the office today to test the machines myself but will look to do a debug boot tomorrow to see if i can see any errors,

I’ve found similar reports in here with error “permission denied” but not for Operation not supported.

My server setup (same across storage and normal nodes) is:

Ubuntu 18.04.3 virtual machines
2 drives, (dev/sda) x 30GB for OS, (dev/sdb) x 60 GB for images
/dev/sdb mounted to /mnt/images with fstab entry
/images directory has .mntcheck in required locations
ownership of the directory was set to fogproject user during setup
images appear to have owner set to root but changing this to fogproject user does not resolve issue.

This is happening when deploying both pre and post sysprepped images. We have another error on the post-syprepped ones generating an error “Windows could not complete the installation” but this is down to the fogclient being enabled on the base image when sysprep taken I think. I can sort that separately.

Any suggestions on above would be great.

And while I’m here can I just say now great the UI is looking these days! i had already seen the improvements the team had put in place when i was last using FOG about 3 odd years ago but its looking really slick now.

I’ve fully updated my documentation on the installation of above for our service desk teams and in case thats of use to anyone here I’m happy to share.

regards Tom

@Wayne-Workman HI Wayne know this is an old call but stumbled upon it when I had the same issue.

You were after a decent photo of the error for the wiki which I’ve not been able to get and adding in a codebox below just screws up but hopefully this workaround of text on a black background in notepad++ will do the trick

Also in my case for anyone else finding this later on I had moved the images directory to /home/fog/images and updated fog everywhere except for the /etc/exports file.

Amending that to read as

/home/fog/images *(ro,sync,no_wdelay,no_subtree_check,insecure_locks,no_root_squash,insecure,fsid=0)
/home/fog/images/dev *(rw,async,no_wdelay,no_subtree_check,no_root_squash,insecure,fsid=1)

And then running

exportfs -a

bypassed the error for me,.

cheers kiweegie.

@Quazz Hi Quazz yes main problem of high cpu usage appears to be much better - main server with most number of hosts is sitting at 5-30% CPU load roughly with no active tasks running. I’m testing now with images running to double check under load.

cheers Kiweegie.

@Quazz You’re quite right, apologies Quazz I stand corrected. I was in /opt/git/trunk and presumed running ./bin/installfog.sh would suffice. Must not be enough caffeine in the system this morning…

@Quazz Thanks Quazz but I am inside the bin directory as my screenshot shows I believe. It would fail well before there if not.

@Sebastian-Roth Just upgraded trunk (5554) using git now and getting this error on install

./bin/installfog.sh: line 452: installPackages: command not found

 * Confirming package installation

./bin/installfog.sh: line 456: confirmPackageInstallation: command not found

 * Configuring services


 * What is the storage location for your images directory? (/images)

@Wayne-Workman Hi Wayne

apologies for not getting back to you til now, other projects keep piling up… I’ve checked the DB as you suggested via the cli and although only 3 hosts are listed in the GUI the cli shows 270 hosts…

|    270 | FOG01-current   |                                              |        |         3 |            0 | 2016-05-21 11:28:20 | 2016-05-21 11:44:32 | foguser        | 0         |                    |                                                    |                   |                                                                                                    |                  |                                                                                                    |                  |                |            |            |             |            |              | 0000-00-00 00:00:00 | 6            |              |             | 1           |

Above is last snippet.

I guess I can just drop the DB and start over?

cheers Kiweegie.

@Tom-Elliott Hey Tom

another anomaly turned up since most recent changes. My Helpdesk team complained that all desktops with FOG client installed were boot looping. Work around was to remove all clients from the host management section in FOG. This permitted desktops to boot and not restart - suspect this is down to the old FOG client.

Only today getting time investigate this and noticed that when adding in a brand new host it seems to accept ok but nothing shows in the GUI when clicking List all hosts. If I export the list it shows one host only (I’ve added 2) but if I try and re-add the 2nd host i get error Hostname already exists.

Something funky going on with the database?

cheers Kiweegie

@Tom-Elliott Hey Tom, many thanks. Both servers now have access to the reports, fog settings etc pages. CPU usage still high but the servers are usable enough albeit slow. I’ll keep an eye on Jbobs progress with the new client.

thanks again, Kiweegie.

@Wayne-Workman Hi Wayne

here’s the output of apachetop on my main machine

last hit: 15:16:16         atop runtime:  0 days, 00:21:30             15:16:17
All:        22036 reqs (  17.1/sec)       4721.2K ( 3747.7B/sec)     219.4B/req
2xx:   22036 ( 100%) 3xx:       0 ( 0.0%) 4xx:     0 ( 0.0%) 5xx:     0 ( 0.0%)
R ( 30s):     454 reqs (  15.1/sec)         90.0K ( 3072.1B/sec)     203.0B/req
2xx:     454 ( 100%) 3xx:       0 ( 0.0%) 4xx:     0 ( 0.0%) 5xx:     0 ( 0.0%)

REQS REQ/S    KB KB/S URL
 210  7.00   1.0  0.0*/fog/service/servicemodule-active.php
  53  1.77  86.9  2.9 /fog/management/other/ssl/srvpublic.crt
  43  1.43   0.5  0.0 /fog/service/Printers.php
  30  1.00   0.2  0.0 /fog/service/autologout.php
  28  0.97   0.1  0.0 /fog/service/snapins.checkin.php
  17  0.59   0.9  0.0 /fog/management/index.php
  16  0.53   0.1  0.0 /fog/service/greenfog.php
  15  0.50   0.1  0.0 /fog/service/printerlisting.php
  14  0.47   0.1  0.0 /fog/service/getversion.php
  14  0.48   0.1  0.0 /fog/service/jobs.php
  13  0.45   0.1  0.0 /fog/service/hostname.php
   1  0.04   0.0  0.0 *

and from my second machine

last hit: 15:15:47         atop runtime:  0 days, 00:21:10             15:15:48
All:         5274 reqs (   4.2/sec)       1008.8K (  813.4B/sec)     195.9B/req
2xx:    5259 (99.7%) 3xx:      15 ( 0.3%) 4xx:     0 ( 0.0%) 5xx:     0 ( 0.0%)
R ( 30s):     190 reqs (   6.3/sec)         50.5K ( 1722.4B/sec)     272.0B/req
2xx:     190 ( 100%) 3xx:       0 ( 0.0%) 4xx:     0 ( 0.0%) 5xx:     0 ( 0.0%)

REQS REQ/S    KB KB/S URL
  80  2.67   0.4  0.0*/fog/service/servicemodule-active.php
  30  1.07  49.2  1.8 /fog/management/other/ssl/srvpublic.crt
  13  0.45   0.2  0.0 /fog/service/Printers.php
   9  0.35   0.0  0.0 /fog/service/hostname.php
   9  0.33   0.1  0.0 /fog/service/getversion.php
   9  0.35   0.0  0.0 /fog/service/jobs.php
   9  0.38   0.0  0.0 /fog/service/printerlisting.php
   9  0.36   0.0  0.0 /fog/service/snapins.checkin.php
   9  0.38   0.0  0.0 /fog/service/greenfog.php
   8  0.35   0.4  0.0 /fog/management/index.php
   5  0.17   0.0  0.0 /fog/service/autologout.php

Heading off home now but will be online later if more information required.

regards Kiweegie.

@Wayne-Workman Not a problem. Installed on both boxes and currently running - I need to run myself shortly but will fire over the results before i go in about 20 mins.

cheers, Kiweegie.

@Tom-Elliott hi Tom, updated once more and still the same CPU usage - FOG01 around mid 60% max and FOG02 around mid 30% max.

git-svn-id: https://svn.code.sf.net/p/freeghost/code/trunk@5312 71f96598-fa45-0410-b640-bcd6f8691b32

Added to that I cannot access the Storage management, Report management or FOG configuration page links within the web GUI any longer… All other links are ok.

cheers Kiweegie.

@Tom-Elliott Morning Tom

I upgraded late yesterday afternoon 26Apr GMT to the latest git release:

git-svn-id: https://svn.code.sf.net/p/freeghost/code/trunk@5303 71f96598-fa45-0410-b640-bcd6f8691b32

I’m still seeing high CPU usage. top shows CPU jumping between 25-65%

top - 11:20:20 up 6 days, 19:45,  1 user,  load average: 5.31, 4.77, 4.80
Tasks: 154 total,   3 running, 151 sleeping,   0 stopped,   0 zombie
Cpu(s): 50.4%us, 25.3%sy,  0.0%ni, 23.8%id,  0.0%wa,  0.0%hi,  0.5%si,  0.0%st
Mem:   1922092k total,  1720328k used,   201764k free,    86980k buffers
Swap:  4128764k total,     5512k used,  4123252k free,  1253364k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
 6726 mysql     20   0 1350m  51m 6596 S 11.3  2.8 103:15.15 mysqld
30973 apache    20   0  327m  13m 3856 S  9.3  0.7   1:30.69 httpd
31311 apache    20   0  327m  13m 3856 S  9.3  0.7   0:19.28 httpd
30135 apache    20   0  328m  13m 3856 R  9.0  0.7   4:06.95 httpd
30754 apache    20   0  328m  13m 3856 S  9.0  0.7   2:12.27 httpd
31364 apache    20   0  327m  13m 3856 S  9.0  0.7   0:10.67 httpd
30861 apache    20   0  327m  13m 3856 S  8.6  0.7   1:54.65 httpd
31356 apache    20   0  328m  13m 3856 S  8.6  0.7   0:11.72 httpd
31412 apache    20   0  327m  13m 3856 R  8.3  0.7   0:01.23 httpd
30728 apache    20   0  328m  13m 3856 S  7.6  0.7   2:13.29 httpd
31361 apache    20   0  328m  13m 3856 S  7.3  0.7   0:10.60 httpd
31403 apache    20   0  327m  13m 3716 S  6.6  0.7   0:02.80 httpd
30744 apache    20   0  327m  13m 3856 S  6.3  0.7   2:12.84 httpd
31314 apache    20   0  327m  13m 3856 S  6.0  0.7   0:19.26 httpd
31363 apache    20   0  328m  13m 3856 S  6.0  0.7   0:10.76 httpd
31400 apache    20   0  328m  13m 3856 S  6.0  0.7   0:02.77 httpd
31406 apache    20   0  327m  13m 3856 S  6.0  0.7   0:02.67 httpd
31414 apache    20   0  327m  13m 3848 S  6.0  0.7   0:01.41 httpd
31006 apache    20   0  328m  13m 3856 S  4.7  0.7   1:23.89 httpd
30857 apache    20   0  327m  13m 3856 S  3.7  0.7   1:53.48 httpd
30751 apache    20   0  327m  13m 3856 S  3.3  0.7   2:11.88 httpd
 9083 root      20   0  318m  24m 3528 S  1.7  1.3   2:59.69 FOGPingHosts
   11 root      20   0     0    0    0 S  0.3  0.0   4:23.42 events/0

This is happening on 2 servers, FOG01 with 267 hosts, and FOG02 which has 124 hosts. FOG02 has high-ish CPU usage also but not anywhere near as high as FOG01. Both servers are identical in terms of OS and FOG versions, located in same site albeit FOG01 is serving local clients and FOG02 our remote sites. FOG02 will eventually have the WOL and location plugins installed for this resason but does not currently.

Ref removing the old client in case that’s interfering can we use any fogservice.msi installer or must it be the exact same as was installed on the client?

I am also seeing apache errors in log as follows, multiple IP addresses listed with same error

[Wed Apr 27 12:07:57 2016] [error] [client 10.166.***.***] PHP Warning: implode(): Invalid arguments passed in /var/www/html/fog/lib/fog/eventmanager.class.php on line 67

Line in question in file refers to this one

$pluginfiles = array_values(array_filter(preg_grep(sprintf('#/(%s)/#',implode('|',$_SESSION['PluginsInstalled'])),array_map($fileitems,(array)$files))));

I had plugins installed on this box previously but now do not so that could be all that means…

regards Kiweegie.

@Wayne-Workman Thanks Wayne

well luckily I backup the 2 FOG servers in question…

Is it as simple as getting the original certs from backup and put back in the relevant file path on the new server? If so where do the certs reside in the file system?

Or is the SSL cert intrinsically linked to that server install and we need to update the clients. Looking for the path of least resistance.

cheers, Kiweegie.

Hi all, due to a non-FOG related issue on a couple of FOG boxes I had to rebuild them and since doing so am encountering very high CPU usage and multiple httpd processes.

top - 13:09:42 up 22:33,  1 user,  load average: 56.32, 45.19, 42.16
Tasks: 221 total,  47 running, 174 sleeping,   0 stopped,   0 zombie
Cpu(s): 56.9%us, 42.7%sy,  0.0%ni,  0.0%id,  0.0%wa,  0.0%hi,  0.3%si,  0.0%st
Mem:   1922092k total,  1666716k used,   255376k free,    92020k buffers
Swap:  4128764k total,     2304k used,  4126460k free,   644060k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
28249 mysql     20   0 1373m  59m 6588 S 11.0  3.2   1:16.55 mysqld
28903 apache    20   0  328m  15m 3840 R  4.2  0.8   0:02.84 httpd
28452 apache    20   0  421m  15m 4484 R  3.9  0.8   0:19.04 httpd
28666 apache    20   0  421m  15m 4480 R  3.9  0.8   0:13.70 httpd
28830 apache    20   0  425m  18m 4304 R  3.9  1.0   0:05.28 httpd
28838 apache    20   0  420m  14m 4392 R  3.9  0.8   0:02.58 httpd
28855 apache    20   0  424m  18m 4692 R  3.9  1.0   0:04.97 httpd
28883 apache    20   0  421m  14m 4256 R  3.9  0.8   0:03.23 httpd
28937 apache    20   0  425m  19m 4368 R  3.9  1.0   0:03.41 httpd
28966 apache    20   0  326m  13m 3872 R  3.9  0.7   0:02.60 httpd
28477 apache    20   0  422m  16m 4692 R  3.6  0.9   0:20.11 httpd
28723 apache    20   0  425m  19m 4684 R  3.6  1.1   0:11.49 httpd
28841 apache    20   0  326m  13m 3732 R  3.6  0.7   0:05.58 httpd
28885 apache    20   0  423m  16m 4056 R  3.6  0.9   0:04.08 httpd
28902 apache    20   0  425m  18m 4088 R  3.6  1.0   0:04.18 httpd
28919 apache    20   0  421m  14m 4112 S  3.6  0.8   0:03.90 httpd
28543 apache    20   0  421m  15m 4436 D  3.2  0.8   0:16.87 httpd
28846 apache    20   0  420m  14m 4416 R  3.2  0.8   0:04.00 httpd
28858 apache    20   0  420m  14m 4376 R  3.2  0.8   0:05.29 httpd
28910 apache    20   0  325m  13m 3844 S  3.2  0.7   0:04.08 httpd
28947 apache    20   0  420m  14m 4392 R  3.2  0.8   0:02.68 httpd
29022 apache    20   0  421m  14m 3752 S  3.2  0.7   0:01.36 httpd
29030 apache    20   0  420m  13m 3760 S  3.2  0.7   0:01.22 httpd
28704 apache    20   0  424m  17m 4772 R  2.9  0.9   0:14.33 httpd
28767 apache    20   0  421m  15m 4312 S  2.9  0.8   0:10.92 httpd
28848 apache    20   0  326m  14m 3892 S  2.9  0.8   0:05.33 httpd

tail /var/log/httpd/access_log

10.***.***.51 - - [20/Apr/2016:12:59:52 +0100] "GET /fog/service/servicemodule-active.php?
moduleid=displaymanager&mac=A4:1F:72:85:89:F4%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.47 - - [20/Apr/2016:12:59:51 +0100] "GET /fog/service/servicemodule-active.php?moduleid=snapinclient&mac=74:27:EA:EB:14:97%7C%7C00:00:00:00:00:00:00:E0%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.2 - - [20/Apr/2016:12:59:52 +0100] "GET /fog/service/snapins.checkin.php?mac=FC:AA:14:19:72:40%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 4 "-" "-"
10.***.***.9 - - [20/Apr/2016:12:59:51 +0100] "GET /fog/service/servicemodule-active.php?moduleid=autologout&mac=78:45:C4:0D:EE:BD%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.4 - - [20/Apr/2016:12:59:52 +0100] "GET /fog/service/Printers.php?mac=8C:89:A5:90:59:6B%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 12 "-" "-"
10.***.***.56 - - [20/Apr/2016:12:59:52 +0100] "GET /fog/service/servicemodule-active.php?moduleid=displaymanager&mac=FC:AA:14:12:F8:DE%7C%7C00:00:00:00:00:00:00:E0%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.59 - - [20/Apr/2016:12:59:52 +0100] "GET /fog/service/servicemodule-active.php?moduleid=clientupdater&mac=A4:1F:72:85:87:EE%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.7 - - [20/Apr/2016:12:59:52 +0100] "GET /fog/service/servicemodule-active.php?moduleid=greenfog&mac=FC:AA:14:19:76:E2%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 5 "-" "-"
10.***.***.31 - - [20/Apr/2016:12:59:52 +0100] "POST /fog/service/getversion.php HTTP/1.1" 200 4 "-" "-"
10.***.***.95 - - [20/Apr/2016:12:59:51 +0100] "GET /fog/service/hostname.php?moduleid=hostnamechanger&mac=74:27:EA:CE:0F:26%7C%7C00:00:00:00:00:00:00:E0&newService=1 HTTP/1.1" 200 233 "-" "-"

I suspect due to the rebuild the clients are trying to check in to the FOG server with old client version and CA cert. If I stop all 3 services (httpd, mysqld, FOGMulticastManager) and only start httpd all the processes spawn again and CPU ramps up again making FOG unusable.

Other than updating the new client/SSL combo on all my hosts is there away around this to stop the https processes maxing out the CPU? Assuming of course thats whats causing the problem…

cheers. Kiweegie.

Cheers Wayne, you live and learn.

That sorted the issue. Please mark this as resolved.

Regards. Kiweegie.

Installing latest trunk on clean CentOS 6.7 server with all updates, gets as far as updating/installing database in the installer but when opening URL in browser get this error re PHP version.

FOG Requires PHP v5.5.0 or higher. You have PHP v5.3.3

Nothing in the forum ref this particular error, is there a preferred means of upgrading to the latest version of php required?

I tried installing the scl package which pulls down php54 but this is not recognised.

Then tried the https://webtatic.com/packages/php54/ repo which installs the php54w package (first having to do yum remove php php-common but have seen some CentOS forums recommend against using this package due to the non-standard way they release packages.

Having said that while php -v returns the required package version FOG is looking for installer now fails with

Installing package:php...... Failed!

Anyone got a suggestion on how to get around this? Upgrading to CentOS 7 is not currently an option.

regards Kiweegie.

@Wayne-Workman HI Wayne thanks for the heads up. fog password in this case is purely alphanumeric though so don’t think that was it. Resetting the fog password has resolved my issue however so happy to have this one marked as solved.

regards Kiweegie.

@Tom-Elliott Hi Tom unfortunately I was going off the information passed to me by my service desk… which turns out to not be as accurate as I thought

I’ve tried deploying snapin and while there is no error thrown up in the GUI, c:\fog.log on target machine shows the same error as seen when trying to deploy image.

 14/03/2016 13:35 Middleware::Communication Unknown Response: Type: 2, File: /var/www/html/fog/lib/fog/fogftp.class.php, Line: 104, Message: ftp_login(): Login incorrect.

This would suggest that the fog or ftp user password has been changed but it has not been altered at least not by me. Entry in following 2 locations matched what I had in keepass

Storage Management > All Storage nodes > DefaultMember > Management Password
FOG Configuration > FOG Settings > TFTP Server > FOG_TFTP_FTP_Password

However, resetting the fog user password at commandline fixed the issue…

Don’t understand who or what amended that password as only I have access to the box and it sure wasn’t me!

cheers . Kiweegie.