FOG 1.6, identified problems

lebrun78 · Nov 12, 2019, 9:01 AM

@Sebastian-Roth said in FOG 1.6, identified problems:

@lebrun78 Please take a look at the apache and PHP-FPM error logs (see my signature) and post here. With 5xx server error we should get a proper message in the logs as well.

Hello Sebatian
Here it is:
[12-Nov-2019 08:41:49 UTC] PHP Warning: ftp_login(): Login incorrect. in /var/www/html/fog/lib/fog/fogftp.class.php on line 274

@Tom-Elliott said in FOG 1.6, identified problems:

Also,

Added Link directly now to the Menu bar.

Hopefully that helps make it so much more accessible.

Thank you Tom-Elliott

Tom Elliott · Nov 12, 2019, 4:11 PM

@lebrun78 This error makes little sense.

I would understand the PHP error if you were actually in FOS environment, but you’re not. Your getting error 500 when loading the boot.php file.

Can you have a machine go to the boot.php file and tail the php-fpm error log? This should present the problem immediately. The boot.php doesn’t call FTP at that point, so this message seems unrelated (though would need to be fixed as well).

lebrun78 · Nov 12, 2019, 4:20 PM

@Tom-Elliott
I have nothin (so no error) in /var/log/php-fpm/www-error.log and /var/log/php-fpm/error.log when running boot.php on the client

Tom Elliott · Nov 12, 2019, 4:28 PM

@lebrun78 said in FOG 1.6, identified problems:

http://fogus/fog/service/ipxe/boot.php

So if you go to the above url directly all returns properly?

lebrun78 · Nov 12, 2019, 4:30 PM

@Tom-Elliott
It seems ok:

#!ipxe
set fog-ip 148.60.15.217
set fog-webroot fog
set boot-url http://${fog-ip}/${fog-webroot}
cpuid --ext 29 && set arch x86_64 || set arch i386
goto get_console
:console_set
colour --rgb 0x00567a 1 ||
colour --rgb 0x00567a 2 ||
colour --rgb 0x00567a 4 ||
cpair --foreground 7 --background 2 2 ||
goto MENU
:alt_console
cpair --background 0 1 ||
cpair --background 1 2 ||
goto MENU
:get_console
console --picture http://148.60.15.217/fog/service/ipxe/bg-plateforme.png --left 100 --right 80 && goto console_set || goto alt_console
:MENU
menu
colour --rgb 0xff0000 0 ||
cpair --foreground 1 1 ||
cpair --foreground 0 3 ||
cpair --foreground 4 4 ||
item --gap Host is NOT registered!
item --gap -- -------------------------------------
item fog.local Boot from hard disk
item fog.memtest Run Memtest86+
item fog.reginput Perform Full Host Registration and Inventory
item fog.reg Quick Registration and Inventory
item fog.deployimage Deploy Image
item fog.multijoin Join Multicast Session
item fog.advancedlogin Advanced Menu
choose --default fog.local --timeout 3000 target && goto ${target}
:fog.local
chain -ar ${boot-url}/service/ipxe/grub.exe --config-file="rootnoverify (hd0);chainloader +1" || goto MENU
:fog.memtest
kernel memdisk initrd=memtest.bin iso raw
initrd memtest.bin
boot || goto MENU
:fog.reginput
kernel bzImage32 loglevel=4 initrd=init_32.xz root=/dev/ram0 rw ramdisk_size=275000 web=http://148.60.15.217/fog/ consoleblank=0 rootfstype=ext4 storage=148.60.15.217:/images/ storageip=148.60.15.217 loglevel=4 mode=manreg
imgfetch init_32.xz
boot || goto MENU
:fog.reg
kernel bzImage32 loglevel=4 initrd=init_32.xz root=/dev/ram0 rw ramdisk_size=275000 web=http://148.60.15.217/fog/ consoleblank=0 rootfstype=ext4 storage=148.60.15.217:/images/ storageip=148.60.15.217 loglevel=4 mode=autoreg
imgfetch init_32.xz
boot || goto MENU
:fog.deployimage
#login
params
param mac0 ${net0/mac}
param arch ${arch}
param hostname ${hostname}
goto host_${hostname} || goto autres
:host_bug
:host_win10-3
:host_i207m01
:host_i207m02
:host_i207m03
:host_i207m04
:host_i207m05
:host_i207m06
:host_i207m07
:host_i207m08
:host_i207m09
:host_i207m10
set username i207stud
set password coucou
params
param username i207stud
param password coucou
param qihost 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme
goto fin
:autres
login
params
param username ${username}
param password ${password}
param qihost 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme
:fin
param sysuuid ${uuid}
:fog.multijoin
login
params
param mac0 ${net0/mac}
param arch ${arch}
param username ${username}
param password ${password}
param sessionJoin 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme
param sysuuid ${uuid}
:fog.advancedlogin
login
params
param mac0 ${net0/mac}
param arch ${arch}
param username ${username}
param password ${password}
param advLog 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme
param sysuuid ${uuid}
:bootme
chain -ar http://148.60.15.217/fog/service/ipxe/boot.php##params ||
goto MENU
autoboot

Tom Elliott · Nov 12, 2019, 4:40 PM

@lebrun78 You have a custom Boot.php file?

Maybe the output from PHP is perfect, but how IPXE is interpretting the information is causing the issue.

I’m very confused what you’re trying to do with your menu. And it’s almost difficult to break it down to it’s constituant parts.

Can you reset your “Deploy” ipxe menu to:

params
param mac0 ${net0/mac}
param arch ${arch}
param username ${username}
param password ${password}
param qihost 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme

and see if things are working. Feel free to copy your original menu items too, so you don’t lose it, but my guess is the error you’re seeing is in your customization.

lebrun78 · Nov 13, 2019, 10:02 AM

@Tom-Elliott

Hello

I tried by resetting the menu; but that does not work, the deploy menu runs in a loop.

The configuration on my test server was recovered by restoring the server’s mysql database in 1.4.4, so the boot menus are normally good

Sebastian Roth · Nov 13, 2019, 10:52 AM

@lebrun78 said in FOG 1.6, identified problems:

The configuration on my test server was recovered by restoring the server’s mysql database in 1.4.4, so the boot menus are normally good

Uhhhhmmm, not a good idea. FOG 1.6 is quite different to 1.5.x and even more to 1.4.4!! I am pretty sure your setup is now totally messed up with a DB recovery form 1.4.4 state.

When you initially setup the 1.6 server, did you install plain from scratch or did you start from a copy of an old server? It’s very hard to help if we only know part of what exactly you did.

lebrun78 · Nov 13, 2019, 10:57 AM

it’s a brand new server, (new hardware, new centos 8.0 distribution) except the fog database I restored.
I would like to keep machines, images, snapins configurations

lebrun78 · Nov 13, 2019, 11:29 AM

@Sebastian-Roth
with the restoration of the base, it seemed to work well.
Should I restart from scratched, installed and import from 1.4.4 export files for images, hosts, snapins?

Sebastian Roth · Nov 13, 2019, 11:33 AM

@lebrun78 said in FOG 1.6, identified problems:

Should I restart from scratched, installed and import from 1.4.4 export files for images, hosts, snapins

Definitely better to ex/import that stuff instead of using a complete DB dump from 1.4.4!!

Tom Elliott · Nov 13, 2019, 11:54 AM

@lebrun78 I’m not understanding here.

You made a change only to put it back in place and then test and found it’s still an issue?

This doesn’t make sense to me.

You have some customization going on. I don’t know where in the customization the issue is occurring.

By having it clean, you should be at what is needed for things when they’re working properly.

If you’re still getting error 500 from the boot.php, then chances are you will have an error in your php-fpm/www-error.log

You are trying to do too many things and we can’t help you if you’re doing that.

“I did that, but then I did this and it still isn’t working” doesn’t help because we don’t know at what point things stopped working.

If you started with a 100% clean database, do things work? I’d imagine if it were such a problem, i’d be seeing it too as I run working-1.6 for testing.

lebrun78 · Nov 13, 2019, 3:44 PM

Trying to import from an 1.4.4 export unsuccessful for images,hosts and users .
Is there log for imports ?

Sebastian Roth · Nov 13, 2019, 4:54 PM

@lebrun78 Have you checked the apache and PHP-FPM logs yet? See my signature.

Tom Elliott · Nov 13, 2019, 6:26 PM

I guess what i’m trying to establish in this thread:

I cannot replicate the error you’re seeing. And from what I can tell this is an error that’s been custom made.

The thread starts: FOG 1.6 Identified Problems.

Nothing, so far, besides the advanced menu issue which was addressed, and added the Client link within the menu system, has been a problem specific to FOG 1.6

I don’t know how to help any further with this as the 2 things requested that were not due to custom modifications to the iPXE menu have been addressed.

Were these the only 2 things identified and solved? If so, can you branch out your specific problems into a new thread. I’m getting rather lost on where a problem is and how we’re supposed to help further.

Do things work as intended out of box (before copying your 1.4.4 database over it?)

lebrun78 · Nov 13, 2019, 7:00 PM

I intended to move the draft version 1.6 forward by identifying errors as I progressed through the tests.
I’m going back to zero with the server’s operating system reinstallation.
I can create a thread for each error encountered if you prefer.

Tom Elliott · Nov 13, 2019, 7:14 PM

@lebrun78 I’m not saying you shouldn’t post issues here, I’m saying they should be specific to the issues of 1.6.

We addressed the 2 items that were related to issues in 1.6 - 1 being the advanced menu not having #!ipxe and then added the feature for the Client installer access on the menu.

The other items seem to be due to custom elements. Meaning, they’re not specific to 1.6 and not issues 1.6 is causing rather the custom things you’ve added.

I understand bringing up issues, but pushing everything here simply because you’re on 1.6 doesn’t mean it’s a problem 1.6 is causing, you know what I mean?

lebrun78 · Nov 13, 2019, 7:39 PM

@Tom-Elliott said in FOG 1.6, identified problems:

@lebrun78 I’m not saying you shouldn’t post issues here, I’m saying they should be specific to the issues of 1.6.

We addressed the 2 items that were related to issues in 1.6 - 1 being the advanced menu not having #!ipxe and then added the feature for the Client installer access on the menu.

The other items seem to be due to custom elements. Meaning, they’re not specific to 1.6 and not issues 1.6 is causing rather the custom things you’ve added.

these two features worked very well in version 1.4.4.
The start menus were identical under 1.4.4 and it was ok

The configuration obtained from the database seemed good, in the configuration interface and the generated files.
However, I will try again without starting from a restoration of the base. I will keep you informed on this thread.

Tom Elliott · Nov 13, 2019, 8:02 PM

@lebrun78 said in FOG 1.6, identified problems:

#login
params
param mac0 ${net0/mac}
param arch ${arch}
param hostname ${hostname}
goto host_${hostname} || goto autres
:host_bug
:host_win10-3
:host_i207m01
:host_i207m02
:host_i207m03
:host_i207m04
:host_i207m05
:host_i207m06
:host_i207m07
:host_i207m08
:host_i207m09
:host_i207m10
set username i207stud
set password coucou
params
param username i207stud
param password coucou
param qihost 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme
goto fin
:autres
login
params
param username ${username}
param password ${password}
param qihost 1
isset ${net1/mac} && param mac1 ${net1/mac} || goto bootme
isset ${net2/mac} && param mac2 ${net2/mac} || goto bootme
:fin
param sysuuid ${uuid}

I copied this into my menu and things worked perfectly fine. Of course I don’t have any hosts named host_win10-3 etc… but the point remains I’m not seeing any issues.

lebrun78 · Nov 14, 2019, 8:26 AM

@Sebastian-Roth said in FOG 1.6, identified problems:

@lebrun78 Have you checked the apache and PHP-FPM logs yet? See my signature.

Here is the image import file

00-etudiant-rentree2019,,etudiant-rentree2019,,,,,1,,9
1903-ELEC,,1903-ELEC,,,,,2,,9
1903-INFO,,1903-INFO,,,,,2,,9
1903-VIRT,salles 204 et 206,1903-VIRT,,,,,2,,9
win10light-1903,,win10light-1903,,,,,1,,9

tail -20 /var/log/httpd/access_log

148.60.15.217 - - [14/Nov/2019:09:12:47 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:47 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:47 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:47 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:48 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:48 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:48 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:48 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:49 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:49 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:50 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:50 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:50 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:50 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:51 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:51 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:52 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:51 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"
148.60.15.217 - - [14/Nov/2019:09:12:52 +0100] "GET /fog/status/bandwidth.php?dev=eno1 HTTP/1.1" 200 28 "-" "-"
148.60.10.10 - - [14/Nov/2019:09:12:52 +0100] "POST /fog/management/index.php?node=home&sub=bandwidth HTTP/1.1" 200 53 "http://148.60.15.217/fog/management/index.php?node=image&sub=import" "Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:70.0) Gecko/20100101 Firefox/70.0"

tail -20 /var/log/httpd/error_log

[Wed Nov 13 15:12:59.336472 2019] [suexec:notice] [pid 8977:tid 139894213593344] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
[Wed Nov 13 15:12:59.349238 2019] [lbmethod_heartbeat:notice] [pid 8977:tid 139894213593344] AH02282: No slotmem from mod_heartmonitor
[Wed Nov 13 15:12:59.351083 2019] [mpm_event:notice] [pid 8977:tid 139894213593344] AH00489: Apache/2.4.37 (centos) OpenSSL/1.1.1 configured -- resuming normal operations
[Wed Nov 13 15:12:59.351099 2019] [core:notice] [pid 8977:tid 139894213593344] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'
[Wed Nov 13 17:10:00.053054 2019] [mpm_event:notice] [pid 8977:tid 139894213593344] AH00492: caught SIGWINCH, shutting down gracefully
[Thu Nov 14 08:26:10.431342 2019] [suexec:notice] [pid 1209:tid 140320426273024] AH01232: suEXEC mechanism enabled (wrapper: /usr/sbin/suexec)
AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using fogus2.istic.univ-rennes1.fr. Set the 'ServerName' directive globally to suppress this message
[Thu Nov 14 08:26:10.993453 2019] [lbmethod_heartbeat:notice] [pid 1209:tid 140320426273024] AH02282: No slotmem from mod_heartmonitor
[Thu Nov 14 08:26:10.996363 2019] [mpm_event:notice] [pid 1209:tid 140320426273024] AH00489: Apache/2.4.37 (centos) OpenSSL/1.1.1 configured -- resuming normal operations
[Thu Nov 14 08:26:10.996388 2019] [core:notice] [pid 1209:tid 140320426273024] AH00094: Command line: '/usr/sbin/httpd -D FOREGROUND'

tail -20 /var/log/php-fpm/error.log

[13-Nov-2019 15:12:59] NOTICE: fpm is running, pid 8966
[13-Nov-2019 15:12:59] NOTICE: ready to handle connections
[13-Nov-2019 15:12:59] NOTICE: systemd monitor interval set to 10000ms
[13-Nov-2019 17:10:00] NOTICE: Terminating ...
[13-Nov-2019 17:10:00] NOTICE: exiting, bye-bye!
[14-Nov-2019 08:26:10] NOTICE: fpm is running, pid 1200
[14-Nov-2019 08:26:10] NOTICE: ready to handle connections
[14-Nov-2019 08:26:10] NOTICE: systemd monitor interval set to 10000ms

And no image imported

FOG 1.6, identified problems

200

12.0k

17.3k

155.2k