No network interfaces found | Dell PowerEdge R650 | Intel E810-XXV

[george1421]

@djgalloway OK for debugging its pretty easy on your part (kind of).

You are going to connect that server to the network for pxe booting via the sfp+ port. You need the mac address of that network port you are using.

In fog manually register that host (in host management) with the collected mac interface. Now schedule a deploy image to that computer, we are not going to deploy anything during the debugging process. Before you hit the schedule task button tick the debug check box then schedule the task.

PXE boot the target computer, it should go right into imaging where you will not see the fog ipxe menu. After a few screens of text that you will need to clear with the enter key you will be dropped at the fos linux command prompt on the target computer.

Now I want you to run these debugging commands to help identify that hardware. Take a screen shot of the output. I’m most interesting in the hex codes that appear between the squared brackets on the next command.
lspci -nn | grep -i net

This should list all of the network adapters installed in that computer. We should see the LOM adapters and then the OPC or pcie adapters. I need the hex code to know what kernel model is missing.

The next command we need to search the syslog to see if there are any messages regarding missing firmware.

grep -i firm /var/log/syslog (check to confirm syslog file exists in /var/log directory. That should return any lines where firm is mentioned. For certain network adapters updated firmware (microcode) may be required. These need to be included in the custom kernel.

The next commands have nothing to do with the network but rather with the disk subsystem. Lets see if FOS Linux can see the disks in this server. (your next battle once network works).

lsblk
lspci -nn | grep -i raid

[djgalloway]

@george1421 Here you are!

Looks like it’s playing nice with the RAID controller at least.

[george1421]

Don’t worry about understanding this next part, these are notes on the hardware I need.

[8086:159b] “Ethernet Controller E810-XXV for SFP” first appeared in linux kernel 5.7.x, not currently included in FOS Linux kernel. One off kernel required.

Kernel config parameter: CONFIG_ICE

Firmware says ice director firmware for (something) for intex/ice/ddp/ice.pkg failed with error -2 [hint needs firmware]

raid controller is LSI SAS39xx [1000:10e2] lsblk sees 7 disks in non-raid format or software raid.

**It looks promising to build a custom kernel for this hardware.

[george1421]

@george1421 Here is the link to the one-off kernel :https://drive.google.com/file/d/18pWcju562KfM-iFbkD86ylWM5R2YxgK5/view?usp=sharing

This one is called bzImage5.15.44-ice Looking at the custom kernel I had the ice driver installed but was missing the firmware bit. So this kernel has CONFIG_ICE enabled as well as preloading the firmware intel/ice/ddp/ice-1.3.26.0.pkg into the kernel.

For installing it use the same instructions as the qed-2 kernel below, use the -ice name instead.

A short cut here is in the host definition you just created, there is a kernel field. Update that field to bzImage5.15.44-ice, then save the host profile. Reboot the target computer (assuming its still in debug mode). Have a quick eye, as you should see it now transfer bzImage5.15.44-ice to the target computer as it pxe boots. At the FOS Linux command prompt key in ip a s to see if it gives you an IP address now. If no report back and we will continue debugging.

[djgalloway]

Still no dice unfortunately. The NIC doesn’t show up in ip output at all.

[Sebastian Roth]

@george1421 Looks like the DDP binary blob needs to be named as ice.pkg without the version number (code ref). I don’t think I have seen this ever before and I am not sure the buildroot init is able to properly handle this.

Could you try manually renaming the file after cloning the firmware repo and adjust the filename within the kernel config?

[george1421]

@djgalloway OK updated version: https://drive.google.com/file/d/18jEOG-qqTpJOS6NzfBRzDXBu1E7O9ZHt/view?usp=sharing

Save as bzImage5.15.44-ice2

I did exactly what Sebastian mentioned. I copied the .pkg file to ice.pkg and did a complete rebuild on the kernel thats why it took a bit longer to complete.

[george1421]

@sebastian-roth said in No network interfaces found | Dell PowerEdge R650 | Intel E810-XXV:

I don’t think I have seen this ever before and I am not sure the buildroot init is able to properly handle this.

Same here on the naming convention. I’m building it outside of build root, but in a kernel dev environment so I have a bit more flexibility to create mischief.

[djgalloway]

@george1421 That did it!

Is there any additional information I could provide that might be helpful?

Is there any harm in replacing my existing bzImage files with this patched kernel?

[george1421]

@djgalloway said in No network interfaces found | Dell PowerEdge R650 | Intel E810-XXV:

Is there any additional information I could provide that might be helpful?

No that should do it if it sees the nic and it gets an IP address. Just remember to remove your debug deploy task and you should be done. It sees the disks so it should image now

Is there any harm in replacing my existing bzImage files with this patched kernel?

No harm in replacing your current default image. I would go in and change the global kernel parameter in the fog configuration -> fog settings -> expand add method. You just have to remember you are running under a one off kernel when/if you do a kernel update since the default kernel is something other than bzImage. But this kernel is the same that as what is released by the developers with the addition of the qed and ice spf+ drivers.

[djgalloway]

@george1421 Great, thanks much for your help. I don’t have a lot of spare cycles to donate to the project at the moment but I did just throw you all some beer money.

[george1421]

@djgalloway Thank you. Actually this thread helps advance the project too. The devs won’t add this driver to the main kernel but if they need to create a one off kernel the instructions are here.