• Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login
  • Recent
  • Unsolved
  • Tags
  • Popular
  • Users
  • Groups
  • Search
  • Register
  • Login

Dell Precision Tower 5820 - FlexBay MiniSAS PCIe NVMe SSD not recognized

Scheduled Pinned Locked Moved
Hardware Compatibility
9
124
51.3k
Loading More Posts
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • H
    hlalex
    last edited by hlalex Aug 8, 2018, 7:19 AM Aug 8, 2018, 1:18 PM

    EDIT: This was from a Fedora 27 Live CD.

    I think the very last entry is what we are looking for.

    sudo lspci -k -nn
    00:00.0 Host bridge [0600]: Intel Corporation Sky Lake-E DMI3 Registers [8086:2020] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    00:04.0 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.1 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.2 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.3 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.4 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.5 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.6 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:04.7 System peripheral [0880]: Intel Corporation Sky Lake-E CBDMA Registers [8086:2021] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ioatdma
    	Kernel modules: ioatdma
    00:05.0 System peripheral [0880]: Intel Corporation Sky Lake-E MM/Vt-d Configuration Registers [8086:2024] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    00:05.2 System peripheral [0880]: Intel Corporation Device [8086:2025] (rev 04)
    00:05.4 PIC [0800]: Intel Corporation Device [8086:2026] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    00:08.0 System peripheral [0880]: Intel Corporation Sky Lake-E Ubox Registers [8086:2014] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    00:08.1 Performance counters [1101]: Intel Corporation Sky Lake-E Ubox Registers [8086:2015] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    00:08.2 System peripheral [0880]: Intel Corporation Sky Lake-E Ubox Registers [8086:2016] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    00:14.0 USB controller [0c03]: Intel Corporation 200 Series PCH USB 3.0 xHCI Controller [8086:a2af]
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: xhci_hcd
    00:14.2 Signal processing controller [1180]: Intel Corporation 200 Series PCH Thermal Subsystem [8086:a2b1]
    	Subsystem: Dell Device [1028:0738]
    00:16.0 Communication controller [0780]: Intel Corporation 200 Series PCH CSME HECI #1 [8086:a2ba]
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: mei_me
    	Kernel modules: mei_me
    00:17.0 SATA controller [0106]: Intel Corporation 200 Series PCH SATA controller [AHCI mode] [8086:a282]
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: ahci
    00:1c.0 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #1 [8086:a290] (rev f0)
    	Kernel driver in use: pcieport
    	Kernel modules: shpchp
    00:1c.6 PCI bridge [0604]: Intel Corporation 200 Series PCH PCI Express Root Port #7 [8086:a296] (rev f0)
    	Kernel driver in use: pcieport
    	Kernel modules: shpchp
    00:1f.0 ISA bridge [0601]: Intel Corporation Device [8086:a2d3]
    	Subsystem: Dell Device [1028:0738]
    00:1f.2 Memory controller [0580]: Intel Corporation 200 Series PCH PMC [8086:a2a1]
    	Subsystem: Dell Device [1028:0738]
    00:1f.3 Audio device [0403]: Intel Corporation 200 Series PCH HD Audio [8086:a2f0]
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: snd_hda_intel
    	Kernel modules: snd_hda_intel
    00:1f.4 SMBus [0c05]: Intel Corporation 200 Series PCH SMBus Controller [8086:a2a3]
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: i801_smbus
    	Kernel modules: i2c_i801
    00:1f.6 Ethernet controller [0200]: Intel Corporation Ethernet Connection (5) I219-LM [8086:15e3]
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: e1000e
    	Kernel modules: e1000e
    02:00.0 PCI bridge [0604]: Texas Instruments XIO2001 PCI Express-to-PCI Bridge [104c:8240]
    	Kernel modules: shpchp
    16:05.0 System peripheral [0880]: Intel Corporation Device [8086:2034] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS Configuration Registers [8086:2035] (rev 04)
    16:05.4 PIC [0800]: Intel Corporation Device [8086:2036] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.4 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.5 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.6 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:08.7 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:09.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:09.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.4 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.5 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.6 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0e.7 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0f.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:0f.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:208e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1d.0 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2054] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1d.1 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2055] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1d.2 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2056] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1d.3 System peripheral [0880]: Intel Corporation Sky Lake-E CHA Registers [8086:2057] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.0 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2080] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.1 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2081] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.2 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2082] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.3 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2083] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.4 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2084] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.5 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2085] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    16:1e.6 System peripheral [0880]: Intel Corporation Sky Lake-E PCU Registers [8086:2086] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:00.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port A [8086:2030] (rev 04)
    	Kernel driver in use: pcieport
    	Kernel modules: shpchp
    64:05.0 System peripheral [0880]: Intel Corporation Device [8086:2034] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS Configuration Registers [8086:2035] (rev 04)
    64:05.4 PIC [0800]: Intel Corporation Device [8086:2036] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:08.0 System peripheral [0880]: Intel Corporation Device [8086:2066] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:09.0 System peripheral [0880]: Intel Corporation Device [8086:2066] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0a.0 System peripheral [0880]: Intel Corporation Device [8086:2040] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0a.1 System peripheral [0880]: Intel Corporation Device [8086:2041] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0a.2 System peripheral [0880]: Intel Corporation Device [8086:2042] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0a.3 System peripheral [0880]: Intel Corporation Device [8086:2043] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0a.4 System peripheral [0880]: Intel Corporation Device [8086:2044] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0a.5 System peripheral [0880]: Intel Corporation Device [8086:2045] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0a.6 System peripheral [0880]: Intel Corporation Device [8086:2046] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0a.7 System peripheral [0880]: Intel Corporation Device [8086:2047] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0b.0 System peripheral [0880]: Intel Corporation Device [8086:2048] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0b.1 System peripheral [0880]: Intel Corporation Device [8086:2049] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0b.2 System peripheral [0880]: Intel Corporation Device [8086:204a] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0b.3 System peripheral [0880]: Intel Corporation Device [8086:204b] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0c.0 System peripheral [0880]: Intel Corporation Device [8086:2040] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0c.1 System peripheral [0880]: Intel Corporation Device [8086:2041] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0c.2 System peripheral [0880]: Intel Corporation Device [8086:2042] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0c.3 System peripheral [0880]: Intel Corporation Device [8086:2043] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0c.4 System peripheral [0880]: Intel Corporation Device [8086:2044] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0c.5 System peripheral [0880]: Intel Corporation Device [8086:2045] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0c.6 System peripheral [0880]: Intel Corporation Device [8086:2046] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0c.7 System peripheral [0880]: Intel Corporation Device [8086:2047] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0d.0 System peripheral [0880]: Intel Corporation Device [8086:2048] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0d.1 System peripheral [0880]: Intel Corporation Device [8086:2049] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    64:0d.2 System peripheral [0880]: Intel Corporation Device [8086:204a] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    64:0d.3 System peripheral [0880]: Intel Corporation Device [8086:204b] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    65:00.0 VGA compatible controller [0300]: NVIDIA Corporation GP106GL [Quadro P2000] [10de:1c30] (rev a1)
    	Subsystem: Dell Device [1028:11b3]
    	Kernel driver in use: nouveau
    	Kernel modules: nouveau
    65:00.1 Audio device [0403]: NVIDIA Corporation GP106 High Definition Audio Controller [10de:10f1] (rev a1)
    	Subsystem: Dell Device [1028:11b3]
    	Kernel driver in use: snd_hda_intel
    	Kernel modules: snd_hda_intel
    b2:02.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port C [8086:2032] (rev 04)
    	Kernel driver in use: pcieport
    	Kernel modules: shpchp
    b2:03.0 PCI bridge [0604]: Intel Corporation Sky Lake-E PCI Express Root Port D [8086:2033] (rev 04)
    	Kernel driver in use: pcieport
    	Kernel modules: shpchp
    b2:05.0 System peripheral [0880]: Intel Corporation Device [8086:2034] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    b2:05.2 System peripheral [0880]: Intel Corporation Sky Lake-E RAS Configuration Registers [8086:2035] (rev 04)
    b2:05.4 PIC [0800]: Intel Corporation Device [8086:2036] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    b2:12.0 Performance counters [1101]: Intel Corporation Sky Lake-E M3KTI Registers [8086:204c] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    b2:12.1 Performance counters [1101]: Intel Corporation Sky Lake-E M3KTI Registers [8086:204d] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    	Kernel driver in use: skx_uncore
    b2:12.2 System peripheral [0880]: Intel Corporation Sky Lake-E M3KTI Registers [8086:204e] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    b2:15.0 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    b2:16.0 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    b2:16.4 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
    	Subsystem: Dell Device [1028:0738]
    b2:17.0 System peripheral [0880]: Intel Corporation Sky Lake-E M2PCI Registers [8086:2018] (rev 04)
    b3:00.0 Non-Volatile memory controller [0108]: Device [1c5c:1527]
    	Subsystem: Device [1c5c:1527]
    	Kernel driver in use: nvme
    	Kernel modules: nvme
    

    Just for completeness:

    lsblk
    NAME        MAJ:MIN RM   SIZE RO TYPE MOUNTPOINT
    loop0         7:0    0   1.4G  1 loop 
    loop1         7:1    0   6.5G  1 loop 
    ├─live-rw   253:0    0   6.5G  0 dm   /
    └─live-base 253:1    0   6.5G  1 dm   
    loop2         7:2    0    32G  0 loop 
    └─live-rw   253:0    0   6.5G  0 dm   /
    sdb           8:16   1  14.6G  0 disk 
    └─sdb1        8:17   1  14.6G  0 part /run/initramfs/live
    sr0          11:0    1  1024M  0 rom  
    nvme0n1     259:0    0   477G  0 disk 
    ├─nvme0n1p1 259:1    0   650M  0 part 
    ├─nvme0n1p2 259:2    0   128M  0 part 
    ├─nvme0n1p3 259:3    0   499M  0 part 
    └─nvme0n1p4 259:4    0 475.7G  0 part 
    
    G 1 Reply Last reply Aug 8, 2018, 1:26 PM Reply Quote 0
    • G
      george1421 Moderator @hlalex
      last edited by Aug 8, 2018, 1:26 PM

      @hlalex I think you are spot on with your kernel driver name. The lsblk command from fedora is what I should expect from FOS.

      One last thing I should have asked for with fedora, will you provide the output of sudo uname -a That will tell us what kernel they are using.

      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

      1 Reply Last reply Reply Quote 0
      • H
        hlalex
        last edited by Aug 8, 2018, 1:35 PM

        Linux localhost-live 4.13.9-300.fc27.x86_64 #1 SMP Mon Oct 23 13:41:58 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux
        
        G 1 Reply Last reply Aug 8, 2018, 3:25 PM Reply Quote 0
        • G
          george1421 Moderator @hlalex
          last edited by Aug 8, 2018, 3:25 PM

          @hlalex Well after some research, I think I found what is missing. We may need to get the developers involved to recompile the FOS kernel.

          First some background.
          FC27
          Kernel used 4.13.9
          Device discovered

          b3:00.0 Non-Volatile memory controller [0108]: Device [1c5c:1527]
          	Subsystem: Device [1c5c:1527]
          	Kernel driver in use: nvme
          	Kernel modules: nvme
          

          FOS 1.5.4
          Kernel used 4.17.0 (or 4.15.2)
          Device b3:00.0 not found/kernel driver not available.

          Linux kernel config file found here: https://github.com/FOGProject/fos/blob/master/configs/kernelx64.config

          Setting disabled is on line 2925: https://github.com/FOGProject/fos/blob/master/configs/kernelx64.config#L2925

          #  CONFIG_NVMEM is not set
          

          CONFIG_NVMEM == "Support for NVMEM(Non Volatile Memory) devices like EEPROM, EFUSES…

          This framework is designed to provide a generic interface to NVMEM from both the Linux Kernel and the userspace.

          This driver can also be built as a module. If so, the module will be called nvmem_core."

          @Developers Opinion here? Is there a possibility to get this option turned on for linux kernels 4.15.2 and 4.17.0 for testing purposes?

          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

          1 Reply Last reply Reply Quote 0
          • H
            hlalex
            last edited by Aug 8, 2018, 6:46 PM

            I just received word from Dell that they are going to swap the FlexBay Carriers out for standard PCIe adapters (similar model to the adapters in the Precision 5810s) that should hopefully work without issues.
            I would like to provide as much information as I can before I have to ship them out, so please let me know what other logs/data/tests we may need to work out the issue. I’m sure these drives will become more prevalent in the near future and would like to help as much as I can. Not to mention I have another 40 system lab to refresh next summer, and I would love to have a solution if they wind up with this same drive configuration.

            G 1 Reply Last reply Aug 8, 2018, 6:57 PM Reply Quote 0
            • G
              george1421 Moderator @hlalex
              last edited by Aug 8, 2018, 6:57 PM

              @hlalex We surely like to get this addressed before you swap out the hardware. I’m sure others will either order the same hardware as you have, or other manufacturers will use this hardware design. It needs to be fixed.

              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

              1 Reply Last reply Reply Quote 0
              • H
                hlalex
                last edited by Aug 8, 2018, 7:59 PM

                @george1421 Agreed. It looks like the replacements will not ship until 8/14 so we have a bit of time for testing.

                What baffles me is that I have been in contact with multiple Dell Reps trying to determine exactly which hardware needs to be returned, and none have been able to answer what part is what or point me to any product information for this drive type. As far as I can tell from their site, this particular drive configuration is not currently offered as a retail addition. The specs related to the drive based on the dell support Service Tag lookup lists only:

                414-BBBV : PCIe SSD (Front PCIe FlexBay)
                Part Number Quantity Description
                5G90D 1 INFORMATION, FRONT, PERIPHERAL COMPONENT INTERCONNECT EXPRESS , SOFTWARE SUPPORT DISKETTE, BOOT

                401-ABJT : M.2 512GB PCIe NVMe Class 40 S olid State Drive
                Part Number Quantity Description
                XMW6J 1 SSDR, 512G, P34, 80S3, HYNIX, PC401

                400-AVDR : Dell M.2 carrier
                Part Number Quantity Description
                66XHV 1 ASSEMBLY, DRIVE, BAY (DRIVE BAY), M.2, MODULE

                I have looked high and low for any information on these part numbers with no luck.

                G 1 Reply Last reply Aug 9, 2018, 12:25 AM Reply Quote 0
                • G
                  george1421 Moderator @hlalex
                  last edited by Aug 9, 2018, 12:25 AM

                  @hlalex I went ahead and compiled the latest FOS kernel with the suspected missing module enabled. This is kernel version 4.17.13. Understand its not the official FOS kernel because it doesn’t have the customized patches that FOG kernel developers add, but should work for our test to see if we can init that nvme memory device.

                  I’ll IM you a link to the test kernel.

                  For this test download the linked kernel to /var/www/html/fog/service/ipxe on the fog server, leave the name as bzImage41713 Then go into the host record for one of these test systems and set the “Host Kernel” parameter to bzImage41713. Then finally pxe boot the target system into debug capture task. Run the lspci -nn command and see if we can detect

                  b3:00.0 Non-Volatile memory controller [0108]: Device [1c5c:1527]
                  

                  If its in the list then run the lsblk command to see if has something we can mount.

                  Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                  1 Reply Last reply Reply Quote 0
                  • H
                    hlalex
                    last edited by Aug 9, 2018, 11:48 AM

                    Good Morning @george1421. I stopped by the office to test the custom kernel (I’m going to pick up breakfast for my wife on my way home so she should be happy ;). No luck. The first attempt to boot gave init error, and I realized it was trying init_32.xz instead of init.xz. After adding init.xz to the "Host Init " parameter in the host record it booted into debug without issue. Bad news is that

                    b3:00.0 Non-Volatile memory controller [0108]: Device [1c5c:1527]
                    

                    does not show up with lspci -nn and only /dev/sdb (pxe boot usb) shows up with lsblk.

                    G 1 Reply Last reply Aug 9, 2018, 3:10 PM Reply Quote 0
                    • G
                      george1421 Moderator @hlalex
                      last edited by Aug 9, 2018, 3:10 PM

                      @hlalex Well, digging a bit deeper into this…

                      Going line by line…

                      FC27 I see that the disk controller is in SATA mode

                      00:17.0 SATA controller [0106]: Intel Corporation 200 Series PCH SATA controller [AHCI mode] [8086:a282]
                      	Subsystem: Dell Device [1028:0738]
                      	Kernel driver in use: ahci
                      

                      FOS the disk controllers was in Raid-on mode

                      00:17.0 RAID bus controller [0104]: Intel Corporation C600/X79 series chipset SATA RAID Controller [8086:2826]
                      

                      Note that the hardware ID changes between the two modes. (not pointing fingers here) But as I said before linux does not see the disks behind raid-on devices in uefi mode. Even if you are in bios mode, please change the value to ahci mode and pull the lspci from FOS. I don’t believe that lspci under FOS supports the -k prompt, but that info would be handy.

                      I also found another kernel module that was disabled called “Devices/Memory Controller drivers”. After a bit more research I’m going to compile and updated kernel with Memory Controller support enabled.

                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                      1 Reply Last reply Reply Quote 0
                      • H
                        hlalex
                        last edited by Aug 9, 2018, 4:17 PM

                        @george1421 I had noticed that as well, and double checked the Raid settings. It had been turned back on at some point (probably while I was going through everything else). I turned it back off and re-did the debug task with the same results.

                        It appears that the NVMe PCIe drives use an entirely separate controller from SATA drives. Apparently the specific controller/driver varies based on the interface between the MoBo and SSD. FOS can see the M.2 drives when the are connected via a standard PCIe adapter card, however when the same M.2 drive is connected via the FlexBay MiniSAS backplane, FOS no longer recognizes the drive. This holds true regardless of the SATA controller configuration–the drives are visible with both Raid & AHCI modes.

                        I found a dell support article that gives some good information about the differences between NVMe and AHCI here.

                        I checked through the FOS kernel, and found NVME Support is enabled in lines 880-890: https://github.com/FOGProject/fos/blob/master/configs/kernelx64.config#L880

                        #
                        # NVME Support
                        #
                        CONFIG_NVME_CORE=y
                        CONFIG_BLK_DEV_NVME=y
                        CONFIG_NVME_MULTIPATH=y
                        CONFIG_NVME_FABRICS=y
                        CONFIG_NVME_FC=y
                        CONFIG_NVME_TARGET=y
                        CONFIG_NVME_TARGET_LOOP=y
                        CONFIG_NVME_TARGET_FC=y
                        CONFIG_NVME_TARGET_FCLOOP=y
                        

                        Which explains why the drives are detected when plugged into a PCIe adapter. The MiniSAS connection is a completely different beast–or at least uses a different controller from the standard NVMe drive.

                        I will run through the debug again (with Raid off in bios) and post the results of lspci -nn, lsblk, uname -a, and anything else you suggest. I will also do the same thing with the M.2 plugged in through a PCIe adapter so we have comparison data.

                        G 1 Reply Last reply Aug 9, 2018, 4:21 PM Reply Quote 0
                        • G
                          george1421 Moderator @hlalex
                          last edited by george1421 Aug 9, 2018, 10:21 AM Aug 9, 2018, 4:21 PM

                          @hlalex I have 2 additional kernels for you to test, but I will only share with you tomorrow since you should have other activities planned for today.

                          Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                          H 1 Reply Last reply Aug 10, 2018, 3:21 PM Reply Quote 0
                          • H
                            hlalex @george1421
                            last edited by Aug 10, 2018, 3:21 PM

                            @george1421 Ok, I scripted data collection and pulled fresh info for kernels a, b, c, and F27 Live. I also pulled dmidecode, full lshw ouput, and /proc/diskstats to additional log files. Let me know if they may be of any use I will upload them as well.

                            bzImage41713a.log
                            bzImage41713b.log
                            bzImage41713c.log
                            F27_4139300.log

                            G 2 Replies Last reply Aug 10, 2018, 4:01 PM Reply Quote 1
                            • G
                              george1421 Moderator @hlalex
                              last edited by george1421 Aug 10, 2018, 10:02 AM Aug 10, 2018, 4:01 PM

                              @hlalex Very nice. I see somethings in the FC syslog, that are missing in FOS, namely PCI Hotplug and FOS is not initing all of the CPUs, FOS stops at 8. The Developers may need to reconsider an upper limit with these new systems.

                              That “memory controller” is surely the device we are after.

                              b3:00.0 Non-Volatile memory controller [0108]: Device [1c5c:1527]
                              
                              # and
                              [0.755229] pci 0000:b3:00.0: [1c5c:1527] type 00 class 0x010802
                              [0.755243] pci 0000:b3:00.0: reg 0x10: [mem 0xfb500000-0xfb503fff 64bit]
                              
                              # and
                              
                              [4.586882] nvme nvme0: pci function 0000:b3:00.0
                              [4.803854] nvme0n1: p1 p2 p3 p4
                              

                              I’m going to look into a few of the messages I diff’d between the two syslogs and see what I can tweak in the kernel configuration.

                              Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                              1 Reply Last reply Reply Quote 0
                              • G
                                george1421 Moderator @hlalex
                                last edited by Aug 10, 2018, 4:10 PM

                                @hlalex There is one more bit of data that would be useful from the FC running image. Collecting the output of lsmod to get the currently loaded dynamic modules (drivers). FOS doesn’t use dynamic modules, but instead use statically built in modules so lsmod will not work for FOS. But knowing what FC is loading will also feed into the tweaks needed.

                                Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                H 1 Reply Last reply Aug 13, 2018, 11:49 AM Reply Quote 0
                                • H
                                  hlalex @george1421
                                  last edited by Aug 13, 2018, 11:49 AM

                                  @george1421 Sorry for the delay, here is the output of lsmod on Fedora 27 Live (4.13.9-300). Let me know if anything else would be of use.

                                  Module                  Size  Used by
                                  fuse                  102400  3
                                  nf_conntrack_netbios_ns    16384  1
                                  nf_conntrack_broadcast    16384  1 nf_conntrack_netbios_ns
                                  xt_CT                  16384  1
                                  ip6t_rpfilter          16384  1
                                  ip6t_REJECT            16384  2
                                  nf_reject_ipv6         16384  1 ip6t_REJECT
                                  xt_conntrack           16384  21
                                  ip_set                 36864  0
                                  nfnetlink              16384  1 ip_set
                                  ebtable_nat            16384  1
                                  ebtable_broute         16384  1
                                  bridge                143360  1 ebtable_broute
                                  ip6table_nat           16384  1
                                  nf_conntrack_ipv6      20480  12
                                  nf_defrag_ipv6         36864  1 nf_conntrack_ipv6
                                  nf_nat_ipv6            16384  1 ip6table_nat
                                  ip6table_mangle        16384  1
                                  ip6table_raw           16384  1
                                  ip6table_security      16384  1
                                  iptable_nat            16384  1
                                  nf_conntrack_ipv4      16384  12
                                  nf_defrag_ipv4         16384  1 nf_conntrack_ipv4
                                  nf_nat_ipv4            16384  1 iptable_nat
                                  nf_nat                 28672  2 nf_nat_ipv6,nf_nat_ipv4
                                  nf_conntrack          131072  9 nf_conntrack_ipv6,nf_conntrack_ipv4,nf_conntrack_broadcast,nf_conntrack_netbios_ns,xt_CT,nf_nat_ipv6,xt_conntrack,nf_nat_ipv4,nf_nat
                                  libcrc32c              16384  2 nf_conntrack,nf_nat
                                  iptable_mangle         16384  1
                                  iptable_raw            16384  1
                                  iptable_security       16384  1
                                  ebtable_filter         16384  1
                                  ebtables               32768  3 ebtable_filter,ebtable_nat,ebtable_broute
                                  ip6table_filter        16384  1
                                  ip6_tables             28672  5 ip6table_mangle,ip6table_filter,ip6table_security,ip6table_raw,ip6table_nat
                                  snd_hda_codec_hdmi     49152  1
                                  intel_rapl             20480  0
                                  x86_pkg_temp_thermal    16384  0
                                  intel_powerclamp       16384  0
                                  nouveau              1638400  12
                                  coretemp               16384  0
                                  snd_hda_codec_realtek    94208  1
                                  kvm_intel             200704  0
                                  snd_hda_codec_generic    73728  1 snd_hda_codec_realtek
                                  kvm                   585728  1 kvm_intel
                                  mxm_wmi                16384  1 nouveau
                                  snd_hda_intel          40960  6
                                  i2c_algo_bit           16384  1 nouveau
                                  irqbypass              16384  1 kvm
                                  snd_hda_codec         126976  4 snd_hda_intel,snd_hda_codec_hdmi,snd_hda_codec_generic,snd_hda_codec_realtek
                                  ttm                    94208  1 nouveau
                                  drm_kms_helper        159744  1 nouveau
                                  snd_hda_core           81920  5 snd_hda_intel,snd_hda_codec,snd_hda_codec_hdmi,snd_hda_codec_generic,snd_hda_codec_realtek
                                  dell_wmi               16384  0
                                  drm                   352256  15 nouveau,ttm,drm_kms_helper
                                  intel_uncore          122880  0
                                  dell_smbios            16384  1 dell_wmi
                                  snd_hwdep              20480  1 snd_hda_codec
                                  sparse_keymap          16384  1 dell_wmi
                                  snd_seq                65536  0
                                  intel_rapl_perf        16384  0
                                  video                  40960  2 dell_wmi,nouveau
                                  iTCO_wdt               16384  0
                                  dcdbas                 16384  1 dell_smbios
                                  snd_seq_device         16384  1 snd_seq
                                  snd_pcm                98304  4 snd_hda_intel,snd_hda_codec,snd_hda_core,snd_hda_codec_hdmi
                                  mei_wdt                16384  0
                                  wmi_bmof               16384  0
                                  iTCO_vendor_support    16384  1 iTCO_wdt
                                  tpm_tis                16384  0
                                  dell_smm_hwmon         16384  0
                                  tpm_tis_core           20480  1 tpm_tis
                                  tpm                    53248  2 tpm_tis,tpm_tis_core
                                  snd_timer              32768  2 snd_seq,snd_pcm
                                  wmi                    24576  4 dell_wmi,wmi_bmof,mxm_wmi,nouveau
                                  snd                    81920  22 snd_hda_intel,snd_hwdep,snd_seq,snd_hda_codec,snd_timer,snd_hda_codec_hdmi,snd_hda_codec_generic,snd_seq_device,snd_hda_codec_realtek,snd_pcm
                                  intel_lpss_acpi        16384  0
                                  intel_lpss             16384  1 intel_lpss_acpi
                                  ioatdma                53248  0
                                  soundcore              16384  1 snd
                                  mei_me                 40960  1
                                  shpchp                 36864  0
                                  i2c_i801               24576  0
                                  mei                   102400  3 mei_me,mei_wdt
                                  dca                    16384  1 ioatdma
                                  vfat                   20480  1
                                  fat                    65536  1 vfat
                                  squashfs               53248  1
                                  hid_apple              16384  0
                                  8021q                  32768  0
                                  garp                   16384  1 8021q
                                  mrp                    20480  1 8021q
                                  stp                    16384  2 garp,bridge
                                  llc                    16384  3 garp,bridge,stp
                                  crct10dif_pclmul       16384  0
                                  crc32_pclmul           16384  0
                                  nvme                   32768  0
                                  crc32c_intel           24576  1
                                  e1000e                245760  0
                                  ghash_clmulni_intel    16384  0
                                  nvme_core              45056  1 nvme
                                  serio_raw              16384  0
                                  ptp                    20480  1 e1000e
                                  pps_core               20480  1 ptp
                                  uas                    24576  0
                                  usb_storage            69632  2 uas
                                  sunrpc                331776  1
                                  scsi_transport_iscsi    94208  0
                                  loop                   28672  6
                                  Module                  Size  Used by
                                  fuse                  102400  3
                                  nf_conntrack_netbios_ns    16384  1
                                  nf_conntrack_broadcast    16384  1 nf_conntrack_netbios_ns
                                  xt_CT                  16384  1
                                  ip6t_rpfilter          16384  1
                                  ip6t_REJECT            16384  2
                                  nf_reject_ipv6         16384  1 ip6t_REJECT
                                  xt_conntrack           16384  21
                                  ip_set                 36864  0
                                  nfnetlink              16384  1 ip_set
                                  ebtable_nat            16384  1
                                  ebtable_broute         16384  1
                                  bridge                143360  1 ebtable_broute
                                  ip6table_nat           16384  1
                                  nf_conntrack_ipv6      20480  12
                                  nf_defrag_ipv6         36864  1 nf_conntrack_ipv6
                                  nf_nat_ipv6            16384  1 ip6table_nat
                                  ip6table_mangle        16384  1
                                  ip6table_raw           16384  1
                                  ip6table_security      16384  1
                                  iptable_nat            16384  1
                                  nf_conntrack_ipv4      16384  12
                                  nf_defrag_ipv4         16384  1 nf_conntrack_ipv4
                                  nf_nat_ipv4            16384  1 iptable_nat
                                  nf_nat                 28672  2 nf_nat_ipv6,nf_nat_ipv4
                                  nf_conntrack          131072  9 nf_conntrack_ipv6,nf_conntrack_ipv4,nf_conntrack_broadcast,nf_conntrack_netbios_ns,xt_CT,nf_nat_ipv6,xt_conntrack,nf_nat_ipv4,nf_nat
                                  libcrc32c              16384  2 nf_conntrack,nf_nat
                                  iptable_mangle         16384  1
                                  iptable_raw            16384  1
                                  iptable_security       16384  1
                                  ebtable_filter         16384  1
                                  ebtables               32768  3 ebtable_filter,ebtable_nat,ebtable_broute
                                  ip6table_filter        16384  1
                                  ip6_tables             28672  5 ip6table_mangle,ip6table_filter,ip6table_security,ip6table_raw,ip6table_nat
                                  snd_hda_codec_hdmi     49152  1
                                  intel_rapl             20480  0
                                  x86_pkg_temp_thermal    16384  0
                                  intel_powerclamp       16384  0
                                  nouveau              1638400  12
                                  coretemp               16384  0
                                  snd_hda_codec_realtek    94208  1
                                  kvm_intel             200704  0
                                  snd_hda_codec_generic    73728  1 snd_hda_codec_realtek
                                  kvm                   585728  1 kvm_intel
                                  mxm_wmi                16384  1 nouveau
                                  snd_hda_intel          40960  6
                                  i2c_algo_bit           16384  1 nouveau
                                  irqbypass              16384  1 kvm
                                  snd_hda_codec         126976  4 snd_hda_intel,snd_hda_codec_hdmi,snd_hda_codec_generic,snd_hda_codec_realtek
                                  ttm                    94208  1 nouveau
                                  drm_kms_helper        159744  1 nouveau
                                  snd_hda_core           81920  5 snd_hda_intel,snd_hda_codec,snd_hda_codec_hdmi,snd_hda_codec_generic,snd_hda_codec_realtek
                                  dell_wmi               16384  0
                                  drm                   352256  15 nouveau,ttm,drm_kms_helper
                                  intel_uncore          122880  0
                                  dell_smbios            16384  1 dell_wmi
                                  snd_hwdep              20480  1 snd_hda_codec
                                  sparse_keymap          16384  1 dell_wmi
                                  snd_seq                65536  0
                                  intel_rapl_perf        16384  0
                                  video                  40960  2 dell_wmi,nouveau
                                  iTCO_wdt               16384  0
                                  dcdbas                 16384  1 dell_smbios
                                  snd_seq_device         16384  1 snd_seq
                                  snd_pcm                98304  4 snd_hda_intel,snd_hda_codec,snd_hda_core,snd_hda_codec_hdmi
                                  mei_wdt                16384  0
                                  wmi_bmof               16384  0
                                  iTCO_vendor_support    16384  1 iTCO_wdt
                                  tpm_tis                16384  0
                                  dell_smm_hwmon         16384  0
                                  tpm_tis_core           20480  1 tpm_tis
                                  tpm                    53248  2 tpm_tis,tpm_tis_core
                                  snd_timer              32768  2 snd_seq,snd_pcm
                                  wmi                    24576  4 dell_wmi,wmi_bmof,mxm_wmi,nouveau
                                  snd                    81920  22 snd_hda_intel,snd_hwdep,snd_seq,snd_hda_codec,snd_timer,snd_hda_codec_hdmi,snd_hda_codec_generic,snd_seq_device,snd_hda_codec_realtek,snd_pcm
                                  intel_lpss_acpi        16384  0
                                  intel_lpss             16384  1 intel_lpss_acpi
                                  ioatdma                53248  0
                                  soundcore              16384  1 snd
                                  mei_me                 40960  1
                                  shpchp                 36864  0
                                  i2c_i801               24576  0
                                  mei                   102400  3 mei_me,mei_wdt
                                  dca                    16384  1 ioatdma
                                  vfat                   20480  1
                                  fat                    65536  1 vfat
                                  squashfs               53248  1
                                  hid_apple              16384  0
                                  8021q                  32768  0
                                  garp                   16384  1 8021q
                                  mrp                    20480  1 8021q
                                  stp                    16384  2 garp,bridge
                                  llc                    16384  3 garp,bridge,stp
                                  crct10dif_pclmul       16384  0
                                  crc32_pclmul           16384  0
                                  nvme                   32768  0
                                  crc32c_intel           24576  1
                                  e1000e                245760  0
                                  ghash_clmulni_intel    16384  0
                                  nvme_core              45056  1 nvme
                                  serio_raw              16384  0
                                  ptp                    20480  1 e1000e
                                  pps_core               20480  1 ptp
                                  uas                    24576  0
                                  usb_storage            69632  2 uas
                                  sunrpc                331776  1
                                  scsi_transport_iscsi    94208  0
                                  loop                   28672  6
                                  
                                  G 2 Replies Last reply Aug 13, 2018, 4:24 PM Reply Quote 0
                                  • G
                                    george1421 Moderator @hlalex
                                    last edited by Aug 13, 2018, 4:24 PM

                                    @hlalex Did bzImage version D work any better than the previous ones? I uploaded it last Friday.

                                    Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                    H 1 Reply Last reply Aug 13, 2018, 5:31 PM Reply Quote 0
                                    • G
                                      george1421 Moderator @hlalex
                                      last edited by Aug 13, 2018, 5:01 PM

                                      @hlalex ok I found an interesting driver from your FC lsmod The one in question is shpchp which is “SHPC PCI Hotplug driver”, this is a specific hotplug driver (that is not currently enabled in “bzImage41713D”. I’m in the process of recompiling bzImage41713E. Lets see if that one gets us to that nvme drive. When I have version E uploaded I’ll send you an IM.

                                      Please help us build the FOG community with everyone involved. It's not just about coding - way more we need people to test things, update documentation and most importantly work on uniting the community of people enjoying and working on FOG!

                                      H 2 Replies Last reply Aug 13, 2018, 5:04 PM Reply Quote 0
                                      • H
                                        hlalex @george1421
                                        last edited by Aug 13, 2018, 5:04 PM

                                        @george1421 I must have missed version D, my bad. I will pull it and post the results ASAP.

                                        I will keep an eye out for E as well.

                                        1 Reply Last reply Reply Quote 0
                                        • H
                                          hlalex @george1421
                                          last edited by Aug 13, 2018, 5:31 PM

                                          @george1421 We are making some progress with version D. While booting I received the

                                          print_req_error: I/O error, dev nvme0n1, sector 0
                                          nvme nvme0: failed to set APST feature (-19)
                                          unable to open '/dev/nvme0n1'
                                          syspath not found
                                          

                                          error I was getting with Clonezilla live. This is the first time this error has shown up in FOS, which I believe is progress! (At least it knows there is an nvme disk installed, even if FOS can’t access it).

                                          Here are the logs from version D.

                                          bzImage41713D_lsmod.log
                                          bzImage41713D.log

                                          I’ll upload version E results shortly.

                                          G 1 Reply Last reply Aug 13, 2018, 6:03 PM Reply Quote 0
                                          • 1
                                          • 2
                                          • 3
                                          • 4
                                          • 5
                                          • 6
                                          • 7
                                          • 1 / 7
                                          1 / 7
                                          • First post
                                            18/124
                                            Last post

                                          150

                                          Online

                                          12.0k

                                          Users

                                          17.3k

                                          Topics

                                          155.2k

                                          Posts
                                          Copyright © 2012-2024 FOG Project