Posts made by hlalex

@hlalex said in Dell Precision Tower 5820 - FlexBay MiniSAS PCIe NVMe SSD not recognized:

@george1421 Ok, F27 still installs and boots fine. When upgrading to F28, it fails to reboot and drops to a shell (:/#).

@george1421 Since none of the fresh install methods were working with F28, I tried F27 to make sure there it still worked properly (to rule out any settings/hardware changes). After getting F27 installed and booted properly, I then attempted to upgrade to F28 using the GUI software manager. This resulted in the same failure of F28 to boot as the fresh install method.

The logs I posted are from a fresh install of F28 on a SATA installed in one of the hot swap bays. And I completely agree on the oddness of this adapter. I can only assume they are trying to getthe most from the advertised 2700MB/s read & 1390MB/s write speeds of these drives, but in an easier to manage platform.

F28_4.18.16-200 running from SATA drive, does not detect NVMe with lsblk or blkid…

4.18.16-200.fc28.x86_64.log
4.18.16-200.fc28.x86_64_lsmod.log

@george1421 Ok, F27 still installs and boots fine. When upgrading to F28, it fails to reboot and drops to a shell (:/#).

blkid returns:

[  989.751061] Buffer I/O error on dev dm-0, logical block 13107184, async page read
[  989.751677] Buffer I/O error on dev dm-1, logical block 4092912, async page read

lsmod gives:

Module                     Size    Used By
hid_apple                 16384    0
nouveau                 2187264    1
video                     45056    1 nouveau
mxm_wmi                   16384    1 nouveau
i2c_algo_bit              16384    1 nouveau
drm_kms_helper           196608    1 nouveau
ttm                      126976    1 nouveau
drm                      475136    4 drm_kms_helper,ttm,nouveau 
e1000e                   282624    0 
nvme                      36864    1 
crc32c_intel              24576    0 
nvme_core                 81920    3 nvme
serio_raw                 16384    0 
wmi                       28672    2 mxm_wmi,nouveau 
uas                       69632    1 uas

journalctl | grep -i error :

kernel: print_req_error: I/O error, dev nvme0n1, sector 34844272
kernel: Buffer I/O error on dev dm-1, logical block 4092878, async page read 
# multiple iterations of ^ this error with different block #'s & dm-1/dm-0
systemd-fschk[564]: fsck: error 2 (No such file or directory) while executing fsck.ext2 for /dev/mapper/fedora-root
mount[569]: mount: /systoot: wrong fs type, bad option, bad superblock on /dev/mapper/fedora-root, missing codepage or helper program, or other error.

EDIT: Installing F28 to SATA drive now. I will pull logs and upload them when finished.

@george1421 I am attempting to install directly to the NVMe flexbay. To rule out any extraneous variables I am going back to the F27 4.13.9-300 Live install that was previously working with this drive arrangement. If it installs and boots, then I will try upgrading to F28 and pull logs. Then I will go back to trying to get logs for F28.

@george1421 Ok, I have tried both the live installer and net installer for F28. Both methods detect the drive during the installation process. After the reboot, I get dumped to a dracut shell complaining that /dev/mapper/xxx root and swap does not exist.

@george1421 Sorry for the delay, I had a drive fail in an array that has been taking up a lot of my time trying.

I missed @matijn’s last post and it has been deleted now… I will try to get those logs uploaded today.

@george1421 It connects directly to the MoBo beside the CPU slot, I posted a pic of the PCIE headers ~7 posts back.

@george1421 Ok, so the NVMe drive fits into a proprietary carrier, which then slides into a 3.5" SAS adapter (pics below). That slides into one of the two top hot swap bays on the 5820. The backplane on those bays connects to the MoBo via mini-SAS headers that Dell labels PCIe0 & PCIe1 (previous post).
EDIT: Forgot to mention, Windows recognizes the disk as @Matijn posted (PC400 NVMe SK hynix…). Not sure where to look for information on the actual hardware connection. Also, If i plug the 3.5" adapter into one of the bottom hotswap ports (SATA/SAS MoBo connection) it is not recognized at all.

@george1421 I got another system with the flex bay adapter via mini-sas port (Precision 7820). I was able to persuade the owner of said system to let me borrow the flex bay adapter for testing Fog. I now have a 5820 installed with the flex bay if you have any tests you would like to run

@matijn I actually did not have issues with the ODD ports (when used with 2.5 SSDs), they connect the two SATA ports on our 5820s. The two FlexBay ports are connected to PCIE0 and PCIE1, which are a mini-sas type connector (pic below). I can’t remember if I tried moving the flexbay NVMe to the standard hot swap bays, but I don’t believe I did.

@george1421 I have to get these drives shipped out by 3:30pm EST today. I anyone has any additional test let me know and I will get anything I can.

Otherwise, Thanks for all the help!

@george1421 Sure thing, I’m keeping them around as long as possible so we can get as much info as possible from them.

@george1421 Success!!

Here are the logs:

• bzImage4139-300m.log
• bzImage4139-300m_lshw.log

One thing I noticed is I got some weird DHCP messages before it booted to the debug console. I will try to replicate and grab an image if possible.

Edit: Shot of the DHCP messages. It says it didn’t get an IP, but it actually does. After pressing [enter] it drops to the debug shell.

@george1421 version N:

• bzImage41713n.log
• bzImage41713n_lshw.log

@george1421 Ok, got some data from windows device manager for the FlexBay drive:

PCI Memory Controller [ this was an uninitialized device, figured it best to include as it is a PCI device but probably not relevant ]

• PCI\VEN_8086&DEV_A2A1&SUBSYS_07381028&REV_00

Everything below l pertains to the M.2 connected to the FlexBay
Disk drive
Device instance path

• SCSI\DISK&VEN_NVME&PROD_PC401_NVME_SK_HY\5&1A7BC20F&0&000000

HW IDs

• SCSI\DiskNVMe____PC401_NVMe_SK_hy3E00
• SCSI\DiskNVMe____PC401_NVMe_SK_hy
• SCSI\DiskNVMe____
• SCSI\NVMe____PC401_NVMe_SK_hy3
• NVMe____PC401_NVMe_SK_hy3
• GenDisk

Status

• 0180200A
• DN_DRIVER_LOADED
• DN_STARTED
• DN_DISABLEABLE
• DN_NT_ENUMERATOR
• DN_NT_DRIVER

Class Guid

• {4d36e967-e325-11ce-bfc1-08002be10318}

Device stack

• \Driver\partmgr
• \Driver\Disk
• \Driver\EhStorClass
• \Driver\stornvme

Driver node strong name

• disk.inf:6d166ee9677c725c:disk_install.NT:10.0.16299.371:GenDisk

@george1421 FlexBay Parts:

414-BBBV : PCIe SSD (Front PCIe FlexBay)
Part Number Quantity Description
5G90D 1 INFORMATION, FRONT, PERIPHERAL COMPONENT INTERCONNECT EXPRESS , SOFTWARE SUPPORT DISKETTE, BOOT

401-ABJT : M.2 512GB PCIe NVMe Class 40 S olid State Drive
Part Number Quantity Description
XMW6J 1 SSDR, 512G, P34, 80S3, HYNIX, PC401

400-AVDR : Dell M.2 carrier
Part Number Quantity Description
66XHV 1 ASSEMBLY, DRIVE, BAY (DRIVE BAY), M.2, MODULE

@george1421 version M logs:

• bzImage41713m.log
• bzImage41713m_lshw.log

@sebastian-roth I just tested both options as kernel arguments and nothing seems to have changed.

I also tried the pcie_aspm.policy=powersave to no avail.

Let me know and I can try to post some logs before I have to punch out.

@george1421 Found a few references to this error:

https://bugs.archlinux.org/task/57331

https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1678184

https://forums.lenovo.com/t5/ThinkPad-T400-T500-and-newer-T/NVMe-APST-problem-controller-is-down/td-p/3847511

http://lists.infradead.org/pipermail/linux-nvme/2017-February/008008.html

it looks like the variable to set is nvme_core.default_ps_max_latency_us=<some_number_here>

I tried setting it to 0, 250, and 300 according some those posts (using the “Host Kernel Arguments” option in the host record) and nothing seems to change.