Hello, On compatible SSD I could not find any information in manual and on OEM webpage. Are you possibly aware of any recommended list of compatible NVMe and how to find it? Please can you advise on how to handle the PCIe mismatch of ‘PCIe bridge and NVMe’ and the related PCIe error ‘RxErr’, described below? Your advise is highly appreciated! Kind Regards, dgtdabbler Akoya E14412, Board SF40CM, AMI1.02.00.MN.V05, i5-10210U, 16 GB RAM, 1x m.2 slot for SSD, NVMe WD Blue SN570 1TB (firmware updated to ver 234110WD, 3500 MB/s (read), PCIe Gen3 x4, acc, to OEM spec.) --- Brief Summary Linux was installed at the very begin on this notebook, on a brandnew NVMe ‘WD Blue SN570 1TB’, which I inserted in the notebook’s sole m.2 slot for SSD. Disk benchmark test shows 1.6 GB/s (read) and 1.4 GB/s (write), fine for my applications. The system has been running nice for long time, incl. browser, e-mail client, LibreOffice. My favourite notebook! The Concern When I check the system messages from sudo dmesg, I note PCIe errors ‘RxErr’ ongoing. Sifting thru the entire dmesg, there is mentioned: - ‘01:00.0 15,752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0000:00:1d.0’ (so, the width of the NVMe WD Blue SN570 1TB is limited from x4 to x2, when this link is set up/negotiated, that’s how I read this) - ‘capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link’ (this likely relates to the NVMe WD Blue SN570 1TB also, I think. The WD Blue SN570 1TB can handle PCIe x4, acc to OEM WD. Not sure if alternatively this message (the point ‘PCIe x4’) could relate to the capability of the PCIe bridge, possibly.) HeLo@E14412:~$ sudo dmesg -T | grep --color -i -E ‘00.1d.0|01:00.0|bandwith|RxErr’
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: [8086:02b0] type 01 class 0x060400
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: PTM enabled (root), 4ns granularity
[Sa Nov 30 13:15:03 2024] pci 0000:01:00.0: [15b7:501a] type 00 class 0x010802
[Sa Nov 30 13:15:03 2024] pci 0000:01:00.0: reg 0x10: [mem 0xb1200000-0xb1203fff 64bit]
[Sa Nov 30 13:15:03 2024] pci 0000:01:00.0: reg 0x20: [mem 0xb1204000-0xb12040ff 64bit]
[Sa Nov 30 13:15:03 2024] pci 0000:01:00.0: 15.752 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x2 link at 0000:00:1d.0 (capable of 31.504 Gb/s with 8.0 GT/s PCIe x4 link)
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: PCI bridge to [bus 01]
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: bridge window [mem 0xb1200000-0xb12fffff]
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: PCI bridge to [bus 01]
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: bridge window [mem 0xb1200000-0xb12fffff]
[Sa Nov 30 13:15:03 2024] pci 0000:00:1d.0: Adding to iommu group 11
[Sa Nov 30 13:15:03 2024] pci 0000:01:00.0: Adding to iommu group 14
[Sa Nov 30 13:15:04 2024] pcieport 0000:00:1d.0: PME: Signaling with IRQ 122
[Sa Nov 30 13:15:04 2024] pcieport 0000:00:1d.0: AER: enabled with IRQ 122
[Sa Nov 30 13:15:04 2024] pcieport 0000:00:1d.0: DPC: enabled with IRQ 122
[Sa Nov 30 13:15:04 2024] pcieport 0000:00:1d.0: DPC: error containment capabilities: Int Msg #0, RPExt+ PoisonedTLP+ SwTrigger+ RP PIO Log 4, DL_ActiveErr+
[Sa Nov 30 13:15:04 2024] nvme 0000:01:00.0: platform quirk: setting simple suspend
[Sa Nov 30 13:15:04 2024] nvme nvme0: pci function 0000:01:00.0
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: AER: Corrected error message received from 0000:00:1d.0
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: device [8086:02b0] error status/mask=00000001/00002000
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: [ 0] RxErr (First)
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: AER: Corrected error message received from 0000:00:1d.0
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: device [8086:02b0] error status/mask=00000001/00002000
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: [ 0] RxErr (First)
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: AER: Corrected error message received from 0000:00:1d.0
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: PCIe Bus Error: severity=Corrected, type=Physical Layer, (Receiver ID)
[Sa Nov 30 13:15:07 2024] pcieport 0000:00:1d.0: device [8086:02b0] error status/mask=00000001/00002000
... List of PCIe devices and their ‘PCIe slot ID’ as provided by sudo lspci -PPb: - 00:1d.0 is the PCIe slot of the PCI bridge - 01:00.0 is the the NVMe WD Blue SN570 1TB, linked to 00:1d.0 PCIe bridge HeLo@E14412:~$ sudo lspci -PPb # List of PCIe devices
00:00.0 Host bridge: Intel Corporation Comet Lake-U v1 4c Host Bridge/DRAM Controller (rev 0c)
00:02.0 VGA compatible controller: Intel Corporation CometLake-U GT2 [UHD Graphics] (rev 02)
00:04.0 Signal processing controller: Intel Corporation Xeon E3-1200 v5/E3-1500 v5/6th Gen Core Processor Thermal Subsystem (rev 0c)
00:08.0 System peripheral: Intel Corporation Xeon E3-1200 v5/v6 / E3-1500 v5 / 6th/7th/8th Gen Core Processor Gaussian Mixture Model
00:12.0 Signal processing controller: Intel Corporation Comet Lake Thermal Subsytem
00:14.0 USB controller: Intel Corporation Comet Lake PCH-LP USB 3.1 xHCI Host Controller
00:14.2 RAM memory: Intel Corporation Comet Lake PCH-LP Shared SRAM
00:14.3 Network controller: Intel Corporation Comet Lake PCH-LP CNVi WiFi
00:14.5 SD Host controller: Intel Corporation Comet Lake PCH-LP SCS3
00:15.0 Serial bus controller: Intel Corporation Serial IO I2C Host Controller
00:15.1 Serial bus controller: Intel Corporation Comet Lake Serial IO I2C Host Controller
00:16.0 Communication controller: Intel Corporation Comet Lake Management Engine Interface
00:17.0 SATA controller: Intel Corporation Comet Lake SATA AHCI Controller
00:1a.0 SD Host controller: Intel Corporation Device 02c4
00:1d.0 PCI bridge: Intel Corporation Comet Lake PCI Express Root Port #9 (rev f0)
00:1d.4 PCI bridge: Intel Corporation Comet Lake PCI Express Root Port #13 (rev f0)
00:1f.0 ISA bridge: Intel Corporation Comet Lake PCH-LP LPC Premium Controller/eSPI Controller
00:1f.3 Audio device: Intel Corporation Comet Lake PCH-LP cAVS
00:1f.4 SMBus: Intel Corporation Comet Lake PCH-LP SMBus Host Controller
00:1f.5 Serial bus controller: Intel Corporation Comet Lake SPI (flash) Controller
00:1d.0/01:00.0 Non-Volatile memory controller: Sandisk Corp WD Blue SN570 NVMe SSD 1TB
00:1d.4/02:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 15) Details (by lspci) on PCI bridge: Capabilities, Status, Control, Width, Latencies (and downgrade) of/for Devices, Control and Link are listed using sudo lspci -PPvvv, by filtering these key words with grep (below). And in analogy details for WD Blue SN570 1TB (further below). Additionally, on memory organisation, there is mentioned ‘disabled’ a couple of times. Is that possibly a hint on the mismatch's reason? HeLo@E14412:~$ sudo lspci -PPvvv -s 00:1d.0 | grep --color -i -E '00:1d.0|status|bridge|capabilities|lnkcap|lnkctl|lnksta|width x.?|speed|.?GT/s|downgraded|latency|.?ns |driver|nvme|pcieport'
00:1d.0 PCI bridge: Intel Corporation Comet Lake PCI Express Root Port #9 (rev f0) (prog-if 00 [Normal decode])
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: f000-0fff [disabled] [16-bit]
Memory behind bridge: b1200000-b12fffff [size=1M] [32-bit]
Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff [disabled] [64-bit]
Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16+ MAbort- >Reset- FastB2B-
Capabilities: [40] Express (v2) Root Port (Slot+), MSI 00
LnkCap: Port #9, Speed 8GT/s, Width x2, ASPM L1, Exit Latency L1 <16us
LnkCtl: ASPM L1 Enabled; RCB 64 bytes, Disabled- CommClk+
LnkSta: Speed 8GT/s, Width x2
SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
RootSta: PME ReqID 0000, PMEStatus- PMEPending-
LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+ EqualizationPhase1+
Capabilities: [80] MSI: Enable+ Count=1/1 Maskable- 64bit-
Capabilities: [90] Subsystem: Elitegroup Computer Systems Comet Lake PCI Express Root Port
Capabilities: [a0] Power Management version 3
Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [100 v1] Advanced Error Reporting
Capabilities: [140 v1] Access Control Services
Capabilities: [150 v1] Precision Time Measurement
Capabilities: [200 v1] L1 PM Substates
Capabilities: [220 v1] Secondary PCI Express
LnkCtl3: LnkEquIntrruptEn- PerformEqu-
Capabilities: [250 v1] Downstream Port Containment
Kernel driver in use: pcieport
HeLo@E14412:~$
HeLo@E14412:~$ sudo lspci -PPvvv -s 01:00.0 | grep --color -i -E '01:00.0|status|bridge|capabilities|lnkcap|lnkctl|lnksta|width x.?|speed|.?GT/s|downgraded|latency|.?ns |driver|nvme|pcieport'
00:1d.0/01:00.0 Non-Volatile memory controller: Sandisk Corp WD Blue SN570 NVMe SSD 1TB (prog-if 02 [NVM Express])
Subsystem: Sandisk Corp SanDisk Ultra 3D / WD Blue SN570 NVMe SSD (DRAM-less)
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0, Cache Line Size: 64 bytes
Capabilities: [80] Power Management version 3
Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
Capabilities: [b0] MSI-X: Enable+ Count=17 Masked-
Capabilities: [c0] Express (v2) Endpoint, MSI 00
DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <1us, L1 unlimited
LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L1 <8us
LnkCtl: ASPM L1 Enabled; RCB 64 bytes, Disabled- CommClk+
LnkSta: Speed 8GT/s, Width x2 (downgraded)
LnkCap2: Supported Link Speeds: 2.5-8GT/s, Crosslink- Retimer- 2Retimers- DRS-
LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+ EqualizationPhase1+
Capabilities: [100 v2] Advanced Error Reporting
Capabilities: [150 v1] Device Serial Number 00-00-00-00-00-00-00-00
Capabilities: [1b8 v1] Latency Tolerance Reporting
Max snoop latency: 3145728ns
Max no snoop latency: 3145728ns
Capabilities: [300 v1] Secondary PCI Express
LnkCtl3: LnkEquIntrruptEn- PerformEqu-
Capabilities: [900 v1] L1 PM Substates
Kernel driver in use: nvme
Kernel modules: nvme
HeLo@E14412:~$ Do these messages point on hardware/setting issues, I could inspect, check, fix, adjust, optimise, ..? Please can you advise how to handle the mismatch and get rid of the error message? If any additional information is needed, please let me know. As mentioned above, your support is highly appreciated!
... View more