Questions tagged [pci-express]
PCI Express (Peripheral Component Interconnect Express)
129
questions
-1
votes
0
answers
18
views
What mean is " pciehp: link training error: status 0x1001 "
Sometime when I use ipmitool to control my HBA power , it will be hang in and dmesg show :
[ 320.891399] pciehp 0000:00:02.0:pcie004: Slot(5-1): Card present
[ 322.091096] pcieport 0000:00:02.0: ...
- 1
0
votes
0
answers
29
views
Does interface bandwidth and/or interface type (SATA/NVME) affect IO and Random 4KB RW performance
TLDR: The advertised IOPS of NVME drives is leaps above any SATA SSDs, but how much of this is due to limitations of the:
Interface (SATA/NVME)
Interface Bandwidth (PCIE Gen 4, Gen 3, SATA 3, SATA 2)
...
1
vote
0
answers
130
views
how can I list all static builtin drivers in kernel, such as pcieport and pciehp?
with lspci I can see things like:
Slot: 00:02.0
Class: PCI bridge [0604]
Vendor: Red Hat, Inc. [1b36]
Device: QEMU PCIe Root port [000c]
Driver: pcieport
In dmesg I can see pcieport 0000:00:02.0: ...
- 292
0
votes
1
answer
80
views
40Gbit/s RAID10 - on a single raid adapter is it possible?
I need an ultrafast backups restore for my solution.
I am going to use two hosts: operating server and backup server.
Both servers will be connected directly via 40Gbe PCIe 4.0 8x ethernet adapters so ...
- 23
2
votes
1
answer
207
views
Intel S2600JF server: Processor PCIe Link Speed menu in the BIOS is missing
i have a Intel 4 node server with S2600 JF motherboard per node (older, DDR3 RAM, E5-2600 v1 and v2).
I want to insert a NVMe pcie card (with two drives) that requires bifurcation.
Based on the ...
- 168
1
vote
1
answer
418
views
Unexpected shutdown of Server (BSOD) with message “WHEA_UNCORRECTABLE_ERROR”
When we checked the system event log we found that following warning has been logged repeatedly.
Event 17
A corrected hardware error has occurred.
Component: PCI Express Root Port
Error Source: ...
-4
votes
1
answer
273
views
How to extend 1U / 2U servers with multiple 2 slot full height GPUs for sharing? [closed]
What are the possible options to extend a 1U / 2U server with a GPU?
e.g. I am searching for a solution how to add a GTX 1650 into the server. The GPU is usually 2 slots width and therefore often not ...
- 277
-1
votes
1
answer
447
views
Tesla K80 not showing up in HP DL580 G7
I have a HP Proliant DL580 G7 server with P65 BIOS update from 2015 (which I think is the latest BIOS).
I installed the PCIe expansion board in it and installed 4 x Tesla K80 GPUs. Connected them to ...
- 11
3
votes
1
answer
2k
views
Dell R630 supported PCIe to NVMe (m.2) adapter and drive?
I can't seem to find any information anywhere about supported PCIe to NVMe (m.2) adapter and a brand of drive that will also work.
I am aware third party adapters and drives tend to work with various ...
- 87
1
vote
1
answer
2k
views
How to check PCI type and version of free PCI slot in Linux shell
I know how to check how many PCI slots are not used yet on my server, by using dmidecode and looking for Available slots:
# dmidecode
[...]
Handle 0x0014, DMI type 9, 13 bytes
System Slot Information
...
- 380
0
votes
0
answers
147
views
AMD Optane alternative
I want to have an Optane features with my Ryzen build: high TBW and high I/O. Disk space irrelevant (like MEMPEK1W064GA, 64GB would be enough for me). And it would be nice if I can utilize the full ...
- 1
1
vote
1
answer
4k
views
PCIe - Training error on device - Link degraded, macLinkWidth = x16, negotiatedLinkWidth = x8
i've placed a pcie raid adapter card with onboard ssd's (AORUS RAID ADAPTOR built in with 4 x PCIe 3.0 512GB NVMe SSD) in a new (2020) Dell (Optiplex 7080).
the system boots fine most times, but it ...
- 739
2
votes
1
answer
643
views
How much PCI-E bandwidth can my SAS HDD array make use of?
Note: This question is real-world, but to analyse it, please note I've begun from a "theoretical" starting point of device and bus capability, which I acknowledge will not usually be at all ...
- 704
1
vote
1
answer
5k
views
add M.2 NVMe enablement kit to HP DL360gen9
I have a HP DL360gen9 8sff
Applications running on the machine are saturating the current disks, all Intel Enterprise SSD disks.
I would like to add M.2 NVMe drives but I can't figure out which ...
- 163
3
votes
2
answers
868
views
Why do internal <> external SAS expanders require a PCIe slot?
I have seen examples of home-brew NAS units that use SAS expanders plugged into a host motherboard that has neither a CPU or memory, literally for the purpose of powering the card. If the card doesn't ...
- 211
0
votes
1
answer
460
views
Will a NVMe<>PCIe gen3 x4 (physical x16) Adapter use x8 of PCIe gen2?
I've found a couple of x16 nvme adapters like those:
https://www.amazon.de/dp/B07VV9DYTL/ref=sr_1_2_sspa
https://www.amazon.de/dp/B07RWCGP1S/ref=sr_1_8
So as a follow up to my earlier question PCIe ...
- 120
0
votes
1
answer
277
views
PCIe gen3 x4 card in PCIe gen2 x8 slot - full performance possible?
To my understanding, a gen3 x4 slot is equal to a gen2 x8 slot in terms of speed.
I assume that by default a gen3 card can not get full speed, because the gen3 card is only x4 physically, and ...
- 120
0
votes
1
answer
108
views
OCZ Revodrive 350 srs interrupts
We built some servers running Windows Server 2016 out of some "spare" parts with the following specs:
Supermicro X10DRH-iT
Dual E5-2620 v3
256GB Registered ECC DDR4 RAM
1x Adaptec 71685 RAID ...
- 5,170
0
votes
1
answer
129
views
Servers with 24 NVMe drives - read throughput [duplicate]
We would like to buy some servers and we are looking into DELL server with 24 NVMe drives (like R740xd2 - 2 socket server) since we need very high read IOPS and throughput. We are however wondering ...
0
votes
1
answer
283
views
How to boot M2 Pci express Card HP Gen8 Dl360P
I recently purchased the HP GEN8 DL360P server. I wanted to install an operating system to use M2 with a pci express card on this server. However, the server does not start boot with the pci card. ...
- 25
4
votes
1
answer
4k
views
Does Dell PowerEdge R720(xd) support PCIe Bifurcation?
I want to add a bunch of SSDs to my PowerEdge R720xd, and the highest-density way to do that seems to be a card like this Dell Ultra-Speed Drive Quad NVMe M.2 PCIe x16 Card.
However, the specs on ...
- 3,112
0
votes
1
answer
256
views
Possible to use SAS-2 and SAS-3 HBA in the same system?
I'm wondering if it is possible to use a SAS-2 HBA in a "SAS-3" system.
I have a Supermicro X11DPH-T and have attempted to install an LSI 9201-16e. From what I understood (which may be wrong), a ...
- 455
0
votes
1
answer
567
views
Configure single LTO tape drive over Fiber Channel HBA
How do you set up a single tape storage drive over an FC HBA? As far as I can tell, these things are not "plug and play". The tape drive I bought is an lto-5 FC taken from a tape library.
I have ...
- 1
2
votes
2
answers
2k
views
Hardware RAID array using PCIe based storage? (M.2 / U.2 / full PCIe slot)
Is there currently a mechanism for constructing a hardware RAID array using storage devices that have a full-size PCIe slot, PCIe M.2, or PCIe U.2 bus interface, such as SSDs?
It is extremely ...
- 755
1
vote
1
answer
2k
views
PCI-E lane speed vs NIC throughput
I am curious about NIC troughput vs PCIE slot speed.
I have found Mellanox MHQH19B-XTR which claims to be 40 Gbps PCI-E 2.0 x8 cards.
However, this slot limit seems to be theoretical ~ 31 Gbps.
So, ...
- 11
0
votes
2
answers
3k
views
HP ProLiant DL380 G6 GPU installation
I have a Proliant DL380 G6 and I want to build a Graphics card into it. To be specific, it is a GTX 960 from Asus. The card When I now want to build it in, I am pretty shure I need a pcie slot riser, ...
- 9
0
votes
1
answer
67
views
Internal HDD keep being dropped
I own a server on which I run flexraid and since a couple of weeks, I get the issue that whenever the server is doing some heavy operations on the RAID, one or more harddrives get dropped.
In order ...
- 119
-2
votes
1
answer
287
views
How Infiniband manages to have 100Gbit/s
How Infiniband manages to get a speed of 100Gbit/s. The PCIE x16 has maximum speed of 32Gbit/s. For example, NVidia DGX-1 station has 4 such ports. How is this possible?
2
votes
1
answer
142
views
HP DL180 G6 Storage Edition (14x LFF) - Help Adding NIC ports
I have a whole bunch of these (18+) currently running. The DL180 G6 has 2x NIC ports both of which we are using, and one 16x PCI-e slot on a riser, in our case, occupied by a RAID card (mostly P410s)....
- 31
2
votes
0
answers
684
views
Manually executing option roms (PCIe SATA storage card)
I have an older Dell server, a Poweredge 2900 II, and I would like to use it with large HDDs (> 8 TB). For this, an expansion card is needed, since the motherboard nor the PERC RAID controller can ...
- 21
5
votes
0
answers
605
views
How to get PCI Tx/Rx byte counters?
I know how to read statistics about the configured network interfaces, for example via cat /proc/net/dev.
Is there a way to read similar byte counters of PCI or PCIe traffic?
Apparently, according ...
- 51
2
votes
0
answers
332
views
PCIe: Why pciehp gives contradictory log info
I am running fio jobs on my NVMe SSD and hotplug it then. The platform is hot-pluggable and the system is Centos 7.0.Several seconds after my plug-out, the system encounters a crash and gives these ...
2
votes
2
answers
5k
views
PCIe 3.0 downgraded to 2.0 speed
I have a dual Xeon board with Intel C602 chipset and two E5-2670 CPUs. The board comes with five PCIe 3.0 x16 slots and a PCIe 3.0 x4 slot; all of which are directly connected to the CPUs.
I added a ...
- 334
0
votes
1
answer
1k
views
PCI Express 2.0 x16 vs 3.0 x8
Will a PCI Express 2.0 x16 graphics card fit in a PCI Express 3.0 x8 slot, and if so, will it affect the performance? Theoretically I take it the two configurations should be equal with respect to ...
- 199
0
votes
0
answers
76
views
Using non-FUJITSU 10Gb Ethernet Cards in FUJITSU servers
We are currently trying to upgrade old servers to 10Gb connections. The servers in question are:
PRIMERGY RX200 S6
PRIMERGY RX300 S5
Our FUJITSU partner told us that there were no cards available by ...
- 101
0
votes
3
answers
5k
views
Dell Poweredge R620 PCIe Training error what to do?
After the startup, the server show the "PCIe Training error :Integrated RAID"
And then "PCIe express error interrupt at F000:B891"
My thought is that the controller raid is broken
Any help?
- 1
0
votes
1
answer
75
views
Can a standard PCIe card fit on top of VLP (Very Low Profile) memory?
I am dealing with a motherboard
https://b2b.gigabyte.com/Server-Motherboard/MZ31-AR0-rev-1x#ov
where multiple memory slots are situated right in front of several PCIe slots and hence a full-length ...
- 322
6
votes
2
answers
5k
views
PCIe SATA III RAID controller card Linux setup
I recently added a StarTech 4 port PCIe SATA card to a Linux server. The card is connected via SFF-8087 to a Norco 4224 backplane and 4 new hard drives that I'd like to configure into a new software ...
- 181
1
vote
0
answers
84
views
SFP Card compatibility
We are installing our first "professional" server configuration in the office. We will install a HP ProLiant DL120 Gen9 that will provide a hypervisor based on CentOS / KVM and should be connected to ...
- 11
0
votes
1
answer
1k
views
Only one link comes up on dual PCIe 10-Gigabit card
Background
A server running Ubuntu 16.04
Dell X520 (based on Intel's 82599) is connected via PCIe
ixgbe driver was installed from here and comes up at boot
Issue
The card is recognized by the ...
0
votes
1
answer
163
views
Compatibility criteria between PCIe component and the motherboard
I have a Gigabyte (GA-B85-HD3 2.0) motherboard and an LSI SA9201-16e, however am not seeing the BIOS configuration menu for the card on boot. The motherboard only has one PCIe slot that can accept the ...
- 211
2
votes
1
answer
4k
views
HP Proliant DL380 G7 compatible with Kingston SKC1000H/960G PCIe SSD NVME?
Can anyone confirm if they've successfully installed and operated the Kingston SKC1000H/960G PCIe SSD NVME card in an HP ProLiant DL380 G7 Server? If so, is it just plug-and-play? Does the extra ...
0
votes
1
answer
2k
views
Change the NUMA node where a PCIe device is attached
Modern servers using multiple physical CPU sockets have NUMA.
PCIe devices are attached to one specific NUMA node as the PCIe controller is embedded in the physical CPU chip.
Is it possible to change ...
- 17.1k
1
vote
1
answer
341
views
PCIex lanes on Supermicro X10SRH-CF
I am trying to set up 5 GPUs on X10SRH-CF to run Tensorflow, but cannot seem to get the board boot up with more than 3 cards plugged in. In some layout I get it to boot with 4 cards but OS (Ubuntu ...
- 193
4
votes
1
answer
141
views
PCIE root complex failover
PCIE switches from Avago and IDT have the capability of root complex failover.
This sureley does not happen over an instant - there must be some time that elapses before the secondary root complex ...
- 41
-1
votes
1
answer
322
views
HP PCIe 8GB FC Adapter not visible on Windows Server 2012R2 [closed]
Anyone who can assist me.
I have a HP Proliant GL360, On Boot, the HP PCIe 8GB FC Adapter drivers are visible. Once logged on the server, when I go to Network Connections, I can't see the adapters.
...
- 31
2
votes
1
answer
1k
views
Booting from PCIe SSD on Dell T3600
One of our local workstations SSD is severely slow. I can't seem to find much resources on whether or not the latest BIOS supports booting Windows Server from a PCIe SSD. If it doesn't, is there a way ...
- 137
-1
votes
1
answer
1k
views
How to differentiate GE, Optic and FC adapter/SFP?
I'm going through old switches laying around and find myself troubled by all the different connection types the PCI adapters and their SFP have.
I found a 10GE (gigabit ethernet?) SFP that says it's ...
- 331
1
vote
1
answer
2k
views
Linux: Disabling Interrupt Coalescing for NVMe device
I'm looking at testing an NVMe device with interrupt coalescing enabled, and disabled.
NVMe protocol defined interrupt coalescing parameters that can be passed to the device, and in free BSD the nvme ...
- 11
0
votes
1
answer
794
views
Can I connect a PCIe 2.5" SSD to a regular PCIe 3 slot?
I'm looking to upgrade my server's storage. It currently has SATA SSD storage but I would like to add to it an even faster PCIe3 SSD. It's a full tower with a few empty PCIe3 slots but no PCIe3 ...
- 173