Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [nvme]

The tag has no usage guidance.

0
votes
0answers
6 views

sysbench -IO test weird results?

iam running sysbench on two machines, one is brand new with NVMe disks, AMD Epyc and 256Gb RAM. The results are very nice. The problem is when i run exactly the same test on the old AMD Opteron ...
0
votes
0answers
20 views

Does the HPE ML350 support 970 Pro?

I am going in for an IO intensive application and have though of HPE ML350 for the purpose. I need to know if the NVMe SSDs are supported as boot drivers or not. Also if the drives are supported ...
1
vote
1answer
33 views

Is there ready S.M.A.R.T monitoring toolkit for NVME disks (exporter,source,board)?

I already found node_exporter and grafana board for HDD S.M.A.R.T. Can You please get advice or url for ready exporter or other toolkit? I'm trying to wrote my own "messy" text exporter for ...
1
vote
0answers
16 views

Can't scale write bandwidth on Linux with Intel Optanes

I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/...
0
votes
0answers
11 views

ASUS HyperX M.2 x4 only the first device is visible under Ubuntu

I have a Dell T320 with an ASUS HyperX M.2 x4 PCI-e card (in a PCI-e 3.0 x16 socket), and two Samsung 970 PRO in it (in slot 1 and slot 2 of Hyper M.2), but under Ubuntu 18.04.2 LTS I only see the ...
4
votes
3answers
206 views

How to limit ZFS writes on NVME SSD in RAID1 to avoid rapid disk wear?

Currently I'm running Proxmox 5.3-7 on ZFS with few idling debian virtual machines. I'm using two SSDPE2MX450G7 NVME drives in RAID 1. After 245 days of running this setup the S.M.A.R.T values are ...
1
vote
0answers
242 views

NVME vs SSD: Read/Write performance issue

We have rent some servers from Hetzner.de. A few of them have NVMe hard disks while the others have SSDs. We becnchmarked the read/write performance on 4 of our servers using the following commands: ...
4
votes
2answers
158 views

Automatically mount SSD instance storage on AWS EC2 in Ubuntu 16.04

I am using an Ubuntu 16.04 EC2 from AWS on c5d.2xlarge HW. It comes with a 200 GB SSD called /dev/nvme1n1. I am able to mount this drive using: $ sudo mkfs.ext4 -E nodiscard /dev/nvme1n1 $ sudo ...
0
votes
0answers
10 views

hdd vs ssd for php/mysql dedicated server [duplicate]

I'm migrating a server and I have to choose between: SoftRaid 2x4TB sata SoftRaid 2x450GB SSD nvme The server will basically run nginx+php7.2+mysql8 The response time is very important for our ...
2
votes
0answers
56 views

PCIe: Why pciehp gives contradictory log info

I am running fio jobs on my NVMe SSD and hotplug it then. The platform is hot-pluggable and the system is Centos 7.0.Several seconds after my plug-out, the system encounters a crash and gives these ...
3
votes
1answer
303 views

Intel NVME performance on Linux

I have an Intel 760P NVME drive hooked up to a Supermicro X11SRM-F with a Xeon W-2155 and 64GB of ddr4-2400 RAM. The specs for this drive claim 205K-265K IOPS (whatever 8GB span means) with about 3G/...
0
votes
1answer
327 views

SSD NVME RAID0 MDADM

My goal is to obtain good writing performances on SSD NVME Disks (benchmarking tools seem to give performances in specific optimized context but far from what we can obtained in real life) My server:...
1
vote
2answers
973 views

What does iodepth in fio tests really mean? Is it the queue depth?

I understand queue depth which is the number of outstanding I/O requests that the storage controller can handle (https://www.tomshardware.com/reviews/ssd-gaming-performance,2991-3.html) i.e., this is ...
0
votes
1answer
446 views

“Symbol 'grub_efi_secure_boot' not found” after disk replacement on boot (CentOS 7.5, RAID1)

Recently I had to replace a faulty HD at a Centos 7.5 server with RAID1 (2 x Samsung NVMe disks) After disk replacement, server booted using the other drive, I copied the same partitions at the new ...
1
vote
0answers
22 views

Two NVMe devices appearing as one

When I run lsblk I see that I have two NVMe devices: $ lsblk NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT ... nvme0n1 259:0 0 1.1T 0 disk /home nvme1n1 ...
6
votes
3answers
555 views

Disabling ext4 write barriers when using an external journal

I'm currently experimenting with different ways of improving write speeds to a fairly large, rotating disk-based, software-raid (mdadm) array on Debian using fast NVMe devices. I found that using a ...
3
votes
0answers
93 views

How to setup nvmetcli for FC loopback mode?

I have a NVMe SSD, KC1000, from Kingston and a HBA, QLE2672 2-port 16Gb Fibre Channel Adapter, from QLogic and are installed on Linux kernel 4.16.6. Then I would like to set up a scenario which has a ...
1
vote
1answer
640 views

Questions about performance, NVMe drives and virtual machines

I currently have a 4770K with Samsung 850 Evo running Ubuntu 16.04. I create and manage VMs using vagrant with Virtual Box. I recreate VMs frequently and right now, it takes roughly 36 seconds to spin ...
4
votes
2answers
203 views

What is the Long term stability of NVMe or SSD stored data?

Background: We need ready access to 30TB of audio data, although only a small fraction of it is ever requested for playback, that playback needs to be done immediately even for multi-year old data. ...
2
votes
2answers
809 views

SFF-8639 Backplane - Mixing SAS 12G and NVMe?

On a passive SFF-8639 backplane, with one port per drive, is it possible to connect some of the back side SFF-8643 ports to a SAS HBA and the others to an NVMe card like the Supermicro AOC-SLG3-2E4? ...
2
votes
2answers
1k views

Cannot connect to EC2 instance after converting Ubuntu 16 PV to Ubuntu 16 HVM

So it's been a few days and I still can not connect to my new HVM instance with EC2 running Ubuntu 16. For reference, I am trying to upgrade our server from an m3 instance running Ubuntu 16, to a C5 ...
1
vote
4answers
4k views

ZFS: Configuration advice 1x NVMe as ARC and ZIL and 4x SSDs for zvols for virtualization

So recently upon testing a ZoL system we found out poor performance of random and sequential reads and poor performance of random writes on our SSDs. Our system is a stripe of 2x Samsung 1TB 850Evo ...
3
votes
1answer
2k views

Why is there both character device and block device for nvme?

I am trying to understand the configuration of nvme. But I do not understand why there are two devices: nvme block and nvme character device: crw------- 1 root root 243, 0 Dec 12 16:09 /dev/nvme0 ...
-1
votes
1answer
919 views

Installing 960 Evo NVMe to PowerEdge R730 [closed]

I'm trying to install Samsung 960 Evo NVMe M.2 SSD to Dell PowerEdge R730 server. When I googled it, I stumbled upon this manual, but it says that I should use a carrier to insert into a disk bay (...
1
vote
2answers
424 views

How-To Chain Boot/Trampoline Boot into Ubuntu 17 on PCIe SSD without BIOS support

I have a server-grade SSD (Intel DC P3520) that will eventually end up in a server. Until the server is deployed in the data center I want to conduct some tests in a desktop machine. I have an older ...
0
votes
1answer
3k views

Mounted disk disappears after reboot

I've got a Centos 7 dedicated server with a SSD + a nvme ssd with 400gb. I followed a tutorial to mount + format (as xfs filesystem) the nvme disk so that I could setup my NoSQL databases on that ...
2
votes
0answers
346 views

Encrypt disks using SED and store keys in TPM?

I'm buying servers lately and all of them have disks that support TCG Opal full-disk encryption (aka SED). What I'd like to do is: Store data encrypted-at-rest on the disks (NVMe & SAS). Not be ...
-1
votes
1answer
203 views

NVMe-Dedicated Server without Virtualisation: Big speed benefit? [closed]

I am currently using a VPS which is virtualised with Virtuozzo and sometimes my blog is starting to deliver in 150ms till 350ms (server response). I assume that the virtualisation is the bottle neck ...
0
votes
1answer
928 views

NVMe on old HP Proliant DL380 G6

Do NVMe drives work on HP Proliant DL380 G6 boards? These servers have: 1 x PCIe Gen2 X8 Full Length, Full Height Slot 2 x PCIe Gen2 X4 Half Length, Full Height Slot Is there any interference with ...
1
vote
1answer
626 views

Linux: Disabling Interrupt Coalescing for NVMe device

I'm looking at testing an NVMe device with interrupt coalescing enabled, and disabled. NVMe protocol defined interrupt coalescing parameters that can be passed to the device, and in free BSD the nvme ...
0
votes
1answer
303 views

Any performance gain from multiple nvme drives in RAID versus a single nvme drive?

We've got a cluster of scylladb hosts (it's a cassandra-type database) running on i3 instances in amazon with the /var/lib/scylla/ folder mounted on a single nvme drive. I'm wondering whether there is ...
8
votes
1answer
590 views

The setup of S2D that delivers up to 2M IOPS to SQL FCI

We are about to deploy shared storage researching for ultra-fast storage to implement Microsoft SQL Server Failover Cluster (FCI). So far the project goes, we would to start with 500K IOPS for 8k ...
2
votes
1answer
699 views

Is it worse to go with Samsung 960 EVO instead of Pro version in terms of price to perforamce measure? [closed]

We are about to deploy shared storage researching for ultra-fast storage to implement Microsoft SQL Server Failover Cluster (FCI). So far the project goes, we would to start with 500K IOPS and have ...
1
vote
1answer
558 views

MongoDB with NVMe SSD

Does anyone have recommendations on the RAID configuration when running MongoDB on NVMe SSDs? Is the best practice still RAID10 like with HDDs and SATA SSDs? Thanks.
0
votes
2answers
1k views

clone nvme drive with 4096 sector size to ssd with 512 sector size

I have an nvme drive with a logical and physical sector size of 4096. The block size of this drive as reported by blockdev --getbsz command to be 4096 as well. The destination drive is an SSD with a ...
4
votes
1answer
222 views

NVMe latency monitoring

Is there a way to get read/write queue latencies from NVMe devices? If it's not split for read/write that's better than nothing but ideally I could see these separately. I'd like to go below the ...
4
votes
1answer
8k views

Does any PCIe slot support NVMe SSD's automatically or do I need a specific M.2 slot?

I have been trying to dissect the information I find with googling, but have come to the conclusion that I cannot find with certainty the answer to the following questions: Given you know the basics ...
0
votes
1answer
640 views

Intel server board s2600cw2r boot from nvme?

I have upgraded BIOS to 19 for supporting efi boot, but I can't see my nvme ssd in the boot manager yet.
4
votes
3answers
2k views

Get exact SMART error from Intel RST (Rapid Storage Technology)

On one system I use dual NVMe m.2 drives on an Intel Z170 board in RAID0 with Intel RST. After about 6 months of light use the Intel RST Tool gives me a SMART error. The only option I have is to ...
2
votes
2answers
5k views

Supermicro Server fails to boot from NVMe SSD

I have a SuperMicro server with an NVMe boot drive and an additional SSD for data. I was attempting to install ubuntu on the NVMe boot drive and even though the installation succeeds and the correct ...
1
vote
2answers
2k views

nvme device dropouts - I/O 0 QID 0 timeout, controller disabled

We have 6 Supermicro servers all of the same (or very similar spec), Over the last two weeks one of them has been dropped an NVMe disk at random times due to: [ 66.856719] nvme 0000:03:00.0: I/O 0 ...
3
votes
1answer
549 views

NVMe speed degradation after kernel upgrade

We are testing the speed of two Intel DC P3600 NVMe drives on a CentOS 7.1 system. They are configured in a software RAID1 using mdadm. After upgrading the kernel from the (very old) 3.10 to the ...
1
vote
1answer
4k views

NVMe drives write performance in software RAID 1

We have just received two brand new Supermicro servers 1028U-TN10RT+ with 10 NVMe slots, two of them with Intel DC P3600 800gb hard drives. We were eager to test the performance of the drives as the ...
3
votes
1answer
988 views

Map PCIe slot number (or BDF) to device number or vice versa

Is there any way to know the drive number from BDF or slot number of a PCIe or vice versa? Suppose I have four PCIe drives attached to my system. And I know their BDF's, I want to know each of the ...
2
votes
1answer
1k views

NVMe drives with PLX bridge are slow in performance

Recently I've purchased a couple of NVME drives for a home server I'm running. I decided to make it more budget friendly, and potentially improved IOPs by choosing an Add on card by Supermicro that ...
0
votes
0answers
712 views

How to use vhost-scsi with Intel P3700 NVME SSD in KVM

I am using proxmox beta 4 in my HP DL 380 server with KVM. I configured Intel P3700 NVME - nvme0n1 as Virtio and on windows server 2008 r2 with virtio-scsi driver. I am getting 100 K random IOPS ...
16
votes
7answers
10k views

Understanding NVMe storage and hardware requirements

I'm a bit confused about the recent developments in PCIe-based storage, particularly as it relates to the NVMe specification and its hardware compatibility. While I've worked extensively with SSDs in ...