Questions tagged [nvme]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1
vote
3answers
388 views

NVMe disk problems - smartctl 0x2002 status

My NVMe disk works but it is very slow compared to what it was. I benchmarked it 6 months ago at 2000MB/s using fio, the exact same test now is giving me 350MB/s I ran smartctl but it's giving a ...
0
votes
0answers
20 views

Scuttle Boot Option

I'm trying to devise a simple boot option that would secure erase one or more drives in a computer. Imagine a scenario such as airport security where somebody has the authority to compel you to turn ...
3
votes
2answers
5k views

nvme device dropouts - I/O 0 QID 0 timeout, controller disabled

We have 6 Supermicro servers all of the same (or very similar spec), Over the last two weeks one of them has been dropped an NVMe disk at random times due to: [ 66.856719] nvme 0000:03:00.0: I/O 0 ...
0
votes
1answer
2k views

"Symbol 'grub_efi_secure_boot' not found" after disk replacement on boot (CentOS 7.5, RAID1)

Recently I had to replace a faulty HD at a Centos 7.5 server with RAID1 (2 x Samsung NVMe disks) After disk replacement, server booted using the other drive, I copied the same partitions at the new ...
4
votes
2answers
2k views

Map PCIe slot number (or BDF) to device number or vice versa

Is there any way to know the drive number from BDF or slot number of a PCIe or vice versa? Suppose I have four PCIe drives attached to my system. And I know their BDF's, I want to know each of the ...
1
vote
1answer
40 views

Show free SSD space after TRIM / UNMAP / Deallocate?

For a hard drive supporting ATA TRIM, SCSI UNMAP, or NVMe Deallocate, is it possible to report on the amount of unallocated space? For example, we take a 1TB drive, then write 500GB data to it, then ...
0
votes
0answers
25 views

How do you generate a new encryption key for a drive that uses SED (Self Encryption Drive)

So I'm currently learning more about NVMe drives that ship with a feature called SED (Self Encrypting Drive). Take the Smasung 970 EVO for instance. It clearly states that it features SED. The 970 ...
4
votes
0answers
619 views

Encrypt disks using SED and store keys in TPM?

I'm buying servers lately and all of them have disks that support TCG Opal full-disk encryption (aka SED). What I'd like to do is: Store data encrypted-at-rest on the disks (NVMe & SAS). Not be ...
0
votes
0answers
75 views

How do I maximize nvme raid0(md) performance (in linux)?

Nvme raid0 read(and write) performance is sometimes worse than the performance of one individual underlying drive. hdparm -t /dev/md0 : Timing buffered disk reads: 7054 MB in 3.00 seconds = ...
3
votes
5answers
2k views

Linus/ext4/nvme crashes during high io

During mvn compilation, I have random crashes. The problem seems related to high IO and in kern.log, I can see things like: kernel: [158430.895045] nvme nvme1: controller is down; will reset: CSTS=...
5
votes
1answer
55 views

Are my drives being utilized equally with Linux Software RAID 0 array?

I have four NVMe drives in a RAID 0 configuration. I am attempting to determine how many IOPS the array is handling. When I run iostat, it appears that one drive is handling more IO than the other ...
6
votes
2answers
232 views

Very slow write speed (NVME drive) on 10G network

Setting up an experimental lab cluster, the write speed for data received via 10G fiber connection is 10% of the local write speeds. Testing transfer speed between two identical machines; iperf3 shows ...
6
votes
2answers
551 views

MongoDB on NVMe in production

I'm setting up my db production environment and I have some questions. The server has two NVMe disks, but they cannot be used in the hardware RAID controller. Do I need RAID with NVMe? Would it be ...
0
votes
0answers
34 views

Single-disk array full: how to add a spare disk without losing data?

So I rent this server from Hetzner and it was labeled as 2x512gb nvme ssd. Indeed, the server contains two 512 gb nvme ssd but (my fault) I noticed only later that they were in some sort of software ...
17
votes
8answers
12k views

Understanding NVMe storage and hardware requirements

I'm a bit confused about the recent developments in PCIe-based storage, particularly as it relates to the NVMe specification and its hardware compatibility. While I've worked extensively with SSDs in ...
1
vote
1answer
395 views

Windows storage spaces tiered storage not using nvme drive?

I'm trying to run an Ethereum full node (geth v1.10) with archiving for big data analysis. The storage requirements are expected to be 8TB after being fully sync'd. I have a Synology NAS that is ...
3
votes
3answers
1k views

How can I override IRQ affinity for NVME devices

I am trying to move all interrupts over to cores 0-3 to keep the rest of my cores free for high speed, low latency virtualization. I wrote a quick script to set IRQ affinity to 0-3: #!/bin/bash while ...
0
votes
1answer
375 views

ASUS HyperX M.2 x4 only the first device is visible under Ubuntu

I have a Dell T320 with an ASUS HyperX M.2 x4 PCI-e card (in a PCI-e 3.0 x16 socket), and two Samsung 970 PRO in it (in slot 1 and slot 2 of Hyper M.2), but under Ubuntu 18.04.2 LTS I only see the ...
1
vote
1answer
111 views

Interpreting SMART Logs of Newly Installed NVMe RAID0 Crashing Everyday

An Ubuntu 20.04 system has been stable for a year until a 2nd and 3rd NVMe drive is installed on the motherboard to form a 2x1TB RAID0 array. Ever since then, there is huge amount of IO load on this ...
3
votes
1answer
699 views

Dell R630 supported PCIe to NVMe (m.2) adapter and drive?

I can't seem to find any information anywhere about supported PCIe to NVMe (m.2) adapter and a brand of drive that will also work. I am aware third party adapters and drives tend to work with various ...
0
votes
3answers
2k views

clone nvme drive with 4096 sector size to ssd with 512 sector size

I have an nvme drive with a logical and physical sector size of 4096. The block size of this drive as reported by blockdev --getbsz command to be 4096 as well. The destination drive is an SSD with a ...
0
votes
0answers
54 views

Read data off Apple NGFF M2

I have one of those propietary NGFF M2 SSDs found in older Macbooks. I bought a converter which is supposed to convert it to a standard NVMe. When I plug it in my Linux box only sees it as a SCSI ...
10
votes
3answers
4k views

Automatically mount SSD instance storage on AWS EC2 in Ubuntu 16.04

I am using an Ubuntu 16.04 EC2 from AWS on c5d.2xlarge HW. It comes with a 200 GB SSD called /dev/nvme1n1. I am able to mount this drive using: $ sudo mkfs.ext4 -E nodiscard /dev/nvme1n1 $ sudo ...
1
vote
1answer
695 views

Do I need to replace my NVME SSD?

I have a simple server setup: 2 NVME SSD disks (both SAMSUNG MZVLB1T0HALR-00000 for 1TB) united into RAID0. OS Ubuntu 19.04 Today my system stopped responding. Reboot didn't help. I connected via KVM ...
0
votes
2answers
527 views

Hyper-V Server SSD vs NVME M.2

I'm quite novice on setting up servers and VMs and I'm trying to setup a simple PC to act up as a server in an office. The requirements are low but I think this is a good opportunity for me to learn ...
1
vote
1answer
32 views

Since VFRC feature in VMware is now end of lifed, what can I replace it with?

Now that VFRC (vflash read cache) is end of lifed in Vsphere 7, does anyone have suggestions on what I could replace it with. Looks like there is only Infinio and Virtunet in the market now, has ...
0
votes
0answers
101 views

AMD Optane alternative

I want to have an Optane features with my Ryzen build: high TBW and high I/O. Disk space irrelevant (like MEMPEK1W064GA, 64GB would be enough for me). And it would be nice if I can utilize the full ...
6
votes
0answers
818 views

Write performance is 5 times worse with LUKS on top of mdadm RAID10 than without LUKS

I have servers with many NVMe disks. I am testing disk performance with fio using the following: fio --name=asdf --rw=randwrite --direct=1 --ioengine=libaio --bs=16k --numjobs=8 --size=10G --runtime=...
0
votes
1answer
22 views

VMware nvme writes on unallocated space

I just have a question related to the disk DWPD that I have a hard time finding the answer in google. Consider this scenario: 1 server with only 1 nvme disk of 1TB (no SATA, no Optane, no SD cards, ...
1
vote
0answers
76 views

IPXE boot on amd based architecture with NVME

We have a quite big infrastructure and now we started to use AMD based servers instead of the intel ones with 1 nvme only for os. We are using ipxe to kickstart the servers but for some reason with ...
0
votes
0answers
84 views

cryptsetup Volume Key Does not match the volume

No matter what I do - after dd zeroing out the device - when I try to run cryptsetup luksFormat /dev/nvme0n1 I get the following error: Volume key does not match the volume. I cannot find any ...
1
vote
0answers
806 views

Very slow read/write on software raid1 with nvme device on Ubuntu focal

I have a server with Ubuntu 20.04.1 LTS with NVME ssd devices running on raid1 and the hard drive operates so slow! to open a gzip file to of 500MB to a 3.7GB takes a while.. way more then it should. ...
1
vote
2answers
102 views

Do modern NVMes correct and reallocate bad data at the hardware level?

I'm planning on getting an NVMe for use to contain a swapfile to extend the RAM of my Linux system. Yes, I know this is a bad choice due to the finite number of writes an NVMe has in its lifetime, but ...
4
votes
1answer
461 views

How to explain these fio bandwidth results?

Been running a couple of fio tests on a new server with the following setup: 1x Samsung PM981a 512GB M.2 NVMe drive. Proxmox installed with ZFS on root. 1x VM with 30GB space created and Debian 10 ...
0
votes
1answer
1k views

SSD NVME RAID0 MDADM

My goal is to obtain good writing performances on SSD NVME Disks (benchmarking tools seem to give performances in specific optimized context but far from what we can obtained in real life) My server:...
1
vote
1answer
2k views

add M.2 NVMe enablement kit to HP DL360gen9

I have a HP DL360gen9 8sff Applications running on the machine are saturating the current disks, all Intel Enterprise SSD disks. I would like to add M.2 NVMe drives but I can't figure out which ...
2
votes
1answer
869 views

DELL r630 + NvMe M.2->PCie : Cannot boot Ubuntu installed on M.2 NvMe drive via. PCie adapter

I have plugged in a PNY XLR8 500GB M.2 NvMe drive in a Delock PCIe card and stuck it in Riser 3 on my Poweredge r630 - Although the drive doesn't show up anywhere in BIOS, I could boot the Ubuntu ...
5
votes
3answers
2k views

What is the Long term stability of NVMe or SSD stored data?

Background: We need ready access to 30TB of audio data, although only a small fraction of it is ever requested for playback, that playback needs to be done immediately even for multi-year old data. ...
0
votes
1answer
1k views

Nearly 100% disk utilization after upgrading to debian 10 without any reason

We recently upgraded our servers to debian 10. The setup is completely the same as with debian9 beside of course some new software packages. We are running the default kernel: $ uname -a Linux ...
1
vote
1answer
521 views

How to derive bytes written from SMART's host_write_commands?

Using either smartctl 7.0 or nvme 1.7, I get the following data from the SMART log data_units_written : 350,371,149 host_write_commands : 2,974,115,785 Via smartctl, ...
2
votes
2answers
479 views

Supermicro NVME ports - how to use?

So, my supermicro X11 Dai-N has 8 pci-e lanes routed to two dedicated nvme ports. I just can’t figure out how to connect my nvme harddisks to them. What’s the name of this port specification? Is there ...
0
votes
2answers
496 views

Any performance gain from multiple nvme drives in RAID versus a single nvme drive?

We've got a cluster of scylladb hosts (it's a cassandra-type database) running on i3 instances in amazon with the /var/lib/scylla/ folder mounted on a single nvme drive. I'm wondering whether there is ...
0
votes
1answer
2k views

nvme queue depth vs fio iodepth arg relation/explanation

This question is related to fio (flexible i/o tester) utility manages I/O queues for a NVME storage (SSD's in particular) whilst using libaio engine. For testing i am using Ubuntu 14.04 and a ...
0
votes
1answer
76 views

Servers with 24 NVMe drives - read throughput [duplicate]

We would like to buy some servers and we are looking into DELL server with 24 NVMe drives (like R740xd2 - 2 socket server) since we need very high read IOPS and throughput. We are however wondering ...
12
votes
2answers
8k views

Why is there both character device and block device for nvme?

I am trying to understand the configuration of nvme. But I do not understand why there are two devices: nvme block and nvme character device: crw------- 1 root root 243, 0 Dec 12 16:09 /dev/nvme0 ...
1
vote
1answer
834 views

Supermicro: New NVMe is not detected properly

We have a Supermicro SuperServer 2029U-TN24R4T with currently 8 U.2 NVMe drives (Samsung PM1725a 1.6 TB) running on CentOS 7 with kernel 5.0.10-1.el7.elrepo.x86_64. After adding a new one (PM1725b 1.6 ...
1
vote
0answers
1k views

NVME vs SSD: Read/Write performance issue

We have rent some servers from Hetzner.de. A few of them have NVMe hard disks while the others have SSDs. We becnchmarked the read/write performance on 4 of our servers using the following commands: ...
0
votes
0answers
52 views

Does the HPE ML350 support 970 Pro?

I am going in for an IO intensive application and have though of HPE ML350 for the purpose. I need to know if the NVMe SSDs are supported as boot drivers or not. Also if the drives are supported ...
1
vote
1answer
282 views

Is there ready S.M.A.R.T monitoring toolkit for NVME disks (exporter,source,board)?

I already found node_exporter and grafana board for HDD S.M.A.R.T. Can You please get advice or url for ready exporter or other toolkit? I'm trying to wrote my own "messy" text exporter for ...
1
vote
0answers
26 views

Can't scale write bandwidth on Linux with Intel Optanes

I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/...