Questions tagged [nvme]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
48 views

Strange IO activity

I have some strange IO activity on a server and I can't figure our where it's coming from. To provide some background, I had to replace an NVMe (Samsung PM81) from a server due to wear. I didn't ...
-1 votes
0 answers
18 views

smartctl overall-health test fails on a new NVMe

I have a somehow new laptop with an SSD inside. When I try to install ubuntu and erase disk the installation fails with an read/write to disk error. SMART overall-health self-assessment test also ...
  • 1
0 votes
0 answers
15 views

Extend the root partition

We need to extend the root (nvme0n1p1) partition that is adjacent to the 2nd SWAP (nvme0n1p2) partition that is adjacent to the third (nvme0n1p3) LVM2 partition that has 2 volume groups in ext4 format ...
0 votes
0 answers
33 views

HP Proliant ML350 gen9 boot from NVME with pci express x4 adapter

Will a HP Proliant ML350 gen9 boot linux or windows using an NVME with a PCI express x4 adapter? I've been reading the server manual but I can't seem to find anywhere if this is possible. I want to ...
  • 11
2 votes
1 answer
40 views

How to blink or identify NVMe drives connected to an LSI 9500 tri-mode controller

we have the following setup in Supermicro server: LSI 9400 -> expander -> 10 x HDD LSI 9500 -> expander -> 2 x NVMe |------------| |-----------| | LSI 9400 |...
0 votes
0 answers
40 views

ZoL+FIO Randwrite nvme bs=8k@32io = 148MiB/s?

Sorry for the title, but it's very short summary of BS that I'm looking into. Situation I'm using ZoL 2.1.5 (from jonathonf's ppa) on Ubuntu (tried 20.04&22.04) I have following NVMe disk ...
0 votes
0 answers
124 views

How does RAID0 affect IOPS performance for NVMe SSDs?

I have an application which needs to read large amounts of small and randomly distributed entries from storage. To improve the performance I am considering to install a specialized hardware RAID ...
  • 135
0 votes
0 answers
67 views

How to increase 1st partition size via terminal only when there are second and third adjacent partitions for NVME

This is on an AWS EC2 M5a with EBS (Ubuntu 16.04) NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT nvme0n1 259:1 0 50G 0 disk ├─nvme0n1p1 259:2 0 20G 0 ...
1 vote
0 answers
126 views

Mirror Accelerated Parity / NVMe / ReFs / Fast-Tier Issues

I'm currently building a lab server with some cheapish hardware. 2 NVMe SSDs, bunch of 3.5 HDDs. After creating a Tiered Storage (NVMe-Mirror & HDD-parity), formating it with ReFS, everything ...
  • 164
0 votes
1 answer
39 views

In NVMe, what is the difference between a reserved log and an unsupported log?

I'm reading through the NVMe specification. On page 237 it says the following for get-log return value 0x09: Invalid Log Page: The log page indicated is invalid or not supported. This error condition ...
0 votes
0 answers
94 views

centos7.9 mdadm raid0's performance which is only 50% of centos8 mdadm raid0

I use the same PC and same NVMe SSDs do the raid performance test on different OS. The steps are as follows: mdadm -C -v /dev/md0 -l0 -n4 /dev/nvme[0123]n1 mkfs.xfs /dev/md0 mount -o discard /dev/md0 ...
0 votes
1 answer
378 views

Google Cloud Platform instance creation failure (Invalid value for field 'resource.disks[1].initializeParams.diskSizeGb')

I'm trying to create an instance using GCP. The followings are the specifications (the rest of the settings are set as default): Region: us-west1-b GPU type: NVIDIA Tesla V100 Number of GPUs: 1 Series:...
  • 11
-1 votes
1 answer
31 views

SSD IOPS inquire

I have question about IOPS For example is there difference in IOPS if the SSD was ( sata 2.5 or M.2 sata or M.2 M-key nvme ) i know sata interface = 600MB M.2 sata = 600MB m.2 M-Key nvme = 2000MB But ...
  • 1
1 vote
1 answer
550 views

NVMe SSD poor writing performance on Debian 10

I just went for some disk performance tests on my DIY NAS and noticed some very poor performace results with my NVME disk writes ! My NAS runs Debian 10 with this config : ASROCK X470D4U with Ryzen 5 ...
0 votes
1 answer
78 views

NVMe parallel writes

I'm trying to understand better how writing to NVMe can be optimized. I have a process which writes a large amount of data to disk (~100 gb) in one batch job. The data is spread across 100s of files. ...
1 vote
2 answers
278 views

AWS i3en.3xlarge really low iops

I just launched a new instance ec2 instance of type i3en.3xlarge. Operating system is Ubuntu. I mounted the NVMe Instance store but every speed test I run is incredible low at around 7k iops. What am ...
0 votes
1 answer
153 views

Does the Dell PowerEdge R240 support booting from M.2 NVMe drives?

Did anybody try whether the Dell PowerEdge R240 (or the 14th generation in general) supports booting from M.2 NVMe disks inserted through some (non-Dell) PCIe-M.2-adapter card? Dells manual doesn't ...
  • 192
1 vote
1 answer
70 views

Intel S2600JF server: Processor PCIe Link Speed menu in the BIOS is missing

i have a Intel 4 node server with S2600 JF motherboard per node (older, DDR3 RAM, E5-2600 v1 and v2). I want to insert a NVMe pcie card (with two drives) that requires bifurcation. Based on the ...
0 votes
0 answers
685 views

PCI NVMe mdadm RAID1 performance too slow

I know this has been discussed multiple times but I have not found any solution so far that worked so posting here hoping there is some solutions in Dec 2021… I have a Dell R640 server with dual Xeon ...
1 vote
1 answer
1k views

Health Tests on NVMe

On the servers I have, with HDD or SSD, I have a cron that periodically runs: /usr/sbin/smartctl --test=short/long /dev/sd1 (for each disk) While it runs, it just looks at the output of /usr/sbin/...
  • 471
2 votes
0 answers
287 views

AWS: Can't mount my restored volume (EBS snapshot)

I restored an EBS volume from AWS Backup and attached it to a new EC2 instance. When I lsblk I can see it under the name /dev/nvme1n1. More specifically the output of lsblk is: NAME MAJ:MIN RM ...
0 votes
0 answers
42 views

Figure out what NVME target device initiator is using

I've got a simple NVME-TCP stack going (Linux to Linux machines), and it works fine. One one machine I've got the initiator going and it presents block device in typical form (e.g. /dev/nvme2n1). ...
0 votes
1 answer
285 views

Can we prevent Windows from marking NVMe drives as removable?

I've noticed recently that when adding NVMe drives to Windows, it has a tendency to mark them as removable. I think this is more likely on "enterprise" NVMe SSDs, at least in my experience. ...
1 vote
1 answer
221 views

Show free SSD space after TRIM / UNMAP / Deallocate?

For a hard drive supporting ATA TRIM, SCSI UNMAP, or NVMe Deallocate, is it possible to report on the amount of unallocated space? For example, we take a 1TB drive, then write 500GB data to it, then ...
  • 483
0 votes
1 answer
293 views

How do you generate a new encryption key for a drive that uses SED (Self Encryption Drive)

So I'm currently learning more about NVMe drives that ship with a feature called SED (Self Encrypting Drive). Take the Smasung 970 EVO for instance. It clearly states that it features SED. The 970 ...
0 votes
1 answer
1k views

How do I maximize nvme raid0(md) performance (in linux)?

Nvme raid0 read(and write) performance is sometimes worse than the performance of one individual underlying drive. hdparm -t /dev/md0 : Timing buffered disk reads: 7054 MB in 3.00 seconds = ...
  • 41
6 votes
3 answers
1k views

Very slow write speed (NVME drive) on 10G network

Setting up an experimental lab cluster, the write speed for data received via 10G fiber connection is 10% of the local write speeds. Testing transfer speed between two identical machines; iperf3 shows ...
  • 191
0 votes
0 answers
52 views

Single-disk array full: how to add a spare disk without losing data?

So I rent this server from Hetzner and it was labeled as 2x512gb nvme ssd. Indeed, the server contains two 512 gb nvme ssd but (my fault) I noticed only later that they were in some sort of software ...
6 votes
3 answers
794 views

MongoDB on NVMe in production

I'm setting up my db production environment and I have some questions. The server has two NVMe disks, but they cannot be used in the hardware RAID controller. Do I need RAID with NVMe? Would it be ...
  • 163
1 vote
1 answer
801 views

Windows storage spaces tiered storage not using nvme drive?

I'm trying to run an Ethereum full node (geth v1.10) with archiving for big data analysis. The storage requirements are expected to be 8TB after being fully sync'd. I have a Synology NAS that is ...
1 vote
1 answer
328 views

Interpreting SMART Logs of Newly Installed NVMe RAID0 Crashing Everyday

An Ubuntu 20.04 system has been stable for a year until a 2nd and 3rd NVMe drive is installed on the motherboard to form a 2x1TB RAID0 array. Ever since then, there is huge amount of IO load on this ...
  • 1,449
5 votes
1 answer
263 views

Are my drives being utilized equally with Linux Software RAID 0 array?

I have four NVMe drives in a RAID 0 configuration. I am attempting to determine how many IOPS the array is handling. When I run iostat, it appears that one drive is handling more IO than the other ...
4 votes
3 answers
3k views

How can I override IRQ affinity for NVME devices

I am trying to move all interrupts over to cores 0-3 to keep the rest of my cores free for high speed, low latency virtualization. I wrote a quick script to set IRQ affinity to 0-3: #!/bin/bash while ...
  • 1,098
3 votes
1 answer
2k views

Dell R630 supported PCIe to NVMe (m.2) adapter and drive?

I can't seem to find any information anywhere about supported PCIe to NVMe (m.2) adapter and a brand of drive that will also work. I am aware third party adapters and drives tend to work with various ...
  • 75
1 vote
0 answers
80 views

Read data off Apple NGFF M2

I have one of those propietary NGFF M2 SSDs found in older Macbooks. I bought a converter which is supposed to convert it to a standard NVMe. When I plug it in my Linux box only sees it as a SCSI ...
0 votes
2 answers
1k views

Hyper-V Server SSD vs NVME M.2

I'm quite novice on setting up servers and VMs and I'm trying to setup a simple PC to act up as a server in an office. The requirements are low but I think this is a good opportunity for me to learn ...
1 vote
1 answer
64 views

Since VFRC feature in VMware is now end of lifed, what can I replace it with?

Now that VFRC (vflash read cache) is end of lifed in Vsphere 7, does anyone have suggestions on what I could replace it with. Looks like there is only Infinio and Virtunet in the market now, has ...
0 votes
0 answers
131 views

AMD Optane alternative

I want to have an Optane features with my Ryzen build: high TBW and high I/O. Disk space irrelevant (like MEMPEK1W064GA, 64GB would be enough for me). And it would be nice if I can utilize the full ...
7 votes
0 answers
1k views

Write performance is 5 times worse with LUKS on top of mdadm RAID10 than without LUKS

I have servers with many NVMe disks. I am testing disk performance with fio using the following: fio --name=asdf --rw=randwrite --direct=1 --ioengine=libaio --bs=16k --numjobs=8 --size=10G --runtime=...
0 votes
1 answer
32 views

VMware nvme writes on unallocated space

I just have a question related to the disk DWPD that I have a hard time finding the answer in google. Consider this scenario: 1 server with only 1 nvme disk of 1TB (no SATA, no Optane, no SD cards, ...
  • 103
1 vote
0 answers
188 views

IPXE boot on amd based architecture with NVME

We have a quite big infrastructure and now we started to use AMD based servers instead of the intel ones with 1 nvme only for os. We are using ipxe to kickstart the servers but for some reason with ...
1 vote
0 answers
1k views

Very slow read/write on software raid1 with nvme device on Ubuntu focal

I have a server with Ubuntu 20.04.1 LTS with NVME ssd devices running on raid1 and the hard drive operates so slow! to open a gzip file to of 500MB to a 3.7GB takes a while.. way more then it should. ...
  • 323
2 votes
3 answers
1k views

NVMe disk problems - smartctl 0x2002 status

My NVMe disk works but it is very slow compared to what it was. I benchmarked it 6 months ago at 2000MB/s using fio, the exact same test now is giving me 350MB/s I ran smartctl but it's giving a ...
  • 23
1 vote
2 answers
148 views

Do modern NVMes correct and reallocate bad data at the hardware level?

I'm planning on getting an NVMe for use to contain a swapfile to extend the RAM of my Linux system. Yes, I know this is a bad choice due to the finite number of writes an NVMe has in its lifetime, but ...
1 vote
1 answer
1k views

Do I need to replace my NVME SSD?

I have a simple server setup: 2 NVME SSD disks (both SAMSUNG MZVLB1T0HALR-00000 for 1TB) united into RAID0. OS Ubuntu 19.04 Today my system stopped responding. Reboot didn't help. I connected via KVM ...
  • 111
5 votes
2 answers
901 views

How to explain these fio bandwidth results?

Been running a couple of fio tests on a new server with the following setup: 1x Samsung PM981a 512GB M.2 NVMe drive. Proxmox installed with ZFS on root. 1x VM with 30GB space created and Debian 10 ...
  • 193
1 vote
1 answer
3k views

add M.2 NVMe enablement kit to HP DL360gen9

I have a HP DL360gen9 8sff Applications running on the machine are saturating the current disks, all Intel Enterprise SSD disks. I would like to add M.2 NVMe drives but I can't figure out which ...
3 votes
5 answers
3k views

Linus/ext4/nvme crashes during high io

During mvn compilation, I have random crashes. The problem seems related to high IO and in kern.log, I can see things like: kernel: [158430.895045] nvme nvme1: controller is down; will reset: CSTS=...
  • 151
2 votes
1 answer
2k views

DELL r630 + NvMe M.2->PCie : Cannot boot Ubuntu installed on M.2 NvMe drive via. PCie adapter

I have plugged in a PNY XLR8 500GB M.2 NvMe drive in a Delock PCIe card and stuck it in Riser 3 on my Poweredge r630 - Although the drive doesn't show up anywhere in BIOS, I could boot the Ubuntu ...
  • 65
0 votes
1 answer
2k views

Nearly 100% disk utilization after upgrading to debian 10 without any reason

We recently upgraded our servers to debian 10. The setup is completely the same as with debian9 beside of course some new software packages. We are running the default kernel: $ uname -a Linux ...
  • 1,211