Questions tagged [storage]
Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.
1,965
questions
1
vote
0
answers
16
views
fio gives an unexpected IOPS number
While running tests with fio, we encountered unexpected behavior of it.
Test config:
[global]
iodepth=64
direct=1
ioengine=libaio
group_reporting
time_based
runtime=6000
numjobs=1
rw=randrw
...
0
votes
0
answers
31
views
bcachefs - how to setup a ssd only volume
I stumbled across bcachefs a few days ago.
After some research, I still have a few questions.
As I understand it, only the foreground_target must be defined.
Does it make sense to set up a ...
-1
votes
1
answer
141
views
DL320e Compatibility with a StorageWorks disk array
I currently have a HPE DL320e Gen8 V2. I'd like to expand the storage capabilities for the system as it is being used as a lab NFS system. My question is, since I am not extremely versed in hardware,...
2
votes
1
answer
650
views
Serving HTTPS images with Minio
I followed this documentation, but I can't make my images to be served with HTTPS.
I have the following /etc/default/minio configuration file:
MINIO_ACCESS_KEY="admin"
MINIO_VOLUMES="/...
0
votes
0
answers
46
views
why rook cephfs storage class store pv data in 2 places?
I am a newbie to ceph and run ceph using rook in bare metal environment.my question is :
when you use rook cephfs provisioner as storage class and create a pvc to assign to a pod , when the pv is ...
0
votes
1
answer
124
views
Extending LVM on virtualized ubuntu server
Ok, I hope I can explain this correctly. I am running ubuntu server on proxmox. Unbuntu is running my docker instance. My LVM i originally assigned it is full and I added more storage in proxmox ...
0
votes
0
answers
60
views
FreeBSD ZFS raidz1 Started a (da59) drive replacement. During resilver, second drive (da60) failed
Our system started slowing down... Found a couple of drives in the same raid that looked scary.
Replaced the drive that S.M.A.R.T. marked as failure eminent. (da59)
Then da60 started to error.
Finally ...
1
vote
1
answer
69
views
Setting bytes-to-inode ratio on AKS storage class
I'm hitting inode limits on an AKS cluster in a volume (ext4) provisioned with Azure Disk Provisioner.
I've found the docs on the CSI Driver, but there's no mention on how to choose the target ...
0
votes
0
answers
74
views
Is an in-place upgrade of HPE storage controllers non-destructive?
I've taken over a relatively small shop and would like to upgrade a host that's in production. Looking to get a more definitive answer to the title and would appreciate some firsthand experience.
The ...
0
votes
0
answers
48
views
Bonding 2 interfaces on my storage with different speed
On my synology storage I have bonding option. I am not sure if it is right to do that way, so if you can help me :) So my synology have 2 ports , 1x10G and 1x1G and i am thinking to bond them. Will ...
1
vote
0
answers
37
views
LVM Expand RAID1 with Asymmetric Segments Across 3 Heterogeneous Disks
I have 3 disks: one 1TB drive (A1), one 2TB drive (A2), and one 3TB drive (B). Currently, A2 has data on it in one LV that is 1.6TB in size. A1, A2, and B are PVs, in a volume group MyVG. I desire a ...
0
votes
1
answer
76
views
df reports zfs used space as 128K, not the actual used space
I have a ZFS mirror pool in my Proxmox instance. I am trying to get it to mount to an LXC container read-only (preferably not giving full filesystem access) so I can have Homepage detect the used and ...
0
votes
0
answers
131
views
Libvirt shared storage pool
I have what I hope is a quick question. I'm running:
CENTOS 9
KVM/QEMU
Pacemaker, DLM, lvmlockd, fence_scsi
I have a simple two node KVM cluster where I've set up a LVM logical volume on a attached ...
1
vote
0
answers
90
views
truenas NFS on kubernetes
I am using the following link to setup my k3s setup with Truenas. I am only interested in NFS. I will not be doing ISCSI. After I applied the "helm upgrade --install --create-namespace --values ...
2
votes
0
answers
107
views
Fix kickstart drift between CentOS 8 Stream behavior and CentOS 9 Stream behavior
I'm facing a weird situation on one of my server on the provisioning process.
Here is the machine HW Model:
HPE Proliant DL365 Gen 10 Plus with 6x 1.9TB SATA 6GBps SSD disks.
What's going on:
When I'm ...
2
votes
2
answers
103
views
Storage configuration for GPU servers (ML training)
We have recently purchased a couple of high performance GPU servers to use in training AI/ML models and the job of set up and administration has fallen upon me.
I'll preface this by saying I am ...
0
votes
0
answers
155
views
Proliant ML10 gen9 SSD upgrade
I have a proliant ML10 gen9 with windows server 2012 r2 foundation installed.
The system has a software raid 1 setup (intel rst) with two 1tb HP sata hdds and has started to run very slow.
I am ...
0
votes
1
answer
199
views
Kubernates - mount remote disk (Hetzner Storage Box) on pods
Imagine having a Pod with the capability to access a remote disk, in this instance, a Hetzner Storage Box. These types of storage can be accessed using various protocols
FTP/FTPS
SAMBA/CIFS
SFTP/SCP
...
0
votes
0
answers
10
views
Cannot see google storage buckets when connecting to VM through SFTP
Let's call sftp user Bob. On the VM itself, I can see and access the bucket no problem. Permissions are bob:bob. But when connecting via sftp directory buckets don't even show.
fstab config:
Bucket /...
0
votes
0
answers
229
views
Storage Replica Configuration Failure (error code 0x8009030e)
I`m not able to establish a storage replica between 2 windows servers 2016.
#The script I used
$SR = @{
SourceComputerName = 'Server-1'
SourceRGName = 'RG-1'
SourceVolumeName = "A:"
...
1
vote
0
answers
29
views
Hidden Storage Usage on Root Partition - Can’t Locate Files [duplicate]
I'm encountering a problem with the df command on my Debian 11.8 system. According to df, almost 90% of the space on my / (root) partition is being used. However, the root partition (formatted as ext4)...
4
votes
0
answers
102
views
Data Replication Approaches for Hot Standby Architecture
I'm relatively new to the world of storage & filesystems (please forgive me if I'm not using the correct language), and I'm currently researching ways to achieve a hot standby configuration -- i.e....
0
votes
0
answers
98
views
Storage configuration leads to Ubuntu Linux Server Boot failure - ( initramfs )
Ubuntu Server 22.04 installation is completed and successful but the OS doesn't boot!
What does mean initramfs ?
I've tried to install Ubuntu Server 22.04 on VM.
Installation is completed and ...
0
votes
2
answers
104
views
Can`t get Oracle SAS SSDs to work in HP Z640
I got a pair of SAS SSDs from a decomissioned Oracle server. Model name LB1606R SUN1.6T. I want to use them in HP Z640 workstation (running Windows 10 Pro) so I bought HP LSI 9217-4i4e SAS controller. ...
2
votes
1
answer
109
views
BIOS/Hardware Mirror Drive RAID 1 - Reliability, Consistency and Synchronization
Assuming I have enabled in BIOS a (presumably) hardware RAID in mirror aka RAID1 mode (as opposed to Software-one provided by the OS like Windows Storage Spaces), how is it actually ensuring data ...
0
votes
1
answer
107
views
Server 2022 Expand C:
I have a server running Server 2022. It has 2 Disks running in a raid configuration, copying everything from one disk to another (2TB per disk, 2TB total storage). I added 2 more disks(2TB ea), ...
0
votes
0
answers
50
views
Failover and offline reads in GlusterFS?
I have a cluster, where all machines have the daemon running and the clients mounted. As far as I understand, only the machine where I run peer probe becomes the host.
If a client goes down:
the ...
1
vote
0
answers
153
views
Multi-node OpenStack with iSCSI storage
I’m trying to deploy a multi-node OpenStack environment using Kolla, Ansible, and Ubuntu server. I successfully added a partition to my Cinder storage using iSCSI. But I can't configure OpenStack to ...
0
votes
1
answer
245
views
Data Sync between 2 Datacenters
I'm reaching out to you in the hope that some of you can provide me with fresh ideas for a current problem I'm working on. I'm planning to set up a redundant data center (including websites, mail ...
4
votes
1
answer
752
views
How to configure a LSI MegaRAID controller to host non-RAID backup disks which allow hot swap
I'm running a server with a LSI MegaRAID controller that has 4 slots in the backplane for 4 SATA HDDs. Two of those slots are used for HDDs which are configured as RAID1 which is used as the "...
0
votes
0
answers
215
views
Test-SRTopology Fails to Create CIM Session to Local Host
We are trying to setup Storage Replication between two brand new Server 2019 VMs. I have followed all the steps in Microsoft's guide (https://learn.microsoft.com/en-us/windows-server/storage/storage-...
0
votes
1
answer
79
views
Can I mirror a 2-disk striped zpool to a single large drive?
Currently I have a 4TB pool with two striped drives:
# zpool status
pool: lxd
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some ...
1
vote
1
answer
39
views
Storing each file on separate physical drives for a single file volume
I am working with a bunch of really large files (>100 GB). As we often process multiple large files in parallel (e.g. 10-12), we think that it might be advantageous to have each file be stored on ...
-1
votes
3
answers
344
views
how to design a sql query to have sub-columns in the result?
I tried several sql queries but it does not meet my expectations because in the result I cannot have sub-columns
i need to design a sql query for the following result (have sub-columns in the result):
...
-2
votes
2
answers
86
views
How many SAS drives can you put on an ASUS RS720A-E11/E12-RS24U?
The ASUS RS720-E12-RS24U server comes with 24 2.5‘‘ drive bays. The specification on the ASUS web page says that only 8 of the 24 bays support SAS drives. However, according to the manual, (chapter 2....
0
votes
0
answers
41
views
How to size compute/gpu/storage/network for generative AI or LLM? [duplicate]
I would like to provision compute (servers), gpus (say 2 A100 80GB or H100), storage and network (may be 100GbE) to run OpenApaca 7B (https://huggingface.co/openlm-research/open_llama_7b) model.
How ...
0
votes
0
answers
59
views
Windows Server 2016 Standard: User accounts filling up C: drive, but the accounts are empty
I'm dealing with a virtual server that keeps maxing out the C: drive due to the Users directory. The Users directory has well over 2,000 Users, each taking up ~70MB of space, but when I look in an ...
0
votes
1
answer
1k
views
ceph "permission denied" when adding storage OSD
I just setup three storage nodes for ceph in a qemu/kvm environment to learn about it. OS is Ubuntu Server 22.04 LTS. The ceph and ceph-common packages are from standard repos. I followed the ...
0
votes
0
answers
293
views
LVM disk is corrupt - is any data recoverable?
Under RHEL7 we have a logical volume consisting of 27 volume groups PVs. Each of these VGsPVs was added sequentially as we ran out of space on the LV.
We do not have a backup of the data. There are ...
0
votes
1
answer
130
views
HBA in Linux storage server - best practices for many HDDs
I will launch and administrate a Linux storage server: 4U, HBA LSI 9500-16i Tri-Mode, hybrid. It wiill possess 12 positions for the HDDs/SSDs in the back, 24 positions in front. There is an expander ...
0
votes
0
answers
112
views
Many drives in two RAID6 arrays simultaneously failed, seem to be working after reboot except SMART long test
in my storage server, I operate three RAID6 Linux software arrays. Everything was working fine until it was not.
There are two RAID6 arrays and one RAID5 array, all consisting of SATA drives, all ...
0
votes
1
answer
89
views
Jenkins - Space distribution
We are running a Jenkins server with multiple nodes. After some time and more and more projects that got added to the instance, we are encountering multiple issues (that we have to few people to solve,...
0
votes
0
answers
45
views
Erasure coding error detection ability
I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node.
I am ...
1
vote
2
answers
109
views
iSCSI shared disks with custom device name on clients
I'm using RHEL 7.9 (Maipo) and need to setup for all iSCSI clients the same device name, like /dev/sdb or /dev/thiscustomname.
I could do that by sharing the source disk using multipath, but for Db2 ...
21
votes
1
answer
2k
views
Birth time of files are missing if file is created in a logical volume with size less than 512 MB
I have a volume group in my system, created with single physical volume.
I'm creating two logical volumes - one with size 100M and one with size 512M.
Any file created on LV with 100M size does not ...
0
votes
0
answers
35
views
df command showing incorrect information
i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers
The machines size on Vcenter is 16.3To but when using df it shows ...
0
votes
0
answers
22
views
Spanned disk created from a single LUN?
Does this appear to you as a single 2 TB LUN (Disk 4), separated into two separate 1 TB partitions, then spanned together into a logical volume ('G')? If so, how was this accomplished? I am unable to ...
5
votes
2
answers
1k
views
Windows File server heavy cpu usage - Render Farm with many clients reading data at once
I have a windows file sever with Dual Xeon E5-2650v4 cpus. They are 14 core each so 28 cores total.
The network interface is a Mellanox Connectx3 40gbs.
The disk drives in the server are 7.68TB Sata ...
1
vote
1
answer
106
views
Upgrade from SATA to SAS: Expected speedup?
My current setup is this:
Megaraid 9361-16i
12 x 12 TB SATA disks WD DC HC520
Connected to the controller via 3 of the 4 SAS ports
Configured either Raid-10 or Raid-6 without spares. Raid-6 in write-...
2
votes
4
answers
799
views
Creating replicated gluster volume always gives Distributed-Replicate volume
Peace upon you,
I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume
i followed the following commands
Pool Peers
root@tiny1:~# gluster peer status
...