Questions tagged [storage]
Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.
1,941
questions
0
votes
0
answers
17
views
Windows Server 2016 Standard: User accounts filling up C: drive, but the accounts are empty
I'm dealing with a virtual server that keeps maxing out the C: drive due to the Users directory. The Users directory has well over 2,000 Users, each taking up ~70MB of space, but when I look in an ...
0
votes
0
answers
30
views
ceph "permission denied" when adding storage OSD
I just setup three storage nodes for ceph in a qemu/kvm environment to learn about it. OS is Ubuntu Server 22.04 LTS. The ceph and ceph-common packages are from standard repos. I followed the ...
0
votes
0
answers
57
views
LVM disk is corrupt - is any data recoverable?
Under RHEL7 we have a logical volume consisting of 27 volume groups PVs. Each of these VGsPVs was added sequentially as we ran out of space on the LV.
We do not have a backup of the data. There are ...
- 141
0
votes
1
answer
26
views
HBA in Linux storage server - best practices for many HDDs
I will launch and administrate a Linux storage server: 4U, HBA LSI 9500-16i Tri-Mode, hybrid. It wiill possess 12 positions for the HDDs/SSDs in the back, 24 positions in front. There is an expander ...
- 11
0
votes
0
answers
32
views
How to calculate Storage Spaces Direct nested mirror accelerated parity for two servers. Very odd results when setting up a volume
Using https://learn.microsoft.com/en-us/azure-stack/hci/concepts/nested-resiliency as a backstop things seem to be pretty simple. When setting up a mirror accelerated parity volume over two servers ...
- 288
0
votes
0
answers
46
views
Many drives in two RAID6 arrays simultaneously failed, seem to be working after reboot except SMART long test
in my storage server, I operate three RAID6 Linux software arrays. Everything was working fine until it was not.
There are two RAID6 arrays and one RAID5 array, all consisting of SATA drives, all ...
- 11
-1
votes
0
answers
47
views
How do I expand the disk size? /dev/sda is not populating, /dev/vda1 full
I started uploading images and got my /dev/vda1 full. How do I expand the size?
Googling told me to mount volumes. I use Digital Ocean, and followed these instructions:
# Format the volume
sudo mkfs....
- 107
0
votes
1
answer
27
views
Jenkins - Space distribution
We are running a Jenkins server with multiple nodes. After some time and more and more projects that got added to the instance, we are encountering multiple issues (that we have to few people to solve,...
0
votes
0
answers
29
views
Erasure coding error detection ability
I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node.
I am ...
- 23
1
vote
1
answer
37
views
iSCSI shared disks with custom device name on clients
I'm using RHEL 7.9 (Maipo) and need to setup for all iSCSI clients the same device name, like /dev/sdb or /dev/thiscustomname.
I could do that by sharing the source disk using multipath, but for Db2 ...
- 113
21
votes
1
answer
2k
views
Birth time of files are missing if file is created in a logical volume with size less than 512 MB
I have a volume group in my system, created with single physical volume.
I'm creating two logical volumes - one with size 100M and one with size 512M.
Any file created on LV with 100M size does not ...
- 333
0
votes
0
answers
24
views
df command showing incorrect information
i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers
The machines size on Vcenter is 16.3To but when using df it shows ...
0
votes
0
answers
17
views
Spanned disk created from a single LUN?
Does this appear to you as a single 2 TB LUN (Disk 4), separated into two separate 1 TB partitions, then spanned together into a logical volume ('G')? If so, how was this accomplished? I am unable to ...
- 41
4
votes
2
answers
721
views
Windows File server heavy cpu usage - Render Farm with many clients reading data at once
I have a windows file sever with Dual Xeon E5-2650v4 cpus. They are 14 core each so 28 cores total.
The network interface is a Mellanox Connectx3 40gbs.
The disk drives in the server are 7.68TB Sata ...
- 41
1
vote
1
answer
64
views
Upgrade from SATA to SAS: Expected speedup?
My current setup is this:
Megaraid 9361-16i
12 x 12 TB SATA disks WD DC HC520
Connected to the controller via 3 of the 4 SAS ports
Configured either Raid-10 or Raid-6 without spares. Raid-6 in write-...
- 113
2
votes
4
answers
202
views
Creating replicated gluster volume always gives Distributed-Replicate volume
Peace upon you,
I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume
i followed the following commands
Pool Peers
root@tiny1:~# gluster peer status
...
- 121
0
votes
1
answer
40
views
Cloud File Storage: Does zipping files reduce data transmission speed / costs?
If I need to store, say, a 5gb file on a cloud file storage location (e.g., aws s3 bucket), will zipping the file reduce the cost / latency when people download it?
Obviously zipping a file reduces ...
- 105
1
vote
2
answers
66
views
Expanding XFS file system from another device?
I have two virtual devices on a fedora system. Both are in a raid 5 configuration. No LVM is in place. The system it’s self is installed on one of the devices. That same device is also the one with ...
- 113
4
votes
1
answer
407
views
Linux immutable backup repository deployment architecture best practice?
What are the Linux distributions that are compatible with the Immutable repository?
Can you give me some advice on the best hardware or virtual machine configurations to deploy a large backup ...
- 1,255
1
vote
1
answer
33
views
Netapp Storage to HP Nimble cloud
We have a working Netapp Setup with FAS2720 9.7P9 Version connected to Fujitsu ESXi (VMWare 5.5). With multiple VMs running on 3 ESXi Systems but they are residing entirely on Netapp Storage.
We are ...
- 11
0
votes
1
answer
47
views
Recover files from deduplicated volume in Windows Storage Server 2016
We have a Windows Storage Server 2016 having some volumes with Storage Deduplication enabled.
Its OS crashed so we had to re-install the OS (couldn't restore from backup).
There are some files which ...
- 103
-1
votes
1
answer
42
views
Do clouds charge upon the storage usage or processing power or both? [closed]
I am interested to know if I want to deploy my Kubernetes cluster on a cloud service like AWS, do they charge upon the storage my application uses or the processing power it uses or both?
Is there any ...
- 337
0
votes
1
answer
33
views
Can you use a SAS fan-out cable to connect more drives?
I bought a Broadcom 9400-16e HBA that has four external ports. I was hoping that by using four mini-SAS cables that fan-out to two, I could double the number of connected drives from 16 to 32. However,...
- 131
0
votes
0
answers
198
views
LVM thin pool show 100% usage
I've deployed openstack and used LVM as a backend for the cinder block storage, but after using it for a while I could no longer allocate block storage volumes , after checking the available space in ...
- 35
1
vote
1
answer
90
views
RAID6 REBUILD - Virtual Drive not importable
Good morning,
Last week, the heatsink of our LSI9271-8i Raid card dropped off from the card and the card is dead. It is an 8 disk x 10TB (Slot7 is hot spare) RAID6.
Well, we have another LSI9271-8i, ...
- 11
2
votes
2
answers
302
views
Distributed SSD cache for network storage
Our small computing cluster has 3 computing nodes and 1 file server. The file server has around 70TB data to be accessed by the 3 computing nodes. All of the 3 computing nodes have 3 4TB SSDs which ...
- 21
1
vote
2
answers
81
views
Configure ceph block storage pool in cockpit
I have a plain install on machine C with Oracle Linux 9.1 and cockpit and cockpit-machines. On machines A and B I have a ceph cluster configured which defines an rbd block storage pool for VM disks. ...
- 121
2
votes
2
answers
191
views
How to bind spdk driver to NVMe device if root filesystem is mounted there?
I am trying to use SPDK in Ubuntu 20.04 (Linux kernel 5.4.0) to run storage applications. My NVMe SSD is allocated as below:
$ lsblk
...
nvme0n1 259:1 0 1.5T 0 disk
├─nvme0n1p1 ...
- 144
0
votes
0
answers
125
views
How to store EBS volumes in the database ( using aws ebs as postgresql dataspace)
I have created a Ec2 Amazon linux 2 instance and have attached 4 extra EBS volumes ( gp2=3gb, gp3=3gb,io1=4gb, io2=4gb and mounted it and I have installed postgres db on it.
I have created number of ...
- 1
2
votes
1
answer
94
views
System Volume Information filling up; ways to alleviate?
On all versions of Windows Server from 2012R2 onward, we are seeing System Volume Information folders, especially on server C: drives but also others, often filling up with hundreds of gigabytes of ...
0
votes
0
answers
29
views
HP ML350G9 and Smart Array installation
I have a HP ML350G9, with an array controller type 440ar.
On the motherboard there are two 4xSATA-connectors, but when the 440ar is installed, it blocks those two ports.
I found this guide of how to ...
0
votes
1
answer
217
views
Setting up resilient single drive NVMe storage for LUKS encryption
I would like to set up resilient encrypted storage with single NVMe drive for my laptop and its (encrypted) backup (with SATA housing and SSD drive).
This is what I have at the moment:
SSD -> GPT ...
- 123
0
votes
0
answers
16
views
I increased VM storage from Virtual Media Manager in VBox but it is not applied in VM
Here is how I increased the storage of the VM in the VBox interface:
I used Virtual Media Manager.
I increased the VM storage and apply.
When I click Information:
Format: VDI
Storage details: ...
0
votes
0
answers
30
views
Does interface bandwidth and/or interface type (SATA/NVME) affect IO and Random 4KB RW performance
TLDR: The advertised IOPS of NVME drives is leaps above any SATA SSDs, but how much of this is due to limitations of the:
Interface (SATA/NVME)
Interface Bandwidth (PCIE Gen 4, Gen 3, SATA 3, SATA 2)
...
0
votes
0
answers
171
views
storcli: A proper way to replace a drive in RAID0 or How to migrate virtual drive WITH data loss?
I have a RAID0 where I need to replace a drive and can lose the data. In order to replace it, I do:
storcli64 /c0/e1/sX set offline
storcli64 /c0/e1/sX set missing
storcli64 /c0/e1/sX spindown
then ...
- 1,201
0
votes
0
answers
480
views
Is there a tool for copying files directly from any running Kubernetes pod to another?
I would like to move a large file set from a running Kubernetes pod to another (possibly in another cluster) in order to migrate quickly from one Storage Class to another with little or no downtime.
I ...
0
votes
1
answer
30
views
Does the data size of an SSD chip have compatibility issues with certain boards?
I'm considering getting an 8TB SSD storage chip for my Intel NUC mini-server (I install linux on it). However, I'm wondering if there are any considerations one needs to take when adding that much ...
- 103
0
votes
1
answer
129
views
can you cancel the rescan-scsi-bus.sh --forcerescan action
i was wondering if it was possible to cancel the rescan-scsi-bus.sh --forcerescan action after running it ? as far as i can see all it does is adds
echo 1 > /sys/class/scsi_device/${host}:${channel}...
- 1
0
votes
1
answer
434
views
Persistent volume claims vs subPath
I would like to use a single mount point on a node (ie /data) and have a different sub folder for each PersistentVolumeClaim that I am going to use in my cluster.
At the moment I have multiple ...
- 101
0
votes
1
answer
234
views
Is it possible to specify storage class with azcopy?
I would like to use azcopy to sync a local drive with cloud storage. However I want to specify it to use archive storage tier. Is this possible? I am not really clear from the help page:
$ ./azcopy....
- 111
1
vote
0
answers
187
views
Cannot get over 100k iops from storage on 10g network on 4k random blocks
My setup description:
storage system for vm storage: supermicro server, 1-socket Xeon E5-2620 v4, 82599ES-intel-based RA-Link 10GE network adapter, 8x pci-e 2.0, plugged in 8x pci-e 3.0 slot, debian ...
- 11
1
vote
1
answer
227
views
How best to deal with large dovecot inboxes?
I have a small number of mail users (abut 100) and some have comparatively large (10Gb+) mail boxes. I'm running Ubuntu using postfix and dovecot Maildir format.
I could just keep adding storage, but ...
- 472
0
votes
0
answers
124
views
Can I prevent rsync from setting attributes on the topmost directory?
I'm currently building a solution to rsync Gerrit data into a Kubernetes container which has storage (a persistent volume) mounted at /var/gerrit/logs/. I am trying to use the rsync command below, but ...
- 1
0
votes
0
answers
90
views
mapping lshw output to lsblk to get disk storage
I am trying to get all the hardware devices in one pass and later
get more details on each one of them.
So, I start with lshw and use lshw -short -c storage to get storage devices, shows
something ...
- 32
3
votes
1
answer
258
views
Shared file system among pods
We are running a cluster of x nodes.
Every node in the cluster pulls some files from remote storage. Unfortunately, the remote server is getting overloaded. So we are exploring a solution in which ...
- 131
-2
votes
2
answers
224
views
How do you rate limit an Azure Storage account?
I have an Azure storage account that hosts 20 MB files. Users download the files directly from the storage account, and there is no CDN or anything monitoring the traffic. I'm concerned that users can ...
- 99
-1
votes
1
answer
38
views
Add a petabyte of storage to your GCP Virtual Machine
How do you add a petabyte of storage to your GCP Virtual Machine
Video Storage
Seems the optimal solution to do enterprise video storage would be in a google cloud bucket. I want to access this ...
1
vote
1
answer
34
views
enquiry on performance boost/hit for centralized source code location
My website currently has multiple windows servers , all of them local in intranet, and each of them have the same source code in the same folder. Currently my workflow is every time I want to Live a ...
- 23
3
votes
2
answers
89
views
SAN Solution for diverse VM Servers
I recently got my fingers into Server Administration. I am currently the only person administering an air gapped network with 8 sites. Most things are dated and old but I get the money to renew things....
- 31
1
vote
1
answer
521
views
kubernetes - assign individual storage to each replica in statefulset
I am running a statefulset in my cluster and am trying to assign each of the replicas (3 in total) to assign their own PVC. Unfortunately, I can only provide 1 name as claimName. How do I make sure ...
- 59