Questions tagged [storage]

Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.

Filter by
Sorted by
Tagged with
0 votes
0 answers
17 views

Windows Server 2016 Standard: User accounts filling up C: drive, but the accounts are empty

I'm dealing with a virtual server that keeps maxing out the C: drive due to the Users directory. The Users directory has well over 2,000 Users, each taking up ~70MB of space, but when I look in an ...
Christopher DeAngelis's user avatar
0 votes
0 answers
30 views

ceph "permission denied" when adding storage OSD

I just setup three storage nodes for ceph in a qemu/kvm environment to learn about it. OS is Ubuntu Server 22.04 LTS. The ceph and ceph-common packages are from standard repos. I followed the ...
user5717448's user avatar
0 votes
0 answers
57 views

LVM disk is corrupt - is any data recoverable?

Under RHEL7 we have a logical volume consisting of 27 volume groups PVs. Each of these VGsPVs was added sequentially as we ran out of space on the LV. We do not have a backup of the data. There are ...
tmark's user avatar
  • 141
0 votes
1 answer
26 views

HBA in Linux storage server - best practices for many HDDs

I will launch and administrate a Linux storage server: 4U, HBA LSI 9500-16i Tri-Mode, hybrid. It wiill possess 12 positions for the HDDs/SSDs in the back, 24 positions in front. There is an expander ...
michalt's user avatar
  • 11
0 votes
0 answers
32 views

How to calculate Storage Spaces Direct nested mirror accelerated parity for two servers. Very odd results when setting up a volume

Using https://learn.microsoft.com/en-us/azure-stack/hci/concepts/nested-resiliency as a backstop things seem to be pretty simple. When setting up a mirror accelerated parity volume over two servers ...
AngryCarrotTop's user avatar
0 votes
0 answers
46 views

Many drives in two RAID6 arrays simultaneously failed, seem to be working after reboot except SMART long test

in my storage server, I operate three RAID6 Linux software arrays. Everything was working fine until it was not. There are two RAID6 arrays and one RAID5 array, all consisting of SATA drives, all ...
michalt's user avatar
  • 11
-1 votes
0 answers
47 views

How do I expand the disk size? /dev/sda is not populating, /dev/vda1 full

I started uploading images and got my /dev/vda1 full. How do I expand the size? Googling told me to mount volumes. I use Digital Ocean, and followed these instructions: # Format the volume sudo mkfs....
Ivan's user avatar
  • 107
0 votes
1 answer
27 views

Jenkins - Space distribution

We are running a Jenkins server with multiple nodes. After some time and more and more projects that got added to the instance, we are encountering multiple issues (that we have to few people to solve,...
Marvin S.'s user avatar
0 votes
0 answers
29 views

Erasure coding error detection ability

I would like to know in an (2+1) Erasure coding storage setup, can it detect corruption when one node is lost, and there is a silent data corruption from HDD on one of the remaining node. I am ...
Waiho's user avatar
  • 23
1 vote
1 answer
37 views

iSCSI shared disks with custom device name on clients

I'm using RHEL 7.9 (Maipo) and need to setup for all iSCSI clients the same device name, like /dev/sdb or /dev/thiscustomname. I could do that by sharing the source disk using multipath, but for Db2 ...
adamitj's user avatar
  • 113
21 votes
1 answer
2k views

Birth time of files are missing if file is created in a logical volume with size less than 512 MB

I have a volume group in my system, created with single physical volume. I'm creating two logical volumes - one with size 100M and one with size 512M. Any file created on LV with 100M size does not ...
m.divya.mohan's user avatar
0 votes
0 answers
24 views

df command showing incorrect information

i have two rhel 7.9 servers with replicated glusterfs storage, and the df command is dispalying wrong size information on both servers The machines size on Vcenter is 16.3To but when using df it shows ...
Asma Mohamed Nacer's user avatar
0 votes
0 answers
17 views

Spanned disk created from a single LUN?

Does this appear to you as a single 2 TB LUN (Disk 4), separated into two separate 1 TB partitions, then spanned together into a logical volume ('G')? If so, how was this accomplished? I am unable to ...
PorLosTacos's user avatar
4 votes
2 answers
721 views

Windows File server heavy cpu usage - Render Farm with many clients reading data at once

I have a windows file sever with Dual Xeon E5-2650v4 cpus. They are 14 core each so 28 cores total. The network interface is a Mellanox Connectx3 40gbs. The disk drives in the server are 7.68TB Sata ...
tom greene's user avatar
1 vote
1 answer
64 views

Upgrade from SATA to SAS: Expected speedup?

My current setup is this: Megaraid 9361-16i 12 x 12 TB SATA disks WD DC HC520 Connected to the controller via 3 of the 4 SAS ports Configured either Raid-10 or Raid-6 without spares. Raid-6 in write-...
Homer512's user avatar
  • 113
2 votes
4 answers
202 views

Creating replicated gluster volume always gives Distributed-Replicate volume

Peace upon you, I am trying to create a replicated gluster volume but always it gives me Distributed-Replicate volume i followed the following commands Pool Peers root@tiny1:~# gluster peer status ...
Yassine Chilali's user avatar
0 votes
1 answer
40 views

Cloud File Storage: Does zipping files reduce data transmission speed / costs?

If I need to store, say, a 5gb file on a cloud file storage location (e.g., aws s3 bucket), will zipping the file reduce the cost / latency when people download it? Obviously zipping a file reduces ...
Matt's user avatar
  • 105
1 vote
2 answers
66 views

Expanding XFS file system from another device?

I have two virtual devices on a fedora system. Both are in a raid 5 configuration. No LVM is in place. The system it’s self is installed on one of the devices. That same device is also the one with ...
LCaraway's user avatar
  • 113
4 votes
1 answer
407 views

Linux immutable backup repository deployment architecture best practice?

What are the Linux distributions that are compatible with the Immutable repository? Can you give me some advice on the best hardware or virtual machine configurations to deploy a large backup ...
Senior Systems Engineer's user avatar
1 vote
1 answer
33 views

Netapp Storage to HP Nimble cloud

We have a working Netapp Setup with FAS2720 9.7P9 Version connected to Fujitsu ESXi (VMWare 5.5). With multiple VMs running on 3 ESXi Systems but they are residing entirely on Netapp Storage. We are ...
Sachin H's user avatar
0 votes
1 answer
47 views

Recover files from deduplicated volume in Windows Storage Server 2016

We have a Windows Storage Server 2016 having some volumes with Storage Deduplication enabled. Its OS crashed so we had to re-install the OS (couldn't restore from backup). There are some files which ...
Piyush B's user avatar
  • 103
-1 votes
1 answer
42 views

Do clouds charge upon the storage usage or processing power or both? [closed]

I am interested to know if I want to deploy my Kubernetes cluster on a cloud service like AWS, do they charge upon the storage my application uses or the processing power it uses or both? Is there any ...
best_of_man's user avatar
0 votes
1 answer
33 views

Can you use a SAS fan-out cable to connect more drives?

I bought a Broadcom 9400-16e HBA that has four external ports. I was hoping that by using four mini-SAS cables that fan-out to two, I could double the number of connected drives from 16 to 32. However,...
Jorsher's user avatar
  • 131
0 votes
0 answers
198 views

LVM thin pool show 100% usage

I've deployed openstack and used LVM as a backend for the cinder block storage, but after using it for a while I could no longer allocate block storage volumes , after checking the available space in ...
Rafik's user avatar
  • 35
1 vote
1 answer
90 views

RAID6 REBUILD - Virtual Drive not importable

Good morning, Last week, the heatsink of our LSI9271-8i Raid card dropped off from the card and the card is dead. It is an 8 disk x 10TB (Slot7 is hot spare) RAID6. Well, we have another LSI9271-8i, ...
matabufalez's user avatar
2 votes
2 answers
302 views

Distributed SSD cache for network storage

Our small computing cluster has 3 computing nodes and 1 file server. The file server has around 70TB data to be accessed by the 3 computing nodes. All of the 3 computing nodes have 3 4TB SSDs which ...
Leo's user avatar
  • 21
1 vote
2 answers
81 views

Configure ceph block storage pool in cockpit

I have a plain install on machine C with Oracle Linux 9.1 and cockpit and cockpit-machines. On machines A and B I have a ceph cluster configured which defines an rbd block storage pool for VM disks. ...
a.ilchinger's user avatar
2 votes
2 answers
191 views

How to bind spdk driver to NVMe device if root filesystem is mounted there?

I am trying to use SPDK in Ubuntu 20.04 (Linux kernel 5.4.0) to run storage applications. My NVMe SSD is allocated as below: $ lsblk ... nvme0n1 259:1 0 1.5T 0 disk ├─nvme0n1p1 ...
Sadman Sakib's user avatar
0 votes
0 answers
125 views

How to store EBS volumes in the database ( using aws ebs as postgresql dataspace)

I have created a Ec2 Amazon linux 2 instance and have attached 4 extra EBS volumes ( gp2=3gb, gp3=3gb,io1=4gb, io2=4gb and mounted it and I have installed postgres db on it. I have created number of ...
Sam's user avatar
  • 1
2 votes
1 answer
94 views

System Volume Information filling up; ways to alleviate?

On all versions of Windows Server from 2012R2 onward, we are seeing System Volume Information folders, especially on server C: drives but also others, often filling up with hundreds of gigabytes of ...
Jonathan Brickman of Topeka KS's user avatar
0 votes
0 answers
29 views

HP ML350G9 and Smart Array installation

I have a HP ML350G9, with an array controller type 440ar. On the motherboard there are two 4xSATA-connectors, but when the 440ar is installed, it blocks those two ports. I found this guide of how to ...
espen4001's user avatar
0 votes
1 answer
217 views

Setting up resilient single drive NVMe storage for LUKS encryption

I would like to set up resilient encrypted storage with single NVMe drive for my laptop and its (encrypted) backup (with SATA housing and SSD drive). This is what I have at the moment: SSD -> GPT ...
Alojzij Blatnik's user avatar
0 votes
0 answers
16 views

I increased VM storage from Virtual Media Manager in VBox but it is not applied in VM

Here is how I increased the storage of the VM in the VBox interface: I used Virtual Media Manager. I increased the VM storage and apply. When I click Information: Format: VDI Storage details: ...
domandaciao's user avatar
0 votes
0 answers
30 views

Does interface bandwidth and/or interface type (SATA/NVME) affect IO and Random 4KB RW performance

TLDR: The advertised IOPS of NVME drives is leaps above any SATA SSDs, but how much of this is due to limitations of the: Interface (SATA/NVME) Interface Bandwidth (PCIE Gen 4, Gen 3, SATA 3, SATA 2) ...
James Hopwood's user avatar
0 votes
0 answers
171 views

storcli: A proper way to replace a drive in RAID0 or How to migrate virtual drive WITH data loss?

I have a RAID0 where I need to replace a drive and can lose the data. In order to replace it, I do: storcli64 /c0/e1/sX set offline storcli64 /c0/e1/sX set missing storcli64 /c0/e1/sX spindown then ...
Andrey Sapegin's user avatar
0 votes
0 answers
480 views

Is there a tool for copying files directly from any running Kubernetes pod to another?

I would like to move a large file set from a running Kubernetes pod to another (possibly in another cluster) in order to migrate quickly from one Storage Class to another with little or no downtime. I ...
Richard Fairthorne's user avatar
0 votes
1 answer
30 views

Does the data size of an SSD chip have compatibility issues with certain boards?

I'm considering getting an 8TB SSD storage chip for my Intel NUC mini-server (I install linux on it). However, I'm wondering if there are any considerations one needs to take when adding that much ...
Patrick Collins's user avatar
0 votes
1 answer
129 views

can you cancel the rescan-scsi-bus.sh --forcerescan action

i was wondering if it was possible to cancel the rescan-scsi-bus.sh --forcerescan action after running it ? as far as i can see all it does is adds echo 1 > /sys/class/scsi_device/${host}:${channel}...
txblx's user avatar
  • 1
0 votes
1 answer
434 views

Persistent volume claims vs subPath

I would like to use a single mount point on a node (ie /data) and have a different sub folder for each PersistentVolumeClaim that I am going to use in my cluster. At the moment I have multiple ...
yellowhat's user avatar
  • 101
0 votes
1 answer
234 views

Is it possible to specify storage class with azcopy?

I would like to use azcopy to sync a local drive with cloud storage. However I want to specify it to use archive storage tier. Is this possible? I am not really clear from the help page: $ ./azcopy....
max pleaner's user avatar
1 vote
0 answers
187 views

Cannot get over 100k iops from storage on 10g network on 4k random blocks

My setup description: storage system for vm storage: supermicro server, 1-socket Xeon E5-2620 v4, 82599ES-intel-based RA-Link 10GE network adapter, 8x pci-e 2.0, plugged in 8x pci-e 3.0 slot, debian ...
John Kraft's user avatar
1 vote
1 answer
227 views

How best to deal with large dovecot inboxes?

I have a small number of mail users (abut 100) and some have comparatively large (10Gb+) mail boxes. I'm running Ubuntu using postfix and dovecot Maildir format. I could just keep adding storage, but ...
TommyPeanuts's user avatar
0 votes
0 answers
124 views

Can I prevent rsync from setting attributes on the topmost directory?

I'm currently building a solution to rsync Gerrit data into a Kubernetes container which has storage (a persistent volume) mounted at /var/gerrit/logs/. I am trying to use the rsync command below, but ...
brovoca's user avatar
0 votes
0 answers
90 views

mapping lshw output to lsblk to get disk storage

I am trying to get all the hardware devices in one pass and later get more details on each one of them. So, I start with lshw and use lshw -short -c storage to get storage devices, shows something ...
Ani's user avatar
  • 32
3 votes
1 answer
258 views

Shared file system among pods

We are running a cluster of x nodes. Every node in the cluster pulls some files from remote storage. Unfortunately, the remote server is getting overloaded. So we are exploring a solution in which ...
Kiran Ramesh's user avatar
-2 votes
2 answers
224 views

How do you rate limit an Azure Storage account?

I have an Azure storage account that hosts 20 MB files. Users download the files directly from the storage account, and there is no CDN or anything monitoring the traffic. I'm concerned that users can ...
MakotoE's user avatar
  • 99
-1 votes
1 answer
38 views

Add a petabyte of storage to your GCP Virtual Machine

How do you add a petabyte of storage to your GCP Virtual Machine Video Storage Seems the optimal solution to do enterprise video storage would be in a google cloud bucket. I want to access this ...
Gary Truesdale's user avatar
1 vote
1 answer
34 views

enquiry on performance boost/hit for centralized source code location

My website currently has multiple windows servers , all of them local in intranet, and each of them have the same source code in the same folder. Currently my workflow is every time I want to Live a ...
hafwan's user avatar
  • 23
3 votes
2 answers
89 views

SAN Solution for diverse VM Servers

I recently got my fingers into Server Administration. I am currently the only person administering an air gapped network with 8 sites. Most things are dated and old but I get the money to renew things....
Auberginer's user avatar
1 vote
1 answer
521 views

kubernetes - assign individual storage to each replica in statefulset

I am running a statefulset in my cluster and am trying to assign each of the replicas (3 in total) to assign their own PVC. Unfortunately, I can only provide 1 name as claimName. How do I make sure ...
realShadow's user avatar

1
2 3 4 5
39