Questions tagged [storage]
Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.
1,891
questions
0
votes
1
answer
14
views
How to check HPE StorageWorks MSA60 health disk
I have an HP Dl380 g6 with Windows server 2019 and the storage is an MSA60. I use a Smart Arrey P800 card for the MSA60.
Is there any windows HP software that I can check the disks health? Or I need ...
- 13
0
votes
0
answers
16
views
storage backup solution after file finished copy
I have 2 types of storage: 1) permanent [p1,p2,...] 2) backup [b1,b2,...].
While system works, It generates huge files (size > 50GB) and they are copied to permanent storage.
I need a backup ...
- 1
0
votes
0
answers
31
views
Cluster Storage Pools - disable Auto-Pooling
We have a Hyper-Converged Cluster and we utilise a Storage Pool to create Disks/Volumes within, this is all great and works nicely, however, we have a scenario whereby we want to create a separate SSD ...
- 1
1
vote
0
answers
21
views
Mirror Accelerated Parity / NVMe / ReFs / Fast-Tier Issues
I'm currently building a lab server with some cheapish hardware. 2 NVMe SSDs, bunch of 3.5 HDDs. After creating a Tiered Storage (NVMe-Mirror & HDD-parity), formating it with ReFS, everything ...
- 164
1
vote
1
answer
51
views
Docker Swarm Distributed File System with local storage
I'm looking for a distributed file system solution/network file system which can be used in the following scenario:
I have a Docker Swarm with many hosts, but each host is essentially self-contained ...
1
vote
0
answers
47
views
Hyper-v 2012R2 host looses connection to cluster storage
We have a concerning issue with one of our 4 Hyper-V 2012R2 hosts. It looses connection to the clustered storage now and then and any VMs on that host naturally stops when this happens. After a ...
- 11
0
votes
1
answer
19
views
Autoscaling images with EBS attached
We have an AWS EC2 instance that has an EBS gp3 SSD mounted with around 70GB. Sometimes, we do some scp orders to copy new files to this EBS, but for the rest of the time, the instance will only do ...
0
votes
1
answer
53
views
Storage for Millions of audio files with search accessibility (if possible) [closed]
I was looking for solution for this problem that I have with storing of 7tb worth of files , all of them are audio files these files are recordings of asterisk based server freepbx.
At first what I ...
0
votes
1
answer
68
views
btrfs - failing disk generated checksum errors, disk replaced, errors remain
I had a pair of 3TB disks in a btrfs raid1 array.
One of these disks started failing (smartd shows bad sectors), and so I bought a pair of new 8TB drives to replace both disks in the array.
I replaced ...
- 135
0
votes
0
answers
8
views
Ubuntu server boot drive mistakenly filled up
I have a simple Ubuntu storage server installation with a 100+ HDDs attached to it using mergerfs (a union file system) and DAS/disk shelves. The 480 GB SSD boot drive has filled up, but based on the ...
- 261
1
vote
1
answer
13
views
Using git lfs to manage data in storage server
I am part of a small physics research team (10-15 people) which recently has acquired a storage server and I will be responsible for setting it up. As such, I needed to think the best way to organize ...
- 111
0
votes
0
answers
19
views
On a used Nutanix/Supermicro server, I can't see an added SAS drive from the bios even though I can when installing Ubuntu from USB
Bought a used Nutanix 2-node server. It has a SATADOM boot drive in the motherboard with Nutanix software and CentOS. I want to just run bare metal Ubuntu server so attached a 4TB SAS drive to the ...
- 101
0
votes
1
answer
36
views
Software RAID Options Combining Internal SATA & External USB?
BACKGROUND
I currently use a hybrid server-workstation setup for my primary workstation. Basically, just a Fedora base running Linux KVM, on which I then containerize a couple Linux flavors & a ...
0
votes
0
answers
29
views
removing inaccessible datastore in vmware nfs41 - not typical sytuation
after storage metrocluster failure my datastores became inaccessible.
I logged into esxi host via ssh listed storages and removed them using following commands:
esxcli storage nfs41 list
esxcli ...
- 311
1
vote
1
answer
159
views
Synology Storage Manager rejects healthy disks as "Critical" because of "reset commands"?
I am trying to install a new HDD in my DS1515+. The hard drives are brand new Seagate Exos X.
I have bought 3 of these drives, and 1 of them works fine and is now part of my storage pool, but the ...
0
votes
1
answer
53
views
Stretch Cluster File Server with Storage Replica - Partnership not reversing on failure simulation
First off, sorry if this is the wrong place to post this.
I have a Storage Replica setup running in a MSCS Stretch Cluster configuration, two sets of two VMs with each set running on a separate ESXi ...
- 101
0
votes
1
answer
23
views
Synology SHR Volume - Migrate from 3 disks (RAID5-ish) volume into 2 new disks (RAID1-ish)
What I have:
3 x 6TB SHR Volume with 12 TB redundant storage (1 disk recently broken)
What I want:
2 x 18TB SHR volume with 18 TB redundant storage (I'll expand the volume after the migration)
Of ...
1
vote
1
answer
58
views
Simple way to dynamically increase volume size regularly
I have a pair of physical servers with 32TB of raw disk space each (4 * 8TB x 2) in a ZFS pool on Ubuntu. After formatting, I am currently at 86% used and my data volume is growing at a reasonably ...
- 61
0
votes
0
answers
15
views
CIFS shares on Centos7 are not available if single node of fileshare cluster goes down even if using FQDN for multi-node storage cluster
I am currently mounting cifs shares using /etc/fstab and 'mount -a'. Here is an example of one of the mount fstab lines (minus some specfic share naming info):
\\filer-01.domainname.com\apps\...
- 1
0
votes
0
answers
14
views
Dell PowerVault MD3420 - controller cache issues
My MD3420 has a data corruption issue. Some of the Windows VM disks are shown as RAW instead of NTFS now. I've looked into the MD event logs and found these disturbing entries :
RAID controller ...
- 1
0
votes
0
answers
373
views
Persistent volume claim getting stuck in Pending mode
I have just configured openebs as the storageclass type on k0s but when I then attempt to create a persistent volume claim it gets stuck in Pending mode.
As a check to satisfy the WaitForFirstConsumer ...
- 113
0
votes
1
answer
64
views
ZFS / Zpool with limited disk usage?
I have a server with a JBOD of 36 x 14TB disks that have a total usage capacity of 12.7TB (Disks are WUH721414AL5201)
I have created two zpool's:
zpool1 which contains 3 vdev's (Each of them having ...
- 103
0
votes
1
answer
45
views
High util iostat
I have server with oracle db. It works on Dell Unity storage.
The server has very slow disk IO.
How can I fix it?
Here are some details of my server:
OS - OL8
Kernel - 5.4.17 uek
Storage - Dell ...
- 1
1
vote
1
answer
61
views
LVM with uneven proportional "stripe" distribution over 2 disks of different sizes
Is there a way to create a "striped" LV in a VG with 2 disks of different sizes in such a way it utilizes 100% of the available space?
Linear LV would work, but I want to have the load ...
- 260
0
votes
2
answers
43
views
Kubernetes - PersitentVolume vs StorageClass
I have this example of a Persitent Volume from this article on postgresql via kubernetes statefulset
kind: PersistentVolume
apiVersion: v1
metadata:
name: pgdata
labels:
app: postgres
type:...
- 217
-1
votes
2
answers
53
views
Disk iops vs latency
I am trying to understand the diference between iops and latency, this is my question:
If an hypothetical disk had 2 io per second, then its latency would be 0.5 seconds?
0
votes
2
answers
33
views
Is there an easy way to expand a Linux VMs disk?
Im currently planning a cloud solution.
The cloud is supposed to run on Linux VMs via vSphere.
Right now, every time I want to increase the virtual disk space of an already set up Linux VM, it’s a ...
- 67
1
vote
0
answers
16
views
Determining Required LUN Level Uniqueness
I have primarily used NFS for most of my storage needs but I find my self setting up some iSCSI targets today and had what is likely a super basic question.
When I create an export for an iSCSI target,...
- 23
0
votes
1
answer
92
views
Move partition to another disk
Looking to move a partition on Disk 0 (E:) to Disk 3. Reason for doing so is that I want to extend the Disk 0 (C:) partition and I want both drives/partitions on separate VMDK's.
Disk 0 and Disk 3 are ...
- 285
-1
votes
2
answers
32
views
Simple solution for PDF storage [closed]
I'm trying to make a PDF storage that can be accessed by anyone who has the URL to the specific PDF file. Basically I want to be able to hand out just a URL to a person and that leads to the PDF file.
...
0
votes
0
answers
74
views
Assigning hard disks directly from the pool vs syncing back to zfs/block host
What are the specific pros and cons, perhaps even conventions, of attaching a volume to a VM directly from a proxmox zfs pool VS mounting the volume through a file/block storage solution like TrueNAS (...
- 95
0
votes
0
answers
39
views
How do I set up a JBOD device on Ubuntu using a SAS card
I am running Ubuntu 20.04 LTS server. I have installed a SAS PCI card I purchased from Amazon.
The card is active and detected (lspci shows the device).
I have installed the appropriate drivers from ...
- 582
-1
votes
3
answers
48
views
Is it possible to host the database on one server, but the actual data on another? [closed]
We're planning to do AI research using an HPC. This HPC will use datasets that we've created. These datasets are fairly big subsets of the entire dataset (~1TB). All the data we've gathered from ...
- 109
0
votes
0
answers
9
views
Openshift Container Storage will not upgrade
I've got an Openshift cluster which runs Openshift Container Storage 4.4.1. I'd like to update OCP to a higher version, but as far as I understand, I need to upgrade operators first. OCS shows in ...
- 101
0
votes
0
answers
34
views
Is there any NATIVE disk monitoring solution for storage in Azure VMs?
I have done plenty of digging, but it looks like this may be a shortcoming in Azure. I cannot find a native solution in the Azure portal to tell me when VMs are running low on disk space. What if I ...
- 61
1
vote
0
answers
139
views
Openmediavault assemble raid6 with mdadm
I have a raid 6 with 1 hot spare. I the initial config was with 5 6TB drives then I added 2 more 6TB drives with the openmediavault web interface. Everything was fine after that. But the last time ...
- 38
6
votes
2
answers
2k
views
Why does `df` and `du` report free space differently on Ubuntu 18.04? [duplicate]
Why would these two commands report free space so differently? This started happening last year on several Ubuntu 18.04 VMs from time to time.
df reports 100% used while du -smh shows only 2.3G of the ...
- 171
0
votes
0
answers
41
views
Sharing My USB Storage on remote desktop server
I have a server with public IP number running windows server 2019 .
I can access this server via remote desktop through my personal computer.
Is it possible to share my USB storage from my personal ...
0
votes
0
answers
22
views
Is there any limit in how many drives I can combine in one LV
Let say I have 16 4TB Drives in a Raid 1 setup (two drives per raid1). This gives me 8 4TB drives to store on. Now I want those to be one big partition. Is it possibel to use all those 8 drives in one ...
- 11
0
votes
1
answer
87
views
Hyper-V: Benefit of Putting Virtual Hard Disks and Virtual Machines Folders on Separate Drives
Hyper-V has two folders 'Virtual Hard Disks' and 'Virtual Machines', the first stores the virtual disks themselves and the latter stores settings, snapshots, etc.
Is there's benefit of storing these ...
- 195
2
votes
0
answers
119
views
Recovering data from a Dell MD3220 array after both controllers have databases that were corrupt
I have been working on trying to restore data from an array created on a Dell MD3220 PowerVault storage unit. On the phone with Dell and another support group for weeks now and running into brick ...
- 765
0
votes
0
answers
15
views
Reading a file stored on the storage bucket via my VM SSH
I want to run a python script that starts by importing a large table of data. I've seen that instead of using the upload option form the SSH panel of the VM I can use the storage bucket and start by ...
google-cloud-platform
0
votes
1
answer
60
views
Two directories share storage without symbolic link
I am in a pickle.
I have a server (physicals machine) that has a link between a directory and a partition. I don't see a symbolic link.
The problem is that the root partition shows 0% space. Even if I ...
- 117
0
votes
0
answers
16
views
customize host name and boot volume name on SVC storage
I am using PowerVC, which is based on Openstack. Unfortunatelly, PowerVC doesn't officialy support these features - I assume this is inherited from Openstack.
While deployment of new VM on IBM ...
- 1
2
votes
1
answer
516
views
How to get Linux kernel to rescan virtio disks?
I have a virtio disk mounted to a KVM guest, backed by an LVM logical volume. I increased the size of the logical volume with lvresize on the KVM host machine.
Then I had to issue virsh pool-refresh ...
- 153
7
votes
2
answers
1k
views
SMART shows unreadble sectors, btrfs scrubs are clean - which is correct?
I have a pair of disks in RAID1 formatted with btrfs.
The disks go through periodic scrubbing and I get notified with the results. They've been running great for about 2-3 years with no issues.
...
- 135
2
votes
2
answers
215
views
High speed network writes with large capacity storage
I have a NAS running Samba with a 20T ZFS pool with one raid1 vdev with two spinning rust drives. I have 16G RAM in the machine right now. The storage is used for continuously growing, permanent ...
- 374
0
votes
1
answer
37
views
In Azure policy, is it possible to detect a container/blob creation and apply a deployIfNotExist policy?
I would like that a blob storage private endpoint is created for every storage account which uses blob storage. So for that purpose, i want to use an azure policy with deployIfNotExist rules. So if a ...
- 107
0
votes
0
answers
63
views
/var/lib/mysql taking up large amount of space
I have a very simple drupal project that I launched onto an AWS EC2 instance with 8GB of storage. However, something strange has happened and my EC2 ran out of storage. My mysql databases don't even ...
- 101
2
votes
1
answer
262
views
After filesystem reached 100% storage capacity now set to read-only, how to reset to read-write mode?
Yesterday our server (Ubuntu 18.04) reached 100% storage capacity
and set one of our filesystems to read-only mode, see: /dev/md3 / ext4 ro,relatime,errors=remount-ro,data=ordered 0 0. I've tried ...
- 123