Questions tagged [storage]
Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.
1,965
questions
0
votes
1
answer
53
views
Media Being Hosted In SVN For Web Application [closed]
I have a client who decided to use SVN to host the media files and pulled by a web application for viewing. What are the consequences of this, and wouldn't a better option be to use a NAS or CDN?
2
votes
3
answers
3k
views
What's the relation between "HP Diagnostics" the "Array Config Utility" and "Windows Disk Manager"
I have a failed drive that is reported in HP Diagnostics
https://localhost:2381/hpdiags/frontend2/frontend.php?
It tells me that Logical Drive 5 has a drive that is about to fail. The name of ...
1
vote
1
answer
429
views
VirtualBox Fedora Host Windows Guest Networking and Folder Aliases
I'm new to running virtual machines and I have a couple questions.
I have a Fedora 14 box with an 8 core Bulldozer processor that is running VirtualBox with Windows. This machine has several ...
1
vote
1
answer
1k
views
SAN Boot CHAP'd iSCSI Target?
I have a few computers on my network that boot via iSCSI (due to dead HDDs) using chainloaded iPXE over DHCP. I wanted to enable CHAP for my iSCSI target to increase security (and learn). However, ...
10
votes
1
answer
2k
views
2.5 inch drives versus 3.5 inch drives
I am looking for some publicly available comparisons between 2.5 inch drives and 3.5 inch drives. What I had assumed is that a 2.5 inch 15k drive and a 3.5 inch 15k drive would have identical ...
1
vote
1
answer
1k
views
RAID5 Array issues - copy data or replace drive first
I have inherited a critical situation as follows.
2 x 16-Disk RAID5 Storage systems (one holding master data, one
holding backups)
Backup system had no monitoring and two disks failed
so all data is ...
2
votes
2
answers
286
views
LTO-4 Tape Physical Storage [closed]
We have moved to an LTO-4 tape backup system. It works great and now we have a stack of physical tapes lying around that need to be stored and ultimately secured. I was curious what options exist ...
3
votes
1
answer
7k
views
Is Microsoft's "Storage Spaces" just LVM for Windows? [closed]
From initial reading, it looks like Microsoft's forthcoming "Storage Spaces" is an LVM-like tool for Windows.
Is this a correct assessment?
If it's not merely LVM-for-Windows, then what is it, and ...
1
vote
2
answers
1k
views
Adding nearline SAS disks to a controller with SAS disks
I have a Dell Poweredge 840 server that currently has a pair of hot swappable 146Gb SAS disks attached to a SAS 5IR controller, configured as RAID 1.
I have two spare slots to add two add more ...
1
vote
1
answer
645
views
How to connect drive array to redundant motherboards?
How should one connect a small storage array, four 3TB SATA drives for now, to two motherboards or controllers as a failover system? This means avoiding adding another single point of failure such as ...
3
votes
1
answer
689
views
Installed 2TB disk in ubuntu server, dmesg reports it as 9444732965540666 MB
I've have an ageing Linux server running on Dell PowerEdge hardware, with a SAS 5IR RAID controller. It has a pair of SAS 146Gb disks in a RAID 1 configuration that has the OS and other software. I ...
53
votes
6
answers
67k
views
How to move files between two S3 buckets with minimum cost?
I have millions of files in a Amazon S3 bucket and I'd like to move these files to other buckets and folders with minimum cost or no cost if possible. All buckets are in the same zone.
How could I ...
1
vote
1
answer
137
views
250 users with a data dir on a central server - how would you set it up?
I'd like to get best-practice advice on how to setup a scheme where 250 users or more have OS independent access to their own data-dir / user-dir on a central server in the local network. from the ...
7
votes
5
answers
8k
views
SAS Expanders for DIY JBOD Arrays
I am researching making a DIY SAS array much like the Dell MD1000. My understanding is that these devices do not contain a RAID controller, instead they present all the drives on in SAS domain to the ...
8
votes
2
answers
1k
views
Are branded backplanes useable without specific controllers?
I can't find a disk enclosure which I like, so I'm going to build a custom one (if nothing else, that'll teach me to be picky...). I've got a few HP SAS backplanes lying about, but I'm wondering if ...
2
votes
3
answers
740
views
Does NetApp providing tooling to export a WAFL export snapshots to a file?
With the open source ZFS file systm, an exact copy/snapshot can be produced using zfs snapshot. This includes file-system level optimizations like deduplication. Further you can send these to a remote ...
0
votes
2
answers
887
views
How to backup NetApp storage on Linux? [closed]
Our NetVault license is about to expire within the next year, so what alternatives are there on Linux?
We have 20TB and many millions of files, so time on the backup window is important.
The backup ...
0
votes
2
answers
192
views
parted subtracting partition size 16896 from size given
When I create a partition using parted(mkpart) giving unit as Bytes, it is creating "size given - 16896" byte sized partition.
Is there any specific reason to less 16896 bytes from the partition size(...
10
votes
6
answers
53k
views
VMware VMFS5 and LUN sizing - multiple smaller datastores, or 1 big datastore?
With VMFS5 no longer having the 2TB limit for a VMFS volume, I'm considering which scenario would be more beneficial overall:-
Less LUNs of larger size, or
More LUNs of smaller size.
In my case, I ...
1
vote
4
answers
194
views
Calculating risk vs cost for server storage
This is a request for 2 different types of information:
Is there a formula that can/should be followed to calculate risk vs cost of server storage?
What factors should one take into consideration ...
0
votes
3
answers
14k
views
Maximum Size Limit for CIFS Share Accessed by Windows Server 2003 (32 bit) Client?
We have a CIFS share being served out by a NETAPP appliance. The CIFS share has grown to over 2 TB in size. A Windows Server 2003 32 bit-client accesses the share.
Lets say, for example, the ...
1
vote
1
answer
883
views
MySQL Cluster on SSD
We are planning to implement a four node MySQL Cluster and are considering using SSDs as the storage. We would like to get a high level of performance and very low latency on disk IO from the small ...
11
votes
4
answers
48k
views
How do I get my HP servers to email me when a drive fails?
Ideally, with as simple of install as possible and without requiring rebooting the servers. Mostly for DL380 G5's if it helps.
2
votes
1
answer
2k
views
vmware esx 4.1 cant see existing SAN storage
I have 3 esx 4.1 hosts connected to HP EVA 4400 StorageWork. All host can see 6 datastore, LUN1 to LUN6, 1TB for each datastore. Recently I add another esx 4.1 host but unfortunately this now host ...
2
votes
2
answers
550
views
lvm over two raid1's - one slow, one fast. What will happen?
Two software RAID1's,
0: 2x 15K SAS drives, 73GB
1: 2x WD Caviar Green, 3TB
So the first RAID is a faster one, the second a slower data grave. What happens when I add both to a LVM logical volume ...
0
votes
1
answer
1k
views
Converter to use Sata HDD with IBM eserver x236
We have an old x236 machine with 2 70-GB SCSI disks installed on Ultra320 SCSI connector (check out the hardware manual). Now, we are planning to buy a new server in future and x326 would act as a ...
1
vote
1
answer
751
views
Backup HFS+ filesystem to linux server
I am the sysadmin for a small company with 3 Xserves running OSX 10.6.8 containing mission critical data that need to be backed up in an automated fashion.
To accomplish this, we are going to deploy ...
2
votes
2
answers
197
views
What do you do when your site scales so much that uploaded_media can't fit on one machine? [closed]
What do you do when your site scales so much that your uploaded_media (in Django, where all uploaded media files from users is stored) can't fit on one machine?
My personal case, I'm using Django and ...
2
votes
2
answers
233
views
Storing 64000+ files and growing in one folder (ext3)
I'm using a directory as a staging area for my files before shipping them to Amazon S3 buckets. This staging directory has no sub-directory structure /a/b/c or /year/month/day ... it's only files /cdn/...
1
vote
1
answer
238
views
ZFS: can per-user encrypted filesystems be deduplicated on block-level?
Let's assume I build a storage system where each user gets his/her own encrypted filesystem on top of a ZFS pool. Would deduplication on pool-level still work when each fs is encrypted?
What ...
1
vote
2
answers
670
views
ZFS: Best-practices doc state: "On systems with 1,000s of ZFS file systems..."?
The docs state:
"On systems with 1,000s of ZFS file systems, provision 1 GB of extra memory for every 10,000 mounted file systems including snapshots."
What does that mean - how do these people use ...
0
votes
1
answer
105
views
Bandwidth efficient software RAID [closed]
I have this crazy idea .. that might just work if I find my missing piece
Take network with 40 windows workstations (on 24 hours)
Each machine uses 20 GB out of 500 GB capacity
Install free copy of ...
190
votes
2
answers
48k
views
What are the different widely used RAID levels and when should I consider them?
This is a Canonical Question about RAID levels.
What are:
the RAID levels typically used (including the RAID-Z family)?
deployments are they commonly found in?
benefits and pitfalls of each?
0
votes
1
answer
88
views
Raid group on a p2000g3 iscsi
I have to set up an hypervR2 cluster (2nodes) and a san storage (hp p2000g3 iscsi) with 12 disks (300 GO, 10k SAS)
The p2000 has 2 controllers.
What is the best ?
ONe big raid group (raid10) with the ...
1
vote
0
answers
209
views
Virtual linux drive on a NAS - recommendations
I have a Linux server currently running under a Microsoft Virtual Machine. I have it set up so that the storage drive is set up as a secondary virtual disk. I need to move this machine to a new box ...
0
votes
5
answers
343
views
Desktop HDD in a server? [duplicate]
Possible Duplicate:
What are the merits of SAS vs SATA drives?
Would it be OK to use a SATA 6Gb/s desktop drive in a server?
Say for example a 4 Seagate ST31000524AS drives in a raid 10 array.
I ...
2
votes
3
answers
352
views
Best way to attach 96 tb to workstation
I'm running a workstation with dual xeon 5690's (12 physical/24 logical cores), 192 gb of ram (ie, maxed-out), Windows 7 64bit, 5 slots for adapter cards, and 1 tb of internal storage, with 5 more ...
1
vote
1
answer
342
views
How to diagnose storage system scaling problems?
We are currently testing the maximum sequential read throughput of a storage system
(48 disks total behind two HP P2000 arrays) connected to HP DL580 G7 running RHEL 5 with 128 GB of memory.
Initial ...
8
votes
6
answers
23k
views
MegaRAID JBOD substitute
It seems that certain MegaRAID chips don't support JBOD (unfortunately).
I've read online that to make these controllers act as a pass-through, I should configure the disks in RAID0.
What RAID0 ...
-1
votes
2
answers
1k
views
How do the file sharing websites store such huge amounts of data? [closed]
I'm referring to file sharing websites like megaupload.com, rapidshare.com and the software download websites like download.com, filehippo.com.
They need to store tons of terabytes of data and they ...
3
votes
5
answers
23k
views
How to implement cheap LFF 3.5" SATA storage on a HP ProLiant ML350 G6 with 2.5" SFF SAS
In a series of bad, hasty decisions, a HP ProLiant ML350 G6 server was bought for file server use at my place of work. The intention was to build a FreeNAS 8 server using cheap 3.5" SATA drives.
Only ...
-2
votes
3
answers
96
views
Data storage solutions for rapidly running out of space [closed]
I have 2 web servers (1 live and other backup), the issue I have is our storage is rapidly running out.
All the data on the server is used by our customers and new documents are uploaded to the ...
0
votes
1
answer
446
views
Redundancy on the Freenas install itself?
I'm wondering what kind of redundancy I can put in place for the Freenas install itself. If the drive that Freenas is installed on fails, does that mean all my raid volumes are gone since its all ...
19
votes
5
answers
2k
views
Extremely fast booting server
I'm changing the way that our DHCP/DNS stuff works at work. Currently we've got 3 DNS servers, and a DHCP box. All of them are VMs.
There's a circular dependency where stuff booting requires NFS, ...
2
votes
4
answers
971
views
Drobo Thin Provisioning: What happens when you run out of space?
I'm thinking about getting a Drobo S to add some storage on a Windows Server 2008 R2 box. The Drobo offers thin provisioning.
While I will only have 4.5TB of space initially, I'd like to use thin ...
9
votes
4
answers
4k
views
Advantages of thick provisioning of storage over thin provisioning with virtual machines
I typically use thin-provisioning of storage space when building VMs: it provides a lot of flexibility, and seems to be faster to build.
The only potential definite advantage I can see is to ensure ...
4
votes
1
answer
601
views
iSCSI volume for hyper-v
I am moving several hyper-v VMs from an under-powered host to a newer host with an iSCSI array for storage. What is the best configuration for the iSCSI volume to get the best performance for hyper-v? ...
2
votes
4
answers
3k
views
Store and backup 200 million small files
My disk are 10x1TB SAS 7200 RPM in a RAID 10 with a MegaRaid 9260 hardware controller with cache/BBU. This results in a 4.6TB RAID 10 volume. hdparm -t (when device is empty) results in 500MB/s.
RAID ...
4
votes
4
answers
13k
views
Set up simple Infiniband Block Storage (SRP or iSER)
I'm trying to figure out how to set up a simple storage system which exports block storage over Infiniband, using either SRP or iSER.
I'm very early in the process, and at the moment I'm basically ...
1
vote
2
answers
1k
views
Can we "add" more SAS ports to an existing backplane?
We have a 3U Supermicro chassis with 16 bays on a SAS expander backplane. We have 15 of the bays occupied with hard drives at the moment. We would like to add two more drives to the backplane, but we ...