Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.

learn more… | top users | synonyms

1
vote
2answers
207 views

LTO(4) Tape Physical Storage

We have moved to an LTO(4) tape backup system. It works great and now we have a stack of physical tapes lying around that need to be stored and ultimately secured. I was curious what options exist ...
3
votes
1answer
3k views

Is Microsoft's “Storage Spaces” just LVM for Windows? [closed]

From initial reading, it looks like Microsoft's forthcoming "Storage Spaces" is an LVM-like tool for Windows. Is this a correct assessment? If it's not merely LVM-for-Windows, then what is it, and ...
1
vote
2answers
497 views

Adding nearline SAS disks to a controller with SAS disks

I have a Dell Poweredge 840 server that currently has a pair of hot swappable 146Gb SAS disks attached to a SAS 5IR controller, configured as RAID 1. I have two spare slots to add two add more ...
1
vote
1answer
352 views

How to connect drive array to redundant motherboards?

How should one connect a small storage array, four 3TB SATA drives for now, to two motherboards or controllers as a failover system? This means avoiding adding another single point of failure such as ...
3
votes
1answer
513 views

Installed 2TB disk in ubuntu server, dmesg reports it as 9444732965540666 MB

I've have an ageing Linux server running on Dell PowerEdge hardware, with a SAS 5IR RAID controller. It has a pair of SAS 146Gb disks in a RAID 1 configuration that has the OS and other software. I ...
25
votes
4answers
21k views

How to move files between two S3 buckets with minimum cost?

I have millions of files in a Amazon S3 bucket and I'd like to move these files to other buckets and folders with minimum cost or no cost if possible. All buckets are in the same zone. How could I ...
1
vote
1answer
99 views

250 users with a data dir on a central server - how would you set it up?

I'd like to get best-practice advice on how to setup a scheme where 250 users or more have OS independent access to their own data-dir / user-dir on a central server in the local network. from the ...
4
votes
4answers
4k views

SAS Expanders for DIY JBOD Arrays

I am researching making a DIY SAS array much like the Dell MD1000. My understanding is that these devices do not contain a RAID controller, instead they present all the drives on in SAS domain to the ...
8
votes
2answers
521 views

Are branded backplanes useable without specific controllers?

I can't find a disk enclosure which I like, so I'm going to build a custom one (if nothing else, that'll teach me to be picky...). I've got a few HP SAS backplanes lying about, but I'm wondering if ...
1
vote
2answers
563 views

Can NetApp's WAFL export snapshots to files?

An exact copy of a ZFS file system can be made with snapshots using zfs send/receive. Can something similar be done with NetApp's WAFL, where you make a snapshot and export it to a file?
0
votes
2answers
630 views

How to backup NetApp storage on Linux? [closed]

Our NetVault license is about to expire within the next year, so what alternatives are there on Linux? We have 20TB and many millions of files, so time on the backup window is important. The backup ...
0
votes
2answers
73 views

parted subtracting partition size 16896 from size given

When I create a partition using parted(mkpart) giving unit as Bytes, it is creating "size given - 16896" byte sized partition. Is there any specific reason to less 16896 bytes from the partition ...
9
votes
6answers
44k views

VMware VMFS5 and LUN sizing - multiple smaller datastores, or 1 big datastore?

With VMFS5 no longer having the 2TB limit for a VMFS volume, I'm considering which scenario would be more beneficial overall:- Less LUNs of larger size, or More LUNs of smaller size. In my case, I ...
1
vote
4answers
152 views

Calculating risk vs cost for server storage

This is a request for 2 different types of information: Is there a formula that can/should be followed to calculate risk vs cost of server storage? What factors should one take into consideration ...
0
votes
3answers
4k views

Maximum Size Limit for CIFS Share Accessed by Windows Server 2003 (32 bit) Client?

We have a CIFS share being served out by a NETAPP appliance. The CIFS share has grown to over 2 TB in size. A Windows Server 2003 32 bit-client accesses the share. Lets say, for example, the ...
1
vote
1answer
640 views

MySQL Cluster on SSD

We are planning to implement a four node MySQL Cluster and are considering using SSDs as the storage. We would like to get a high level of performance and very low latency on disk IO from the small ...
6
votes
5answers
26k views

How do I get my HP servers to email me when a drive fails?

Ideally, with as simple of install as possible and without requiring rebooting the servers. Mostly for DL380 G5's if it helps. Thanks.
2
votes
1answer
2k views

vmware esx 4.1 cant see existing SAN storage

I have 3 esx 4.1 hosts connected to HP EVA 4400 StorageWork. All host can see 6 datastore, LUN1 to LUN6, 1TB for each datastore. Recently I add another esx 4.1 host but unfortunately this now host ...
2
votes
2answers
169 views

lvm over two raid1's - one slow, one fast. What will happen?

Two software RAID1's, 0: 2x 15K SAS drives, 73GB 1: 2x WD Caviar Green, 3TB So the first RAID is a faster one, the second a slower data grave. What happens when I add both to a LVM logical volume ...
0
votes
1answer
821 views

Converter to use Sata HDD with IBM eserver x236

We have an old x236 machine with 2 70-GB SCSI disks installed on Ultra320 SCSI connector (check out the hardware manual). Now, we are planning to buy a new server in future and x326 would act as a ...
1
vote
1answer
463 views

Backup HFS+ filesystem to linux server

I am the sysadmin for a small company with 3 Xserves running OSX 10.6.8 containing mission critical data that need to be backed up in an automated fashion. To accomplish this, we are going to deploy ...
2
votes
2answers
170 views

What do you do when your site scales so much that uploaded_media can't fit on one machine? [closed]

What do you do when your site scales so much that your uploaded_media (in Django, where all uploaded media files from users is stored) can't fit on one machine? My personal case, I'm using Django and ...
2
votes
2answers
169 views

Storing 64000+ files and growing in one folder (ext3)

I'm using a directory as a staging area for my files before shipping them to Amazon S3 buckets. This staging directory has no sub-directory structure /a/b/c or /year/month/day ... it's only files ...
1
vote
1answer
157 views

ZFS: can per-user encrypted filesystems be deduplicated on block-level?

Let's assume I build a storage system where each user gets his/her own encrypted filesystem on top of a ZFS pool. Would deduplication on pool-level still work when each fs is encrypted? What ...
1
vote
2answers
462 views

ZFS: Best-practices doc state: “On systems with 1,000s of ZFS file systems…”?

The docs state: "On systems with 1,000s of ZFS file systems, provision 1 GB of extra memory for every 10,000 mounted file systems including snapshots." What does that mean - how do these people use ...
0
votes
1answer
97 views

Bandwidth efficient software RAID [closed]

I have this crazy idea .. that might just work if I find my missing piece Take network with 40 windows workstations (on 24 hours) Each machine uses 20 GB out of 500 GB capacity Install free copy of ...
135
votes
2answers
25k views

What are the different widely used RAID levels and when should I consider them?

This is a Canonical Question about RAID levels. What are: the RAID levels typically used (including the RAID-Z family)? deployments are they commonly found in? benefits and pitfalls of each? ...
0
votes
1answer
80 views

Raid group on a p2000g3 iscsi

I have to set up an hypervR2 cluster (2nodes) and a san storage (hp p2000g3 iscsi) with 12 disks (300 GO, 10k SAS) The p2000 has 2 controllers. What is the best ? ONe big raid group (raid10) with the ...
1
vote
0answers
149 views

Virtual linux drive on a NAS - recommendations

I have a Linux server currently running under a Microsoft Virtual Machine. I have it set up so that the storage drive is set up as a secondary virtual disk. I need to move this machine to a new box ...
0
votes
5answers
165 views

Desktop HDD in a server? [duplicate]

Possible Duplicate: What are the merits of SAS vs SATA drives? Would it be OK to use a SATA 6Gb/s desktop drive in a server? Say for example a 4 Seagate ST31000524AS drives in a raid 10 ...
2
votes
3answers
309 views

Best way to attach 96 tb to workstation

I'm running a workstation with dual xeon 5690's (12 physical/24 logical cores), 192 gb of ram (ie, maxed-out), Windows 7 64bit, 5 slots for adapter cards, and 1 tb of internal storage, with 5 more ...
1
vote
1answer
314 views

How to diagnose storage system scaling problems?

We are currently testing the maximum sequential read throughput of a storage system (48 disks total behind two HP P2000 arrays) connected to HP DL580 G7 running RHEL 5 with 128 GB of memory. Initial ...
4
votes
6answers
8k views

MegaRAID JBOD substitute

It seems that certain MegaRAID chips don't support JBOD (unfortunately). I've read online that to make these controllers act as a pass-through, I should configure the disks in RAID0. What RAID0 ...
-1
votes
2answers
569 views

How do the file sharing websites store such huge amounts of data? [closed]

I'm referring to file sharing websites like megaupload.com, rapidshare.com and the software download websites like download.com, filehippo.com. They need to store tons of terabytes of data and they ...
1
vote
4answers
9k views

How to implement cheap LFF 3.5“ SATA storage on a HP ProLiant ML350 G6 with 2.5” SFF SAS

In a series of bad, hasty decisions, a HP ProLiant ML350 G6 server was bought for file server use at my place of work. The intention was to build a FreeNAS 8 server using cheap 3.5" SATA drives. Only ...
-2
votes
3answers
82 views

Data storage solutions for rapidly running out of space [closed]

I have 2 web servers (1 live and other backup), the issue I have is our storage is rapidly running out. All the data on the server is used by our customers and new documents are uploaded to the ...
0
votes
1answer
345 views

Redundancy on the Freenas install itself?

I'm wondering what kind of redundancy I can put in place for the Freenas install itself. If the drive that Freenas is installed on fails, does that mean all my raid volumes are gone since its all ...
19
votes
5answers
2k views

Extremely fast booting server

I'm changing the way that our DHCP/DNS stuff works at work. Currently we've got 3 DNS servers, and a DHCP box. All of them are VMs. There's a circular dependency where stuff booting requires NFS, ...
2
votes
4answers
568 views

Drobo Thin Provisioning: What happens when you run out of space?

I'm thinking about getting a Drobo S to add some storage on a Windows Server 2008 R2 box. The Drobo offers thin provisioning. While I will only have 4.5TB of space initially, I'd like to use thin ...
9
votes
4answers
2k views

Advantages of thick provisioning of storage over thin provisioning with virtual machines

I typically use thin-provisioning of storage space when building VMs: it provides a lot of flexibility, and seems to be faster to build. The only potential definite advantage I can see is to ensure ...
3
votes
1answer
424 views

iSCSI volume for hyper-v

I am moving several hyper-v VMs from an under-powered host to a newer host with an iSCSI array for storage. What is the best configuration for the iSCSI volume to get the best performance for hyper-v? ...
2
votes
4answers
2k views

Store and backup 200 million small files

My disk are 10x1TB SAS 7200 RPM in a RAID 10 with a MegaRaid 9260 hardware controller with cache/BBU. This results in a 4.6TB RAID 10 volume. hdparm -t (when device is empty) results in 500MB/s. RAID ...
3
votes
4answers
9k views

Set up simple Infiniband Block Storage (SRP or iSER)

I'm trying to figure out how to set up a simple storage system which exports block storage over Infiniband, using either SRP or iSER. I'm very early in the process, and at the moment I'm basically ...
1
vote
2answers
613 views

Can we “add” more SAS ports to an existing backplane?

We have a 3U Supermicro chassis with 16 bays on a SAS expander backplane. We have 15 of the bays occupied with hard drives at the moment. We would like to add two more drives to the backplane, but we ...
2
votes
2answers
52 views

Tool for managing archive drive and working drive

I have been tasked with administering a process here at work that is a little out of my league. We currently have access to two network drives, the S drive and the V drive. S drive is 18.1 ...
5
votes
3answers
1k views

What to use for software-based shared file storage?

The situation: setting up a load balancer Currently we have all of our servers (running CentOS Linux) in pairs in our data center: each server has a mirroring server. We don't employ any load ...
2
votes
1answer
123 views

Better folder structure for 1-6mil files?

I'm doing a bit of development work for a start up, and have been asked to work on the directory structure for all the content being served and the scalability of the host servers(load balancing, ...
0
votes
1answer
423 views

WordPress MU with multiple Servers; wordpress won't show media-files; Syncing things

yesterday I have seted up a wordpress "clutser". Two Front/Backend Servers for Nginx and PHP One Database Server on all there is installed memcached I have a internal network, so no authenticate ...
1
vote
2answers
102 views

Storage for a small XenDesktop deployment

We are currently looking for a server-side virtualization solution for our developer desktop-systems. We so far chose XenDesktop since we are already running Xen for virtualized servers. This is a ...
1
vote
2answers
442 views

Do I need to have 2 RAID arrays to utilize both controllers in Equallogic unit?

I'm trying to figure out how EQL works with multiple controllers. Dell sales people recommended having one RAID array on one EQL unit. But will this set up allow utilizing both controllers? Or will ...