Questions tagged [storage]

Primarily questions about disk storage, sometimes questions about application storage or cloud storage. Always questions about storing data.

Filter by
Sorted by
Tagged with
0 votes
1 answer
53 views

Media Being Hosted In SVN For Web Application [closed]

I have a client who decided to use SVN to host the media files and pulled by a web application for viewing. What are the consequences of this, and wouldn't a better option be to use a NAS or CDN?
Mike Flynn's user avatar
2 votes
3 answers
3k views

What's the relation between "HP Diagnostics" the "Array Config Utility" and "Windows Disk Manager"

I have a failed drive that is reported in HP Diagnostics https://localhost:2381/hpdiags/frontend2/frontend.php? It tells me that Logical Drive 5 has a drive that is about to fail. The name of ...
makerofthings7's user avatar
1 vote
1 answer
429 views

VirtualBox Fedora Host Windows Guest Networking and Folder Aliases

I'm new to running virtual machines and I have a couple questions. I have a Fedora 14 box with an 8 core Bulldozer processor that is running VirtualBox with Windows. This machine has several ...
grandcameo's user avatar
1 vote
1 answer
1k views

SAN Boot CHAP'd iSCSI Target?

I have a few computers on my network that boot via iSCSI (due to dead HDDs) using chainloaded iPXE over DHCP. I wanted to enable CHAP for my iSCSI target to increase security (and learn). However, ...
Soviero's user avatar
  • 4,376
10 votes
1 answer
2k views

2.5 inch drives versus 3.5 inch drives

I am looking for some publicly available comparisons between 2.5 inch drives and 3.5 inch drives. What I had assumed is that a 2.5 inch 15k drive and a 3.5 inch 15k drive would have identical ...
Basil's user avatar
  • 8,881
1 vote
1 answer
1k views

RAID5 Array issues - copy data or replace drive first

I have inherited a critical situation as follows. 2 x 16-Disk RAID5 Storage systems (one holding master data, one holding backups) Backup system had no monitoring and two disks failed so all data is ...
Phil's user avatar
  • 3,198
2 votes
2 answers
286 views

LTO-4 Tape Physical Storage [closed]

We have moved to an LTO-4 tape backup system. It works great and now we have a stack of physical tapes lying around that need to be stored and ultimately secured. I was curious what options exist ...
John's user avatar
  • 2,276
3 votes
1 answer
7k views

Is Microsoft's "Storage Spaces" just LVM for Windows? [closed]

From initial reading, it looks like Microsoft's forthcoming "Storage Spaces" is an LVM-like tool for Windows. Is this a correct assessment? If it's not merely LVM-for-Windows, then what is it, and ...
warren's user avatar
  • 18.7k
1 vote
2 answers
1k views

Adding nearline SAS disks to a controller with SAS disks

I have a Dell Poweredge 840 server that currently has a pair of hot swappable 146Gb SAS disks attached to a SAS 5IR controller, configured as RAID 1. I have two spare slots to add two add more ...
Bryan's user avatar
  • 7,658
1 vote
1 answer
645 views

How to connect drive array to redundant motherboards?

How should one connect a small storage array, four 3TB SATA drives for now, to two motherboards or controllers as a failover system? This means avoiding adding another single point of failure such as ...
tyblu's user avatar
  • 113
3 votes
1 answer
689 views

Installed 2TB disk in ubuntu server, dmesg reports it as 9444732965540666 MB

I've have an ageing Linux server running on Dell PowerEdge hardware, with a SAS 5IR RAID controller. It has a pair of SAS 146Gb disks in a RAID 1 configuration that has the OS and other software. I ...
Bryan's user avatar
  • 7,658
53 votes
6 answers
67k views

How to move files between two S3 buckets with minimum cost?

I have millions of files in a Amazon S3 bucket and I'd like to move these files to other buckets and folders with minimum cost or no cost if possible. All buckets are in the same zone. How could I ...
Daniel Cukier's user avatar
1 vote
1 answer
137 views

250 users with a data dir on a central server - how would you set it up?

I'd like to get best-practice advice on how to setup a scheme where 250 users or more have OS independent access to their own data-dir / user-dir on a central server in the local network. from the ...
isync's user avatar
  • 701
7 votes
5 answers
8k views

SAS Expanders for DIY JBOD Arrays

I am researching making a DIY SAS array much like the Dell MD1000. My understanding is that these devices do not contain a RAID controller, instead they present all the drives on in SAS domain to the ...
Jacob Groundwater's user avatar
8 votes
2 answers
1k views

Are branded backplanes useable without specific controllers?

I can't find a disk enclosure which I like, so I'm going to build a custom one (if nothing else, that'll teach me to be picky...). I've got a few HP SAS backplanes lying about, but I'm wondering if ...
carlpett's user avatar
  • 956
2 votes
3 answers
740 views

Does NetApp providing tooling to export a WAFL export snapshots to a file?

With the open source ZFS file systm, an exact copy/snapshot can be produced using zfs snapshot. This includes file-system level optimizations like deduplication. Further you can send these to a remote ...
Sandra's user avatar
  • 10.5k
0 votes
2 answers
887 views

How to backup NetApp storage on Linux? [closed]

Our NetVault license is about to expire within the next year, so what alternatives are there on Linux? We have 20TB and many millions of files, so time on the backup window is important. The backup ...
Sandra's user avatar
  • 10.5k
0 votes
2 answers
192 views

parted subtracting partition size 16896 from size given

When I create a partition using parted(mkpart) giving unit as Bytes, it is creating "size given - 16896" byte sized partition. Is there any specific reason to less 16896 bytes from the partition size(...
kumar's user avatar
  • 443
10 votes
6 answers
53k views

VMware VMFS5 and LUN sizing - multiple smaller datastores, or 1 big datastore?

With VMFS5 no longer having the 2TB limit for a VMFS volume, I'm considering which scenario would be more beneficial overall:- Less LUNs of larger size, or More LUNs of smaller size. In my case, I ...
ThatGraemeGuy's user avatar
1 vote
4 answers
194 views

Calculating risk vs cost for server storage

This is a request for 2 different types of information: Is there a formula that can/should be followed to calculate risk vs cost of server storage? What factors should one take into consideration ...
Anthony Miller's user avatar
0 votes
3 answers
14k views

Maximum Size Limit for CIFS Share Accessed by Windows Server 2003 (32 bit) Client?

We have a CIFS share being served out by a NETAPP appliance. The CIFS share has grown to over 2 TB in size. A Windows Server 2003 32 bit-client accesses the share. Lets say, for example, the ...
user104997's user avatar
1 vote
1 answer
883 views

MySQL Cluster on SSD

We are planning to implement a four node MySQL Cluster and are considering using SSDs as the storage. We would like to get a high level of performance and very low latency on disk IO from the small ...
somecallmemike's user avatar
11 votes
4 answers
48k views

How do I get my HP servers to email me when a drive fails?

Ideally, with as simple of install as possible and without requiring rebooting the servers. Mostly for DL380 G5's if it helps.
DrZaiusApeLord's user avatar
2 votes
1 answer
2k views

vmware esx 4.1 cant see existing SAN storage

I have 3 esx 4.1 hosts connected to HP EVA 4400 StorageWork. All host can see 6 datastore, LUN1 to LUN6, 1TB for each datastore. Recently I add another esx 4.1 host but unfortunately this now host ...
Syairus's user avatar
  • 23
2 votes
2 answers
550 views

lvm over two raid1's - one slow, one fast. What will happen?

Two software RAID1's, 0: 2x 15K SAS drives, 73GB 1: 2x WD Caviar Green, 3TB So the first RAID is a faster one, the second a slower data grave. What happens when I add both to a LVM logical volume ...
isync's user avatar
  • 701
0 votes
1 answer
1k views

Converter to use Sata HDD with IBM eserver x236

We have an old x236 machine with 2 70-GB SCSI disks installed on Ultra320 SCSI connector (check out the hardware manual). Now, we are planning to buy a new server in future and x326 would act as a ...
vulcan raven's user avatar
1 vote
1 answer
751 views

Backup HFS+ filesystem to linux server

I am the sysadmin for a small company with 3 Xserves running OSX 10.6.8 containing mission critical data that need to be backed up in an automated fashion. To accomplish this, we are going to deploy ...
lowkeyliesmyth's user avatar
2 votes
2 answers
197 views

What do you do when your site scales so much that uploaded_media can't fit on one machine? [closed]

What do you do when your site scales so much that your uploaded_media (in Django, where all uploaded media files from users is stored) can't fit on one machine? My personal case, I'm using Django and ...
MikeN's user avatar
  • 8,502
2 votes
2 answers
233 views

Storing 64000+ files and growing in one folder (ext3)

I'm using a directory as a staging area for my files before shipping them to Amazon S3 buckets. This staging directory has no sub-directory structure /a/b/c or /year/month/day ... it's only files /cdn/...
Haytham Elkhoja's user avatar
1 vote
1 answer
238 views

ZFS: can per-user encrypted filesystems be deduplicated on block-level?

Let's assume I build a storage system where each user gets his/her own encrypted filesystem on top of a ZFS pool. Would deduplication on pool-level still work when each fs is encrypted? What ...
isync's user avatar
  • 701
1 vote
2 answers
670 views

ZFS: Best-practices doc state: "On systems with 1,000s of ZFS file systems..."?

The docs state: "On systems with 1,000s of ZFS file systems, provision 1 GB of extra memory for every 10,000 mounted file systems including snapshots." What does that mean - how do these people use ...
isync's user avatar
  • 701
0 votes
1 answer
105 views

Bandwidth efficient software RAID [closed]

I have this crazy idea .. that might just work if I find my missing piece Take network with 40 windows workstations (on 24 hours) Each machine uses 20 GB out of 500 GB capacity Install free copy of ...
Tomas's user avatar
  • 39
190 votes
2 answers
48k views

What are the different widely used RAID levels and when should I consider them?

This is a Canonical Question about RAID levels. What are: the RAID levels typically used (including the RAID-Z family)? deployments are they commonly found in? benefits and pitfalls of each?
MDMarra's user avatar
  • 101k
0 votes
1 answer
88 views

Raid group on a p2000g3 iscsi

I have to set up an hypervR2 cluster (2nodes) and a san storage (hp p2000g3 iscsi) with 12 disks (300 GO, 10k SAS) The p2000 has 2 controllers. What is the best ? ONe big raid group (raid10) with the ...
despe94's user avatar
1 vote
0 answers
209 views

Virtual linux drive on a NAS - recommendations

I have a Linux server currently running under a Microsoft Virtual Machine. I have it set up so that the storage drive is set up as a secondary virtual disk. I need to move this machine to a new box ...
Larry G. Wapnitsky's user avatar
0 votes
5 answers
343 views

Desktop HDD in a server? [duplicate]

Possible Duplicate: What are the merits of SAS vs SATA drives? Would it be OK to use a SATA 6Gb/s desktop drive in a server? Say for example a 4 Seagate ST31000524AS drives in a raid 10 array. I ...
cmaduro's user avatar
  • 239
2 votes
3 answers
352 views

Best way to attach 96 tb to workstation

I'm running a workstation with dual xeon 5690's (12 physical/24 logical cores), 192 gb of ram (ie, maxed-out), Windows 7 64bit, 5 slots for adapter cards, and 1 tb of internal storage, with 5 more ...
PaeneInsula's user avatar
1 vote
1 answer
342 views

How to diagnose storage system scaling problems?

We are currently testing the maximum sequential read throughput of a storage system (48 disks total behind two HP P2000 arrays) connected to HP DL580 G7 running RHEL 5 with 128 GB of memory. Initial ...
Unknown's user avatar
  • 11
8 votes
6 answers
23k views

MegaRAID JBOD substitute

It seems that certain MegaRAID chips don't support JBOD (unfortunately). I've read online that to make these controllers act as a pass-through, I should configure the disks in RAID0. What RAID0 ...
cedivad's user avatar
  • 690
-1 votes
2 answers
1k views

How do the file sharing websites store such huge amounts of data? [closed]

I'm referring to file sharing websites like megaupload.com, rapidshare.com and the software download websites like download.com, filehippo.com. They need to store tons of terabytes of data and they ...
claws's user avatar
  • 232
3 votes
5 answers
23k views

How to implement cheap LFF 3.5" SATA storage on a HP ProLiant ML350 G6 with 2.5" SFF SAS

In a series of bad, hasty decisions, a HP ProLiant ML350 G6 server was bought for file server use at my place of work. The intention was to build a FreeNAS 8 server using cheap 3.5" SATA drives. Only ...
nybergh's user avatar
  • 194
-2 votes
3 answers
96 views

Data storage solutions for rapidly running out of space [closed]

I have 2 web servers (1 live and other backup), the issue I have is our storage is rapidly running out. All the data on the server is used by our customers and new documents are uploaded to the ...
Grimlockz's user avatar
  • 325
0 votes
1 answer
446 views

Redundancy on the Freenas install itself?

I'm wondering what kind of redundancy I can put in place for the Freenas install itself. If the drive that Freenas is installed on fails, does that mean all my raid volumes are gone since its all ...
AdamB's user avatar
  • 189
19 votes
5 answers
2k views

Extremely fast booting server

I'm changing the way that our DHCP/DNS stuff works at work. Currently we've got 3 DNS servers, and a DHCP box. All of them are VMs. There's a circular dependency where stuff booting requires NFS, ...
Tom O'Connor's user avatar
  • 27.6k
2 votes
4 answers
971 views

Drobo Thin Provisioning: What happens when you run out of space?

I'm thinking about getting a Drobo S to add some storage on a Windows Server 2008 R2 box. The Drobo offers thin provisioning. While I will only have 4.5TB of space initially, I'd like to use thin ...
Brad's user avatar
  • 1,427
9 votes
4 answers
4k views

Advantages of thick provisioning of storage over thin provisioning with virtual machines

I typically use thin-provisioning of storage space when building VMs: it provides a lot of flexibility, and seems to be faster to build. The only potential definite advantage I can see is to ensure ...
warren's user avatar
  • 18.7k
4 votes
1 answer
601 views

iSCSI volume for hyper-v

I am moving several hyper-v VMs from an under-powered host to a newer host with an iSCSI array for storage. What is the best configuration for the iSCSI volume to get the best performance for hyper-v? ...
Top__Hat's user avatar
  • 962
2 votes
4 answers
3k views

Store and backup 200 million small files

My disk are 10x1TB SAS 7200 RPM in a RAID 10 with a MegaRaid 9260 hardware controller with cache/BBU. This results in a 4.6TB RAID 10 volume. hdparm -t (when device is empty) results in 500MB/s. RAID ...
cedivad's user avatar
  • 690
4 votes
4 answers
13k views

Set up simple Infiniband Block Storage (SRP or iSER)

I'm trying to figure out how to set up a simple storage system which exports block storage over Infiniband, using either SRP or iSER. I'm very early in the process, and at the moment I'm basically ...
ajdecon's user avatar
  • 1,301
1 vote
2 answers
1k views

Can we "add" more SAS ports to an existing backplane?

We have a 3U Supermicro chassis with 16 bays on a SAS expander backplane. We have 15 of the bays occupied with hard drives at the moment. We would like to add two more drives to the backplane, but we ...
zippy's user avatar
  • 1,718

1
26 27
28
29 30
40