Tagged Questions

The tag has no wiki summary.

learn more… | top users | synonyms

0
votes
1answer
20 views

mysqld : multiple tmpdir & balancing

Our 1Tb tempdir can sometimes be completely used by mysqld, resulting in disk-full and query errors. This can be due to lots of mid-size queries, or couple of very big queries. We have a 5Tb raid ...
0
votes
0answers
72 views

Tips on Copying 3 Database files nearing 250 GB?

We are upgrading from SQL Workgroup 2005 to SQL Standard 2012. We have plenty of databases of smaller sizes that copied over with straight windows file copy in a reasonable time frame. We have one ...
1
vote
1answer
252 views

Offsite backup solutions for 40TB of data/35 Million Files on single drive [closed]

I've got a server with 40TB of data and 35 million files. While the server itself has raid and all that jazz, I'm concerned about what would happen should something physically destroy the server ...
4
votes
2answers
2k views

4TB HGST SATA drive only shows 1.62 TB in Windows Server 2012

I'm using a Supermicro X9SRE-3F motherboard with the latest BIOS and 2x 4TB drives connected to the on-board SATA controller. If I set the BIOS to RAID and create a RAID 1 array, the array shows up ...
4
votes
2answers
287 views

Tomcat Denial of Service due to large packets

I had asked this question on ITSecurity, but I felt this question is better placed here. On a recent assesment, I found that sending large (>5 MB) requests to a tomcat server causes 100% CPU usage on ...
0
votes
2answers
6k views

Increasing the size available to, or changing location of, /tmp

I am currently in charge of a server running Red Hat and a bioinformatics webapp that deals with huge files, some of which are over 100GB when uncompressed. The act of decompressing these files is ...
77
votes
12answers
8k views

Transfer 10TB of files from USA -> UK datacenter

I am migrating my server from the USA to the UK from one data center to another, my host said I should be able to achieve 11 megabytes per second. Operating system is Windows Server 2008 at both ...
6
votes
8answers
2k views

24TB RAID 6 configuration

I am in charge of a new website in a niche industry that stores lots of data (10+ TB per client, growing to 2 or 3 clients soon). We are considering ordering about $5000 worth of 3TB drives (10 in a ...
5
votes
2answers
888 views

Is rsync a good candidate for failover implementation (very large dataset)?

I have a large a set of data (+100 GB) which can be stored into files. Most of the files would be in the 5k-50k range (80%), then 50k - 500k (15%) and >500k (5%). The maximum expected size of a file ...
4
votes
2answers
1k views

Import a 260GB csv file into MySQL

I have a really big csv ~260GB and I want to import it into MySQL. I use the following mysql script in MacOS DROP TABLE IF EXISTS tmp_catpath_5; create table tmp_catpath_5( a1 ...
7
votes
3answers
7k views

How do large companies backup their data?

How do companies who handle large amounts of data, for example Google or Facebook, backup everything? According to this Google platform article on Wikipedia, Google has an estimated 450,000+ servers ...
3
votes
2answers
505 views

Best approach to design this MySQL big database

I'm planing to design a database that contains only 2 tables (stats1 and stats2), but, this tables will contain rows going to 40 000 000 records! all the records will be "positive/unsigned" integers. ...
1
vote
3answers
1k views

Sync Large File Shares

What is the best way to sync large sets of files between to geographically separate locations so that both locations have the same file? We have a constantly changing 500gig file share in Location1 ...
1
vote
6answers
65 views

SQL Server 2000 tables

We currently have an SQL Server 2000 database with one table containing data for multiple users. The data is keyed by memberid which is an integer field. The table has a clustered index on memberid. ...
14
votes
3answers
3k views

In Bash, are wildcard expansions guaranteed to be in order?

Is the expansion of a wildcard in Bash guaranteed to be in alphabetical order? I am forced to split a large file into 10 Mb pieces so that they can be be accepted by my Mercurial repository. So I was ...