System that handles large amounts of data in an organised fashion

learn more… | top users | synonyms (2)

28
votes
1answer
5k views

How do you do load testing and capacity planning for databases?

This is a canonical question about capacity planning for databases. Related: Can you help me with my capacity planning? How do you do Load Testing and Capacity Planning for Web Sites? ...
18
votes
3answers
26k views

Third-party SSD solutions in ProLiant Gen8 servers

I was wondering if anyone had any specific experience using Intel DC3700 SSDs (or similar) in the HP (DL380p) Gen8 servers? I'm upgrading a set of database servers that use direct-attached storage. ...
1
vote
1answer
2k views

How do I set my.cnf in Mysql so that there are no limits to connections?

Unlimited connections, how do I edit that setting?
43
votes
7answers
38k views

What is the best Linux filesystem for MySQL (InnoDB)?

I tried to look for benchmark on the performances of various filesystems with MySQL InnoDB but couldn't find any. My database workload is the typical web-based OLTP, about 90% read, 10% write. Random ...
9
votes
1answer
19k views

how to connect to mongodb server via ssh tunnel

It was easy for me to connect to my remote mysql server on AWS using a sequelpro, however I'm struggling with doing the same thing with mongodb. I tried setting up an ssh tunnel via command line ...
8
votes
9answers
3k views

How do you usually back up your database?

I am using mysql How often do you back up your database? How do you normally backup your database? Export all data into sql or cvs format and keep it in a folder??
11
votes
4answers
5k views

Should I backup and restore the `mysql` database?

In the process of creating an automated solution for backing up and restoring an entire MySQL server, I've come across the mysql database which seems to contain user accounts, permissions, metadata, ...
11
votes
3answers
627 views

What types of systems have to “scale up” rather than “scale out”?

I have been wondering for a long time if there are systems that have to "scale up" (onto a more powerful, more expensive server) rather than "scale out" by being split across many smaller servers. ...
7
votes
1answer
5k views

How to disable keys in MySQL InnoDB tables?

Is it possible to disable keys in InnoDB tables? If yes, how? If not, why?
5
votes
12answers
28k views

SQL Server database on an external hard disk drive

Due to some security problems, My boss has asked me to store all sensitive data in external/removable storages like USB stick or external HDD and this specially includes the MDF/NDF/LDF files of SQL ...
2
votes
1answer
238 views

Microsoft SQL alternative for Oracle's Imp and Exp command

I'm looking a command line tool or SQL command to export/import a table or complete database. Much like the imp and exp commands of Oracle databases. Any suggestions?
1
vote
1answer
2k views

Deleting huge chunks of data from mysql innodb

I need to delete a huge chunk of my data in my production database, which runs about 100GB in size. If possible, i would like to minimize my downtime. My selection criteria for deleting is likely to ...
0
votes
2answers
380 views

Windows Server 2008 Web vs Standard

Please tell me what choice will be best between Windows Server 2008 R2 Web edition and Windows Server 2008 R2 Standard edition for NoSQLDatabase/BackendComputing scaling farm? I am pretty sure that ...
0
votes
1answer
363 views

Binding MySQL to run from the public or private LAN IP address - which one is faster

So we have 2 servers all running at the same web host. We have bind MySQL to listen on the public ip-address of the database server and the web server connects to it from the public ip. Both servers ...
39
votes
7answers
32k views

Is it safe to have SQL Server auto-shrink turned on?

There are many SQL Server options that can be enabled for databases, and one of the most misunderstood ones is auto-shrink. Is it safe? If not, why not?
15
votes
2answers
30k views

Best Mysql cache settings for 8gb RAM dedicated mysql server using only Innodb (5gb database)

I'm a pretty big noob when it comes to setting up mysql for performance. And honestly I'm not worried about the fine tuning to squeeze every last bit of performance out of mysql, but I do know that ...
16
votes
3answers
14k views

How does one list warnings from the 'mysqlimport' utility?

To start off, this is not about loading data from within mysql itself, but using the command-line tool "mysqlimport". I am using it to load a CSV directly into a table and need to see the warnings ...
24
votes
6answers
4k views

Scaling databases with cheap SSD hard drives

I hope that many of you are working with high traffic database-driven websites, and chances are that your main scalability issues are in the database. I noticed a couple of things lately: Most large ...
9
votes
3answers
3k views

OpenSSH with public keys from database

Is it possible to fetch the public keys from a database instead of the authorized_keys file? I would like to use such a setup to manage ssh access to things like git repositories for multiple users ...
9
votes
5answers
8k views

Modifying columns of very large mysql tables with little or no downtime

I periodically need to make changes to tables in mysql 5.1, mostly adding columns. Very simple with the alter table command. But my tables have up to 40 million rows now and they are growing fast... ...
4
votes
8answers
3k views

MS SQL Layout for best performance

We have purchased a new server to act as a MS SQL backend. I am curious to know what the best setup would be for it. The server is a Dell R710 it has 6 hard drives 2x 74GB 15k and 4x 146GB 15k ...
6
votes
5answers
3k views

Best way to make sure a MySQL database is fully in UTF8

After some problems with UTF8 and none-UTF8 strings, we're standardising on UTF8. One thing I need to do is check that everything is in UTF8 in the MySQL database? What do I need to check? Server ...
2
votes
2answers
2k views

Debugging mysql too many connections problem

I get a "too many connections" error from time to time with my mysql database, if I do a show status like 'Conn%'; I get a result like this +---------------+-------+ | Variable_name | Value | +----...
7
votes
1answer
1k views

Does anyone have any experience when it comes to speed of Amazon RDS vs MySQL on a Small server?

EC2 Small vs Amazon RDS - which is faster for MySQL? (I have one database, well-indexed and tuned. About 10,000 rows on each table.) How's the performance like?
4
votes
7answers
3k views

MySQL database backup over network

Server #1 is a MySQL database server running on Debian which contains numerous tables and one particular table that is over 100GB. Server #2 is used as a MySQL slave for replication, but now it needs ...
4
votes
5answers
1k views

mysqldump for sql server [closed]

I have used mysqldump on a mysql database lots of times and am familiar with how it works. Does anyone know if there is a similar tool that could be used on a sql server database. I know sql server ...
2
votes
5answers
467 views

Mysql high availability

I have a application that receives data from approximately 1000 different sources every couple of minutes. This data needs to be saved into a OSS database (most likely MySQL - but depending on answers ...
2
votes
4answers
17k views

How to copy & move MySQL database

I'm very new to servers and databases, my experience spanning only a few installations of XAMPP for easy website testing and exploration. So I have XAMPP installed on my laptop, and I just put it on ...
6
votes
5answers
565 views

Virtualizing Microsoft SQL Database server

My company is looking to virtualize our Microsoft SQL server. I read on another question that databases on VM's suffer from a IO bottleneck which is not very good for us. But I was wondering if ...
5
votes
4answers
5k views

MySQL, disk I/O and SSD drives

We have a LAMP box with 2x mirrored 1 TB WD Black Caviar disks running the whole OS and MySQL. 8 GB / RAM, 2x quad core CPUs. We're really taxed on disk I/O, and I've been thinking of ...
3
votes
7answers
1k views

soft/fake raid in linux

original I don't have much experience with Linux, but this is a good oportunity to learn I'm mounting a simple database server and i would like to know if ubuntu server 9.10 (what do you guys ...
3
votes
5answers
683 views

Alternative to multiple WordPress installs (and not using WordPress-mu)

I run several instances of WordPress on a server for managing blogs across multiple domains (also hosted on the same server). Some domains are even utilizing multiple WordPress instances just as ...
2
votes
2answers
7k views

Any way to copy the schema from one MySQL database to another?

I have a MySQL database that contains almost 100 tables. I want to set up N additional MySQL databases on the same server, each running on a different port. And I want each additional database to ...
2
votes
1answer
241 views

What database is easy to maintain and manage in a cluster?

I'm looking for a database (DBMS) that is easy to scale out. I would like to have high availability so I need a multi-master cluster, where the data is replicated to two or more physical computers. I ...
2
votes
3answers
1k views

Amazon EC2 + EBS:: Regular backup plan?

I have read some articles about amazon ec2 instances and ebs. I found out that, the data on the instance are not persistent, which means, if the hardware fails, instance shut down, I will lost my data....
1
vote
2answers
603 views

What is the standard system architecture for MongoDB

I know this question is too vague, so I would like to add some key numbers to give insights about what the scenario is Each Document size - 360KB Total Documents - 1.5 million Document created/day -...
1
vote
1answer
4k views

how to move/configure Mysql Database to another partition?

The current partition of mine mysql databases is full so it denies to start. How can i move databases to another partition without losing anything. Edit: I am on Ubuntu 10 Server. Thanks
1
vote
1answer
4k views

Third-party SSD solutions in ProLiant Gen9 servers

has anyone experience with using consumer SSDs like the Samsung 850 Pro in an HP ProLiant Gen9 server with a Smart Array P440ar controller? Judging by various reports about older versions (Gen6 to ...
0
votes
1answer
8k views

How do I uninstall MySQL completely?

remove ALL settings. remove ALL databases. remove ALL replication settings. WHat command do I run to remove that?
0
votes
1answer
948 views

MySQL keeps restarting due to running out of memory

how can we prevent this from happening? it generally causes down time of about 30 minutes, which is extremely disruptive for service...
8
votes
1answer
168 views

Can I specify where my database files are stored *per database* in MySQL?

Is it possible to have two databases hosted on a single MySQL instance, but have the files stored in two different physical locations? For example: db1 stored in: C:/ProgramData/MySQL/MySQL Server ...
5
votes
3answers
5k views

Dell SSD options and 3rd party SSDs in Dell hardware

Anyone have any experience with Dell's SSDs? We're looking at using them for a machine running a key value database like Tokyo Tyrant. They're expensive as well as being pretty small. Only 25/50GB ...
3
votes
2answers
1k views

repair suspect database

My sql server 2008 told me that you database is suspect and I can't see my tables or my data or use it what should I do ?
3
votes
2answers
483 views

Good Books About Scaling Up Databases/Servers/etc.? [closed]

I've applied for an internship at a startup company that expects its user base to grow by a large factor in a small amount of time, and so part of their project is to scale everything up so that they'...
2
votes
2answers
221 views

Two mirrored database servers, or one twice as powerful

I'm looking at setting up a seperate database server for one of my applications, the application currently runs on 3 servers; 1 frontend server and 2 application/database servers. But for performance ...
2
votes
4answers
383 views

Standard database backup procedures

I've been looking at the setup we've implemented for a hosted client, who has a database backed up several times per day (and the last week of backups always available). Say the backups require 20gb, ...
1
vote
1answer
367 views

Allow Remote Connections to MySql Database

I have looked at this Post and it details how you can allow a connection from a remote host to the database. But the line that took me off guard was this: mysql> GRANT ALL PRIVILEGES ON *.* TO ...
1
vote
3answers
3k views

How do you clone an oracle instance?

How do you clone an oracle instance? Basically, I want to end up copying it from d:\oracle\oldname to d:\oracle\newname. I'm working with Oracle 10.2.
1
vote
2answers
3k views

How to “align” a Linux file system with a SSD?

I'm interested in getting a dedicated server with a SSD, probably Corsair Force series CSSD-F120GB2-BRKT. It'll be an Linux server, most likely running XFS (but I'm open to other alternatives). ...
1
vote
1answer
3k views

Why can't I connect to my PostgreSQL database?

I'm trying to install tentd-admin. The install fails during this step: $ DATABASE_URL=postgres://localhost/tent_server bundle exec rake db:migrate I also tried this: $ DATABASE_URL=postgres://...