System that handles large amounts of data in an organised fashion
9
votes
1answer
751 views
How do you do Load Testing and Capacity Planning for Databases
This is a Canonical Question about Capacity Planning for Databases.
Related:
Can you help me with my capacity planning?
How do you do Load Testing and Capacity Planning for Web ...
0
votes
1answer
649 views
How do I set my.cnf in Mysql so that there are no limits to connections?
Unlimited connections, how do I edit that setting?
28
votes
7answers
21k views
What is the best Linux filesystem for MySQL (InnoDB)?
I tried to look for benchmark on the performances of various filesystems with MySQL InnoDB but couldn't find any.
My database workload is the typical web-based OLTP, about 90% read, 10% write. Random ...
7
votes
9answers
1k views
How do you usually back up your database?
I am using mysql
How often do you back up your database?
How do you normally backup your database?
Export all data into sql or cvs format and keep it in a folder??
9
votes
4answers
1k views
Should I backup and restore the `mysql` database?
In the process of creating an automated solution for backing up and restoring an entire MySQL server, I've come across the mysql database which seems to contain user accounts, permissions, metadata, ...
20
votes
4answers
1k views
Can MySQL effectively take advantage of 64 GB RAM?
We have been running into a problem where querying a table that has approximately 50 million rows, and has an index size of 4 GB (table size of about 6 GB) results in the database server swapping ...
4
votes
12answers
12k views
SQL Server database on an external hard disk drive
Due to some security problems, My boss has asked me to store all sensitive data in external/removable storages like USB stick or external HDD and this specially includes the MDF/NDF/LDF files of SQL ...
1
vote
6answers
1k views
MySQL replication out of sync
I have a master-master replication system.
However, due to an auto-increment issue, I got an error in replication...and it stopped replicating.
Someone told me to do:
stop slave; SET GLOBAL ...
0
votes
6answers
219 views
backing up large database with large amount of data in a small time limit then restoring it within a small time of limit?
Backing up large database with large amount of data in a small time limit then restoring it within a small time of limit?
Any useful ideas?
2
votes
1answer
103 views
Microsoft SQL alternative for Oracle's Imp and Exp command
I'm looking a command line tool or SQL command to export/import a table or complete database. Much like the imp and exp commands of Oracle databases.
Any suggestions?
1
vote
2answers
204 views
Database Connection Error
Recently this has been happening every so often...say once a day for about 10 minutes. All the pages on my website load up as a blank page with big text DATABASE CONNECTION ERROR.
I try to login to ...
1
vote
1answer
981 views
Deleting huge chunks of data from mysql innodb
I need to delete a huge chunk of my data in my production database, which runs about 100GB in size. If possible, i would like to minimize my downtime.
My selection criteria for deleting is likely to ...
0
votes
1answer
93 views
Binding MySQL to run from the public or private LAN IP address - which one is faster
So we have 2 servers all running at the same web host. We have bind MySQL to listen on the public ip-address of the database server and the web server connects to it from the public ip. Both servers ...
0
votes
2answers
324 views
Windows Server 2008 Web vs Standard
Please tell me what choice will be best between Windows Server 2008 R2 Web edition and Windows Server 2008 R2 Standard edition for NoSQLDatabase/BackendComputing scaling farm? I am pretty sure that ...
0
votes
4answers
56 views
back-up database in Linux partition from windows partition!
Hello I am in a very embarrassing situation, I was trying to upgrade to ubuntu 10.04 from ubuntu 9.10 yesterday and while updating I forgot to put my laptop on charger and the battery ran out. Since ...
0
votes
2answers
399 views
How do I sync a subset of tables between two databases on the same mysql database server
would like to be able to sync a subset of tables between two mysql databases that are running on the same server. One of the databases acts as the master where inserts, updates and deletes can be ...
24
votes
7answers
8k views
Is it safe to have SQL Server auto-shrink turned on?
There are many SQL Server options that can be enabled for databases, and one of the most misunderstood ones is auto-shrink. Is it safe? If not, why not?
4
votes
8answers
2k views
MS SQL Layout for best performance
We have purchased a new server to act as a MS SQL backend. I am curious to know what the best setup would be for it.
The server is a Dell R710 it has 6 hard drives 2x 74GB 15k and 4x 146GB 15k
...
3
votes
3answers
5k views
How does one list warnings from the 'mysqlimport' utility?
To start off, this is not about loading data from within mysql itself, but using the command-line tool "mysqlimport".
I am using it to load a CSV directly into a table and need to see the warnings ...
5
votes
5answers
1k views
Best way to make sure a MySQL database is fully in UTF8
After some problems with UTF8 and none-UTF8 strings, we're standardising on UTF8. One thing I need to do is check that everything is in UTF8 in the MySQL database? What do I need to check?
Server ...
1
vote
2answers
1k views
Debugging mysql too many connections problem
I get a "too many connections" error from time to time with my mysql database, if I do a
show status like 'Conn%';
I get a result like this
+---------------+-------+
| Variable_name | Value |
...
22
votes
6answers
2k views
Scaling databases with cheap SSD hard drives
I hope that many of you are working with high traffic database-driven websites, and chances are that your main scalability issues are in the database. I noticed a couple of things lately:
Most large ...
4
votes
7answers
1k views
MySQL database backup over network
Server #1 is a MySQL database server running on Debian which contains numerous tables and one particular table that is over 100GB.
Server #2 is used as a MySQL slave for replication, but now it needs ...
3
votes
5answers
957 views
mysqldump for sql server
I have used mysqldump on a mysql database lots of times and am familiar with how it works. Does anyone know if there is a similar tool that could be used on a sql server database.
I know sql server ...
2
votes
4answers
6k views
How to copy & move MySQL database
I'm very new to servers and databases, my experience spanning only a few installations of XAMPP for easy website testing and exploration. So I have XAMPP installed on my laptop, and I just put it on ...
1
vote
5answers
14k views
How can I synchronize MS SQL Server databases?
How can I synchronize MS SQL Server databases? Is there any tool, preferably open source?
6
votes
5answers
469 views
Virtualizing Microsoft SQL Database server
My company is looking to virtualize our Microsoft SQL server. I read on another question that databases on VM's suffer from a IO bottleneck which is not very good for us. But I was wondering if ...
6
votes
2answers
1k views
Is there a secure way to allow IIS 7 in a DMZ to access a DB server behind the firewall?
Our network admins are adamant that it is insecure for our web servers, which are hosted in the DMZ, to access the DB server behind our firewall. To get round the problem, we access the data via web ...
5
votes
1answer
660 views
Does anyone have any experience when it comes to speed of Amazon RDS vs MySQL on a Small server?
EC2 Small vs Amazon RDS - which is faster for MySQL?
(I have one database, well-indexed and tuned. About 10,000 rows on each table.)
How's the performance like?
5
votes
4answers
4k views
MySQL, disk I/O and SSD drives
We have a LAMP box with 2x mirrored 1 TB WD Black Caviar disks running the whole OS and MySQL. 8 GB / RAM, 2x quad core CPUs.
We're really taxed on disk I/O, and I've been thinking of ...
3
votes
5answers
640 views
Alternative to multiple WordPress installs (and not using WordPress-mu)
I run several instances of WordPress on a server for managing blogs across multiple domains (also hosted on the same server). Some domains are even utilizing multiple WordPress instances just as ...
3
votes
7answers
1k views
soft/fake raid in linux
original
I don't have much experience with Linux, but this is a good oportunity to learn
I'm mounting a simple database server and i would like to know if ubuntu server 9.10 (what do you guys ...
3
votes
5answers
925 views
What is “The” book for database design? [closed]
In programming, there is often a canonical book for a particular topic, like the dragon book for compilers, K&R for C, etc.
Is their a book regarding modern database design that simply must be ...
2
votes
3answers
908 views
Amazon EC2 + EBS:: Regular backup plan?
I have read some articles about amazon ec2 instances and ebs. I found out that, the data on the instance are not persistent, which means, if the hardware fails, instance shut down, I will lost my ...
2
votes
1answer
180 views
What database is easy to maintain and manage in a cluster?
I'm looking for a database (DBMS) that is easy to scale out. I would like to have high availability so I need a multi-master cluster, where the data is replicated to two or more physical computers. I ...
1
vote
2answers
129 views
MySQL Table not repairing
Table info:
Database name: user_motiva
Table name: wp_options.frm wp_options.MYD wp_options.MYI wp_options.TMD
when I do a mysqlcheck -r --all-databases it gets hung on that table even if you ...
0
votes
1answer
334 views
MySQL keeps restarting due to running out of memory
how can we prevent this from happening? it generally causes down time of about 30 minutes, which is extremely disruptive for service...
0
votes
1answer
6k views
How do I uninstall MySQL completely?
remove ALL settings.
remove ALL databases.
remove ALL replication settings.
WHat command do I run to remove that?
5
votes
3answers
4k views
Dell SSD options and 3rd party SSDs in Dell hardware
Anyone have any experience with Dell's SSDs?
We're looking at using them for a machine running a key value database like Tokyo Tyrant.
They're expensive as well as being pretty small. Only 25/50GB ...
3
votes
2answers
251 views
Good Books About Scaling Up Databases/Servers/etc.? [closed]
I've applied for an internship at a startup company that expects its user base to grow by a large factor in a small amount of time, and so part of their project is to scale everything up so that ...
3
votes
2answers
937 views
repair suspect database
My sql server 2008 told me that you database is suspect and I can't see my tables or my data or use it what should I do ?
2
votes
2answers
173 views
Two mirrored database servers, or one twice as powerful
I'm looking at setting up a seperate database server for one of my applications, the application currently runs on 3 servers; 1 frontend server and 2 application/database servers. But for performance ...
2
votes
2answers
439 views
View last queries in MySQL
How can I see the last queries for a MySQL DB?
I am a DB administrator. For example, when an application queries the DB, how they can be viewed?
2
votes
4answers
333 views
Standard database backup procedures
I've been looking at the setup we've implemented for a hosted client, who has a database backed up several times per day (and the last week of backups always available). Say the backups require 20gb, ...
1
vote
2answers
228 views
What is the standard system architecture for MongoDB
I know this question is too vague, so I would like to add some key numbers to give insights about what the scenario is
Each Document size - 360KB
Total Documents - 1.5 million
Document created/day ...
1
vote
3answers
37 views
database replication for new user signup
I have a database that stores the users of my application. When a new user signs up, a record is inserted into the database for that user. I have a replicated version (slave) of this database (using ...
1
vote
1answer
279 views
Allow Remote Connections to MySql Database
I have looked at this Post and it details how you can allow a connection from a remote host to the database. But the line that took me off guard was this:
mysql> GRANT ALL PRIVILEGES ON *.* TO ...
1
vote
1answer
142 views
moving data from one MYSQL db to another
I have three relational tables with data in MYSQL db1, and the same schemas with data in MYSQL db2, I need to combine the data into MYSQL db2. what's the right way to do it? should I dump the db1 ...
1
vote
3answers
426 views
Sql Server management studio 2005 cant connect to localhost using windows authentication
I am trying to localhost using windows authentication with SQL Server management studio and I am getting a message that "Login failed for user..." (Error 18456).
I made sure that all the services are ...
1
vote
3answers
241 views
Database hardware advice
As a lone developer in my company I'm missing someone to bounce ideas off with. I've been given the task of gathering some hardware requirements for our server so we can make some internal websites ...
