Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I have few sample databases but they are quite small in size. I want to create a database with records upto 50GB. I want to learn many aspects of the database and also want to test our application's performance against it.

How to gather random data?

share|improve this question

3 Answers 3

up vote 1 down vote accepted

A number of sources on the internet allow you to download their content, and it often reaches into the 10's or 100's of GB. Two that I can think of off the top of my head are:

Though these dumps are in XML, it's easily imported into an empty database by any modern RDBMS. A number of other sites have dumps as well, especially wiki-ish sites (like both of these examples).

share|improve this answer

Just script a lot of appropriate inserts with randomised data.

I can't be any more specific as you tell us nothing about your database.

share|improve this answer
1  
What else you want to know? –  RPK Nov 3 '10 at 19:28
1  
How about the database you're using! –  Chopper3 Nov 3 '10 at 19:58

You can use some "Faker" APIs like this one : http://faker.rubyforge.org/

Or if you want real data, you can gather it from internet, some months ago I needed real data for tests, I've made a IRC bot that log all the messages on the Top 10 channels on Freenode and let it run 24h24 for many weeks, that gave me lot of data (~1 million rows) :)

share|improve this answer

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.