0

I have few sample databases but they are quite small in size. I want to create a database with records upto 50GB. I want to learn many aspects of the database and also want to test our application's performance against it.

How to gather random data?

0

3 Answers 3

1

A number of sources on the internet allow you to download their content, and it often reaches into the 10's or 100's of GB. Two that I can think of off the top of my head are:

Though these dumps are in XML, it's easily imported into an empty database by any modern RDBMS. A number of other sites have dumps as well, especially wiki-ish sites (like both of these examples).

2

Just script a lot of appropriate inserts with randomised data.

I can't be any more specific as you tell us nothing about your database.

2
  • 1
    What else you want to know?
    – RPK
    Nov 3, 2010 at 19:28
  • 1
    How about the database you're using!
    – Chopper3
    Nov 3, 2010 at 19:58
1

You can use some "Faker" APIs like this one : http://faker.rubyforge.org/

Or if you want real data, you can gather it from internet, some months ago I needed real data for tests, I've made a IRC bot that log all the messages on the Top 10 channels on Freenode and let it run 24h24 for many weeks, that gave me lot of data (~1 million rows) :)

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .