I'm working on a little research project, currently running as an instance on ec2, and I'm hoping to figure out whether I'm going down the right path. We, like a thousand other people, are making use of some of twitters streaming feeds to do gather some data to have fun with and my db seems to be having problems keeping up, and queries take what seems to be a very long time. I'm not a DBA by trade, so I'll just dump some info here and add more if need be.
ec2 xl, 15 gigs of ram
ebs: 4 100 gb drives, raid 0.
The stream we're getting we're looking at around 10k inserts per minute.
3 main tables, with the users we're tracking somewhere in the neighborhood of 26M rows currently.
Is this amount of inserts on this hardware too much to ask out of ebs? Should take a look at some things with less overhead like mongodb?