236 reputation
111
bio website
location Plano, TX
age 32
visits member for 2 years, 7 months
seen Nov 4 '13 at 6:50

I thought I was wrong once, but I was mistaken.


Mar
23
comment How to make a huge ram drive?
TomTom, do you realize that summing the numbers takes much less time than doing a select *?
Mar
23
comment How to make a huge ram drive?
(and of course, specify how many records are in AnyTable)
Mar
23
comment How to make a huge ram drive?
I.e. Not trying to be argumentitive there... I actually would like to know.
Mar
23
comment How to make a huge ram drive?
Ok TomTom, run this query: "Select * From AnyTable", where 'AnyTable' has a minimum of 20 fields and tell me how fast the query results are returned. That is, not how fast you see results start to come up in SMSS, but how long before the entire query has been processed.
Mar
23
comment How to make a huge ram drive?
those impediments are minute compared to the slowness of the db. If I could have gotten results back as fast as I am used to then I could have finished in a fraction of the time. Instead I spent more time creating small subsets of the data to work with to formulate the queries with than I did actually creating the queries.
Mar
23
comment How to make a huge ram drive?
To answer your questions: 1) The indexes pretty much suck on this db and I'm working on that, but read the edit and other comments I've made to understand why this isn't relevant for my question. 2) No, the queries can't be further optimized. Just trust me on this one... they definitely aren't that complex to begin with. 3) Like I said it's a new job (only been there a week) and I got to spend almost no time with the previous employee so yes... I'm working on learning the schema and also this is a new industry for me. However...
Mar
23
awarded  Commentator
Mar
23
comment How to make a huge ram drive?
@TomO'Connor Thanks. That was at least as helpful as a couple of other answers I've gotten :)
Mar
23
comment How to make a huge ram drive?
@MarkWagner Pretty much. For example I was asked to include results for one report where a particular field was >= 5. Well, that was about 96% of the records in the table.
Mar
23
awarded  Editor
Mar
23
revised How to make a huge ram drive?
added 296 characters in body
Mar
23
comment How to make a huge ram drive?
+1. Thanks, I agree that FusionIO seems pretty expensive... but if the results come back fast enough that I can run ad-hoc queries in front of the people needing reports so they can give me immediate feedback, allowing me to refine the reports and give them what they need in 2 hours instead of 8, then I think it's well worth the cost.
Mar
23
comment How to make a huge ram drive?
Maybe I should have provided more detail when I wrote the question... running a "select field1, field2, field3, etc from sometable" can take a few minutes for a million records. Not much an index or normalization can do to help that query. It's on a virtual machine with 12 gigs of ram. Like I said... just started at the job and no I'm not a db or networking admin, but I know they are fixing to move to a clustered environment and my understanding is that this only improves availability and not really performance. So I just want to give what input I can to make sure their efforts are fruitful.
Mar
23
awarded  Supporter
Mar
23
comment How to make a huge ram drive?
I realize this solutions annoys the heck out of people who have all that knowledge and expertise though... which is probably why my question got downvoted.
Mar
23
comment How to make a huge ram drive?
Thanks, I actually found that right after I posted this question and given the performance gain I believe it will offer versus the amount of knowledge and expertise I would have to have to otherwise optimize and micro-optimize to math that... it seems like a no brainer to me. Definitely going to look into getting one of these.
Mar
23
comment How to make a huge ram drive?
You say that "a RAM drive won't help a bit", and then say "but ... faster drives for the database might help." You realize that a RAM drive is a much faster drive... right? What am I missing here? Because those comments seem to be totally conflicting to me.
Mar
23
comment How to make a huge ram drive?
And can you get results back from a 100 billion record table in a few seconds? Because that's the kind of speed I'm after because I believe it's possible with just a million records. I don't think your solution will provide that.
Mar
23
comment How to make a huge ram drive?
Tom, that's like saying the sun is tiny because there are much larger stars out there; compared to the rock we live on every day it's pretty large though just as a million records is compared to the average db. Did you answer this question because you wanted to be helpful or because you wanted to be arrogant? I found this: fusionio.com/platforms/iodrive that would totally be worth the cost considering that I could be multiple times more productive with this kind of speed and it's a pretty small fraction of what they're paying me.
Mar
23
awarded  Critic