I recently started receiving pubsub data feed from etsy. It averages around 250 notifications per minute. But obviously, when the USA wakes up that spikes quite heavily.
I want to be able to deal with those spikes (about 3 per day) but the rest of day is fine.
What's the best method of getting the right server configuration. My current approach is to keep upgrading until the server stops dying... next leap is:
- Processor: AMD Phenom II X6-1055T HEXA Core
- RAM: 4GB DDR2 SDRAM
- HD1: SATA Drive (7,200 rpm) (+500 GB 7200 RPM SATA hard drive)
- HD2: SATA Backup Drive (+500 GB SATA (7,200 rpm))
- OS: Linux OS (+CentOS 5 64-bit)
- Bandwidth: 6000GB Monthly Transfer (3000 in + 3000 out) (+100M uplink port)
What's the best approach to working out what sort of server setup you need?
Edit: Server load hits 150 during the spikes. It's not a drive space or bandwidth issue.
Edit 2: Thanks for the debug pointers. I have now run SAR and pasted the output here: http://pastebin.com/xNbL91Wp
sar 05:00:01 PM CPU %user %nice %system %iowait %steal %idle Average: all 16.74 0.16 2.94 1.51 0.00 78.65 sar -W 12:00:02 AM pswpin/s pswpout/s Average: 0.00 0.00 sar -q 12:00:02 AM runq-sz plist-sz ldavg-1 ldavg-5 ldavg-15 Average: 7 195 2.20 2.41 2.63
Also, here is a link to a 3 day graph of my server load
The times in the SAR reports and on this graph are both GMT -5
So with a ldavg-1 of 2.20 would you say that a processor upgrade is advisable?