I am trying to find the most optimal machine configuration for a web cache that will serve HTTP-segmented video to a few thousand concurrent viewers.
The content is composed of periodically updating text files (called manifests) which are a few bytes in size (100 - 500 bytes) and a set of video segment files which are thousands of bytes in size (52,000 - 250,000 bytes).
My setup has a live video origin server that puts these files onto a WebDAV-enabled server (which will be an appropriately configured Apache or Nginx). I would like to front this this "origin" setup at multiple locations using standard hardware and open-source software for serving the user population.
My questions are:
- I am considering a combination of Nginx + Varnish on my edge caches. Does that sound reasonble?
- What would be a good machine config? I am considering 3X2TB 7200RPM HDD in RAID5 and 24GRAM, 1 quad code CPU. Is that good for Varnish? Is there a particular parameter I need to optimize to get the best out of Varnish?
- Does it make sense to setup Varnish in HA pairs or are they usually setup standalone?