Server Fault is a question and answer site for system and network administrators. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

We run a cluster of 45 linux machines with a lot of different stuff running (nginx, Varnish, Apache, MySQL, memcache etc) and load getting balanced on different machines. We do around 3000 requests per second and do some very computationally heavy requests in real time.

We do have a good understanding of Linux by now, but we do keep facing issues of max_connections reached, SYN Cookies sent, IP Tables issues, etc etc. We learn from our syslog and google around it and make a fix. I am hoping to understand all the different parameters and stuff that matters in a Linux box (ubuntu / Debian perspective) that I should know before running a very heavy service on a machine. The service is ought to get many thousands of requests per second from people across the globe (different IPs). A server interact with a bunch of other servers to complete a request.

Is there any book / set of books, I should get to understand the linux system and how it handle a request and what parameters matter where. Also any specific documentation on nginx, varnish, memcache, LAMP, MySQL that I should read before scaling things to many thousand requests per second level.


share|improve this question

closed as off topic by Lucas Kauffman, Sven, EEAA, Iain Mar 11 '12 at 18:39

Questions on Server Fault are expected to relate to server, networking, or related infrastructure administration within the scope defined by the community. Consider editing the question or leaving comments for improvement if you believe the question can be reworded to fit within the scope. Read more about reopening questions here.If this question can be reworded to fit the rules in the help center, please edit the question.

Read the FaQ, this question if off-topic I'm affraid. – Lucas Kauffman Mar 11 '12 at 18:21
I Apologize, will probably take this question down in a bit to keep this clean – Sparsh Gupta Mar 11 '12 at 18:28
up vote 4 down vote accepted

Technically this question shouldn't be here, as it's a shopping question. However I did want to answer as I found Scalable Internet Architectures a brilliant "concepts" type book that covers all the points you talk about.

share|improve this answer

Not the answer you're looking for? Browse other questions tagged or ask your own question.