Server Fault is a question and answer site for system and network administrators. Join them; it only takes a minute:

Sign up
Here's how it works:
  1. Anybody can ask a question
  2. Anybody can answer
  3. The best answers are voted up and rise to the top

How to implement node.js to be able to handle 250k connections as comet server (client side we use

Would the use of nginx as proxy/loadbalancer be the right solution? Or will HA-Proxy be the better way? Has anyone real world experience with 100k+ connections and can share his setup? Would a setup like this be the right one (Quad core CPU per server -> start 4 Instances of node.js per Server?):

  nginx (as proxy / load balancing server)
        /               |          \
       /                |           \
      /                 |            \
     /                  |             \
node server #1  node server #2  node server #3
4 instances     4 instances     4 instances
share|improve this question
YouPorn runs with nginx as load balancer so I'm pretty confident it can handle your load :P – Antoine Benkemoun Nov 29 '11 at 17:45
@AntoineBenkemoun "Handle your load" may have been an unfortunate choice of words there. – ceejayoz Nov 29 '11 at 18:08
@AntoineBenkemoun Our requirement of 250K tcp connections is another playarea and far away from a few hundred http req/sec that a site like YP makes. – Nenad Nov 29 '11 at 21:02

vanilla nginx doesn't support HTTP/1.1 keepalive to the upstream (backend) servers, which breaks :( If you're willing to compile it yourself, you may have better luck -->

Though at that scale I wonder if it would be smoother to skip the web server layer, routing the TCP connections directly...

share|improve this answer
Thank you for the Link. I need to check if HA-Proxy is able to make a proper TCP routing. Would like to hear if anyone has some Real World experience. – Nenad Nov 29 '11 at 21:04
since 1.1.4 nginx has ngx_http_upstream_keepalive module and proxy_http_version directive – SaveTheRbtz Nov 30 '11 at 11:09
@SaveTheRbtz great news, I hope they release soon a stable version that include the proxy_http_version directive. – Nenad Dec 1 '11 at 4:13

Your Answer


By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.