I have a single Nginx server doing load balancing to several upstream servers.
What happens when a request comes in?
Does the load balancer keep the connection open and wait for an answer from the upstream servers? Or does it simply hand the request to an upstream server and "closes" the connection?
If the load balancer keeps the connection open until the request has been processed, it would mean that the load balancer is the bottleneck in my system, and it wouldn't matter if I increased the number of upstream servers.