Questions tagged [load-balancing]

Load balancing deal with the techniques involved on using multiple systems to deal with high demands, balancing the load between those multiple systems. Questions deal with networking and server load balancing, using dedicated hardware or not.

761 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
6 votes
0 answers
2k views

nginx sticky sessions / ip_hash with Socket.io

I am to be load balancing two node.js/Socket.io instances on different boxes with nginx running a simple notifications service with a retroactive event for new clients. I don't think there will be ...
bdls's user avatar
  • 181
5 votes
1 answer
2k views

ARR mixing HTTP server variables among client users

What I am trying to do? I am setting up blue-green deployment to achieve zero down-time deployment. How is the implementation? I have one server. I created a web farm. I set 3 websites blue,...
Oğuzhan Topçu's user avatar
5 votes
2 answers
3k views

nginx proxy_cache: limit parallel requests for the same URL

We're using nginx as a reverse proxy to get files from upstream servers. The files are not dynamic – at least not on a per request basis – and are (sometimes) behind high latency. I would like to ...
Gert's user avatar
  • 208
5 votes
1 answer
1k views

Multiple DNS names and IP address to make load balancing more efficient in an Exchange CAS Array

The tl;dr problem The CAS server occasionally gets one or two NAT'ed IP addresses that have several hundred users behind it. That is bad for scalability. The tl;dr solution Have the NAT'ed ...
makerofthings7's user avatar
5 votes
1 answer
3k views

How to not redirect when cookie is set in haproxy?

On my site I redirect users with mobile devices to a mobile site using my Haproxy loadbalancer. I got some complaints about that and want to offer the users a link back to the "classic" portal. As not ...
OpenHaus's user avatar
4 votes
0 answers
763 views

Nginx not always serving js and css when load balancing between docker containers - works on refresh

I have Nginx set up as a reverse proxy load balancing between two docker containers running all on the same server. When loading a page for the first time, the page loads but I get lots of 404 errors ...
Andy Baxter's user avatar
4 votes
0 answers
7k views

Enabling HSTS header on AWS Application Load Balancer

We have a Spring Boot application behind an AWS Application Load Balancer. The load balancer terminates SSL before forwarding coming requests to our application and also redirects 80 port to 443 port. ...
berkay.ozturk's user avatar
4 votes
1 answer
7k views

What options do I have if I need a firewall behind AWS network load balancer?

Today we're using WAF for Application Load Balancer and it's great, but WAF not support Network Load balancer. So we need a solution that will protect us behind or after the NLB. For example: 1. ...
Noamway's user avatar
  • 153
4 votes
1 answer
2k views

nginx proxy_pass is being ignored

I have an Nginx server which works as a proxy server. I also have 3 different NodeJS Express servers running on ports 8080, 9090 and 8888 (all working correctly). Servers 8080 and 9090 execute the ...
Amit4got's user avatar
4 votes
0 answers
2k views

How to Reduce Failover Interval in HAProxy?

I have setup HAProxy and it is working fine. I observed that when one of the node goes down HAProxy detects that immediately, but switch-over / redirect existing traffic to the rest of working nodes ...
Never Quit's user avatar
4 votes
0 answers
382 views

Pound sticky sessions between HTTP and HTTPS

I have pound setup for http and https, and have sticky sessions based on cookie for both. However, sessions are not sticky when jumping from http to https. Is there anyway to do this in Pound? It's ...
pokero's user avatar
  • 249
4 votes
2 answers
963 views

GKE how to have ingress modify existing load balancer

Is it possible to get GKE to augment the rules for an existing load balancer instead of creating a new one for each ingress object created? We have multiple ingress objects created from multiple ...
tom's user avatar
  • 138
3 votes
0 answers
68 views

Spread IPsec decryption over multiple CPUs

All IPsec traffic being decrypted is processed on a single CPU, despite having multiple IPsec tunnels (SAs.) How can I get the load shared across multiple CPUs? I'm running Strongswan IPsec on Ubuntu ...
Jeff Learman's user avatar
3 votes
1 answer
881 views

TCP request is getting drop on Google cloud load balancer

We are using TCP Google Cloud Loadbalancer for one of our services. The architecture is the following: There is a TCP load balancer on which a range of ports are allowed on frontend and its backend ...
Chandan Kashyap's user avatar
3 votes
0 answers
4k views

Exchange 2013 MAPI over HTTP Load balancing HAProxy

We have successfully managed to deploy HAProxy as a Layer-4 load balancer for all our Exchange 2013 SP1 HTTP based traffic (Autodiscover, OWA, EXP, EWS, MAPI, etc.) For various reasons, however, we ...
Phil's user avatar
  • 3,198
3 votes
0 answers
739 views

Loadbalancing and HA with SolrCloud?

I have a LAMP Application running with solr 3.x on one server for several years now. Now I am migrating due to heavy load to a setup with two dedicated machines where all services are loadbalanced via ...
merlin's user avatar
  • 2,172
3 votes
1 answer
2k views

Can apache proxy/load balancer redirect requests to other available balancer member when it gets timeout from a hanging server?

I am using apache2.4.6 and tomcat8 to implement a load balance solution. I'd like to know whether apache balancer will redirect requests to another balancer member if it gets timeout error from one ...
Chuck's user avatar
  • 131
3 votes
1 answer
795 views

Active Active failover

I have an application which is handling UDP traffic. Need to run the setup in active-active mode with two machines and only one IP exposed to external world. Will LVS be helpful in this scenario or ...
Sunil's user avatar
  • 141
3 votes
1 answer
2k views

Direct Routing in Load Balancer

I wish to set up an load balancer via direct routing switching technique.I installed ipvsadm via $ sudo apt-get install ipvsadm Setup Virtual IP is 172.17.10.173 subnet mask 255.255.240.0 linux ...
Anubhav Agarwal's user avatar
3 votes
3 answers
3k views

Ubuntu Pound Reverse Proxy Load Balancing Based off active server load?

I have Pound installed on a loadbalancer. It seems to work okay, except that it randomly assigns the backend server to forward the request to. I've put 1 backend machine under so much load that it ...
Andrew's user avatar
  • 255
3 votes
1 answer
269 views

Internal+external interfaces with multiple default gateways on Win2003

I'm trying to set up several web servers for a load balanced cluster and need to have each server connected to the internal network (for load balancing) as well as to an external network (Internet - ...
Ariel's user avatar
  • 131
2 votes
3 answers
87 views

Setting up a cluster with workload distribution

I want to setup a server cluster which can keep by servers as busy as possible while still giving fair compute time to everyone. I have setup a basic Kubernetes setup but the issue is that if some ...
starhawk's user avatar
2 votes
0 answers
115 views

Kong-proxy not working inside Jelastic environment

We need a bit of help trying to install Kong in Kubernetes inside Jelastic environment. Me and My colleague have a production based kubernetes cluster with the following: Load Balancer 1 Node with ...
Shawn King's user avatar
2 votes
0 answers
779 views

Shall I do load balancing in nginx, pm2 or both?

PM2 allows to run NodeJS apps on multiple instances, i.e., different cores, allowing load balancing using the same port. PORT=3000 pm2 start -i NUMBER_OF_CORES(e.g 2) app.js But I could also do load ...
João Pimentel Ferreira's user avatar
2 votes
2 answers
1k views

AWS NLB HTTPs health check using mTLS

Is it possible to do a AWS NLB HTTPs health check using mTLS? I tried setting up a TLS listener, loaded my cert, setup a TLS target group with HTTPs health check, but the health checks are still ...
RustyShackleford's user avatar
2 votes
1 answer
4k views

Best way to enable DDoS protection on many individual GCP compute instances without load balancing?

I've been scouring through the Google Cloud Armor docs for information about DDoS protection of a GCP compute VM instance. From what I've found, Google Cloud Armor Managed Protection provides ...
Alexander Guyer's user avatar
2 votes
1 answer
2k views

SQL Server Load Balancing Splitting Read/Write Operations

Hello We have 3 nodes of SQL Server 2014 Standard Edition one of them as primary and the other one as Replication of the Primary using Transactional Replication database We want to use the other 2 ...
Ermesto's user avatar
  • 21
2 votes
0 answers
328 views

Can an AWS Application Load Balancer mark a service as unhealthy "early"

I try to find out, if it is possible to configure an AWS Application Load Balancer in a way, that if the backend service responds with an error status code (e.G. 503 Service Unavailable) to a regular ...
Sven Eppler's user avatar
2 votes
0 answers
237 views

From AWS to GCP - Is downtime unavoidable during migration?

I'm trying to migrate a bitnami wordpress from AWS to GCP. I would like to avoid downtime during the migration. As a new learner, I am not sure how to best handle this. I have encountered some ...
FlyingPenguin's user avatar
2 votes
0 answers
464 views

How to setup FB's Katran load balancer

I'm trying to setup Katran Load balancer from https://github.com/tehnerd/katran on Ubuntu, but I am confused with the example explained and how the packets are forwarding through IPIP interface ...
raitech's user avatar
  • 91
2 votes
0 answers
281 views

How to load balance in nginx based on user category

There will be a web application served by gunicorn with pod instantiated in every node in Kubernetes cluster. External load balancer (limited to the round-robin or least connections methods) drives ...
ipaleka's user avatar
  • 121
2 votes
1 answer
431 views

How to test TLS False Start feature

I am currently enabled both ALPN and forward secrecy for my server using aws network load balancer which support tls up to 1.2. And I would like to know how to validate/test that TSL False Start is ...
tututa's user avatar
  • 21
2 votes
1 answer
5k views

HAPROXY : reverse proxy with TLS termination

I'm a newbie with HAProxy, and I want to use it to redirects HTTPS incoming requests to my HTTP backends servers. I know, how it is possible to do it with Nginx, like this : #SSL for all server { ...
outstore's user avatar
2 votes
0 answers
230 views

How to scale Network Bandwidth for media server?

We are running a WebRTC Server to facilitate audio/video call feature on our app. But as our concurrent users keeps on increasing, we are facing network bandwidth issue. Max cap on google cloud vm ...
hardik24's user avatar
  • 121
2 votes
0 answers
552 views

Lets encrypt wildcard SSL not working behind AWS ELB

I have two servers behind an ELB on AWS. I am using Lets Encrypt newest wildcard SSL feature but I'm running into the following error ERR_SSL_PROTOCOL_ERROR the strange part is that sometimes it will ...
NooBskie's user avatar
  • 105
2 votes
1 answer
393 views

Load balancing prefer own subnet / availability zone first

I have 3 front end boxes that are each in their own availability zone. They all 3 run a reverse proxy server (in this case traefik). How can I keep the traffic within the AZ to avoid the inter AZ ...
Botto's user avatar
  • 241
2 votes
1 answer
486 views

Best practices for load balancing high-bandwidth services?

I have a pretty good handle on load balancing web applications with nginx/HAProxy/etc. As I understand it, in these cases you're mostly limited by things like the number of concurrent connections and ...
anderspitman's user avatar
2 votes
0 answers
404 views

nginx as load balancer not forwarding to ports

I am not getting the expected behaviour from my nginx configured as a load balancer. The load balancer part is working, but I am trying to forward to different ports but it is just going out on the ...
omega1's user avatar
  • 446
2 votes
0 answers
435 views

Having trouble with gRPC calls behind an (AWS classic) load balancer

I have a server written in Python 3.6, using frameworks flask (1.0.2), and SQLAlchemy (2.4.0). I have some rest calls going out to third-party services such as vision APIs. I have a few API calls ...
Dinal24's user avatar
  • 121
2 votes
1 answer
78 views

Does anyone have experience of load balancing an apt repository? Can it be done?

I'd just like a bit of a head start on this if anyone's any experience of it. Searching for things like "apt load balanced" gives remarkably little of use. We currently have an apt repository on a ...
whoasked's user avatar
  • 269
2 votes
0 answers
651 views

NIC team not load balancing

I'm trying to achieve a load-balanced NIC team on a Windows Server 2016 machine. This is a ProLiant using a 4x 1Gb 311FLR interface card which as of yesterday has the latest driver installed (100.20.0....
Rich M's user avatar
  • 273
2 votes
1 answer
2k views

How to make NGINX load balancing server without proxying the requests?

I could not find a solution for the issue so this is my question. Say I have 3 servers, 2 of them are upstream servers, and 1 is a load balancer. This is my basic configurations Upstream servers ...
David Tran's user avatar
2 votes
0 answers
203 views

HAProxy multiple certificates error on first call

I have a load balancer running HAProxy 1.7.5-2 with the following setup: multiple https-enabled frontends each frontend binds the following (for different IPs): bind <ip>:443 ssl crt /opt/...
Ivan Sieder's user avatar
2 votes
0 answers
2k views

Nginx php-fpm getting rid of 502 error on high traffic site

currently i have a server with following specs: 32 core 128gb RAM 1TB SSD hardisk 5Gbps network uplink current setup are nginx+php-fpm without any load balancing setup nginx.conf ...
Teddybugs's user avatar
  • 153
2 votes
0 answers
203 views

What is best practice design for internal traffic between microservices?

I have two PHP written microservices A & B. Endpoints are a.example.com and b.example.com. Both services need to be public accessible. In addition, service B makes a lot of curl requests to a....
starchx's user avatar
  • 533
2 votes
0 answers
1k views

FTP connection via Load Balancer cd works ls fails

Below is the configuration. Client is a linux server IP: 10.204.21.143. This server is only reachable to HA Proxy server. HA Proxy Server IP: 10.204.24.71 (Its a Solaris 11.3 Server) Back end ...
Gaurav Mittal's user avatar
2 votes
1 answer
5k views

Apache (http) behind load balancer (http/https) - Redirect does not preserve https

I have two configurations - development and staging - with (supposedly) identical configurations: a set of HTTP-only Apache instances sitting behind a Citrix load balancer that allows both HTTP and ...
greenlaw's user avatar
  • 121
2 votes
0 answers
310 views

Is there a load balancer that will terminate a GRE tunnel?

I have a network in which several site routers send portions of their traffic to an inspection device via GRE tunnel. I am beginning to exceed the capacity of the inspection device. I could always ...
loadBalanced's user avatar
2 votes
1 answer
4k views

SMTP load balancing with remote host's IP passed through to SMTP servers?

I'm attempting to build a load-balanced SMTP cluster. The mail servers already exist and run Exim 4. Initially, I looked at using Nginx to do the load-balancing, however on the test system all the ...
Pyromancer's user avatar
2 votes
0 answers
770 views

When does the Nginx error happen, recv() failed (110: Connection timed out) while proxying upgraded connection

I am using Nginx 1.10.1 for my APP to balance connections on Websocket. For example, the App A(multi-process) establish Websocket connections to B1, B2 through Nginx so that the connections could be ...
asleea's user avatar
  • 169

1
2 3 4 5
16