Questions tagged [load-balancing]
Load balancing deal with the techniques involved on using multiple systems to deal with high demands, balancing the load between those multiple systems. Questions deal with networking and server load balancing, using dedicated hardware or not.
761
questions with no upvoted or accepted answers
6
votes
0
answers
2k
views
nginx sticky sessions / ip_hash with Socket.io
I am to be load balancing two node.js/Socket.io instances on different boxes with nginx running a simple notifications service with a retroactive event for new clients.
I don't think there will be ...
5
votes
1
answer
2k
views
ARR mixing HTTP server variables among client users
What I am trying to do?
I am setting up blue-green deployment to achieve zero down-time deployment.
How is the implementation?
I have one server.
I created a web farm.
I set 3 websites blue,...
5
votes
2
answers
3k
views
nginx proxy_cache: limit parallel requests for the same URL
We're using nginx as a reverse proxy to get files from upstream servers.
The files are not dynamic – at least not on a per request basis – and are (sometimes) behind high latency.
I would like to ...
5
votes
1
answer
1k
views
Multiple DNS names and IP address to make load balancing more efficient in an Exchange CAS Array
The tl;dr problem
The CAS server occasionally gets one or two NAT'ed IP addresses that have several hundred users behind it. That is bad for scalability.
The tl;dr solution
Have the NAT'ed ...
5
votes
1
answer
3k
views
How to not redirect when cookie is set in haproxy?
On my site I redirect users with mobile devices to a mobile site using my Haproxy loadbalancer. I got some complaints about that and want to offer the users a link back to the "classic" portal. As not ...
4
votes
0
answers
763
views
Nginx not always serving js and css when load balancing between docker containers - works on refresh
I have Nginx set up as a reverse proxy load balancing between two docker containers running all on the same server. When loading a page for the first time, the page loads but I get lots of 404 errors ...
4
votes
0
answers
7k
views
Enabling HSTS header on AWS Application Load Balancer
We have a Spring Boot application behind an AWS Application Load Balancer. The load balancer terminates SSL before forwarding coming requests to our application and also redirects 80 port to 443 port.
...
4
votes
1
answer
7k
views
What options do I have if I need a firewall behind AWS network load balancer?
Today we're using WAF for Application Load Balancer and it's great, but WAF not support Network Load balancer.
So we need a solution that will protect us behind or after the NLB. For example:
1. ...
4
votes
1
answer
2k
views
nginx proxy_pass is being ignored
I have an Nginx server which works as a proxy server.
I also have 3 different NodeJS Express servers running on ports 8080, 9090 and 8888 (all working correctly).
Servers 8080 and 9090 execute the ...
4
votes
0
answers
2k
views
How to Reduce Failover Interval in HAProxy?
I have setup HAProxy and it is working fine. I observed that when one of the node goes down HAProxy detects that immediately, but switch-over / redirect existing traffic to the rest of working nodes ...
4
votes
0
answers
382
views
Pound sticky sessions between HTTP and HTTPS
I have pound setup for http and https, and have sticky sessions based on cookie for both.
However, sessions are not sticky when jumping from http to https. Is there anyway to do this in Pound?
It's ...
4
votes
2
answers
963
views
GKE how to have ingress modify existing load balancer
Is it possible to get GKE to augment the rules for an existing load balancer instead of creating a new one for each ingress object created?
We have multiple ingress objects created from multiple ...
3
votes
0
answers
68
views
Spread IPsec decryption over multiple CPUs
All IPsec traffic being decrypted is processed on a single CPU, despite having multiple IPsec tunnels (SAs.) How can I get the load shared across multiple CPUs?
I'm running Strongswan IPsec on Ubuntu ...
3
votes
1
answer
881
views
TCP request is getting drop on Google cloud load balancer
We are using TCP Google Cloud Loadbalancer for one of our services.
The architecture is the following:
There is a TCP load balancer on which a range of ports are allowed on frontend and its backend ...
3
votes
0
answers
4k
views
Exchange 2013 MAPI over HTTP Load balancing HAProxy
We have successfully managed to deploy HAProxy as a Layer-4 load balancer for all our Exchange 2013 SP1 HTTP based traffic (Autodiscover, OWA, EXP, EWS, MAPI, etc.)
For various reasons, however, we ...
3
votes
0
answers
739
views
Loadbalancing and HA with SolrCloud?
I have a LAMP Application running with solr 3.x on one server for several years now. Now I am migrating due to heavy load to a setup with two dedicated machines where all services are loadbalanced via ...
3
votes
1
answer
2k
views
Can apache proxy/load balancer redirect requests to other available balancer member when it gets timeout from a hanging server?
I am using apache2.4.6 and tomcat8 to implement a load balance solution.
I'd like to know whether apache balancer will redirect requests to another balancer member if it gets timeout error from one ...
3
votes
1
answer
795
views
Active Active failover
I have an application which is handling UDP traffic. Need to run the setup in active-active mode with two machines and only one IP exposed to external world.
Will LVS be helpful in this scenario or ...
3
votes
1
answer
2k
views
Direct Routing in Load Balancer
I wish to set up an load balancer via direct routing switching technique.I installed ipvsadm via
$ sudo apt-get install ipvsadm
Setup
Virtual IP is 172.17.10.173 subnet mask 255.255.240.0
linux ...
3
votes
3
answers
3k
views
Ubuntu Pound Reverse Proxy Load Balancing Based off active server load?
I have Pound installed on a loadbalancer. It seems to work okay, except that it randomly assigns the backend server to forward the request to. I've put 1 backend machine under so much load that it ...
3
votes
1
answer
269
views
Internal+external interfaces with multiple default gateways on Win2003
I'm trying to set up several web servers for a load balanced cluster and need to have each server connected to the internal network (for load balancing) as well as to an external network (Internet - ...
2
votes
3
answers
87
views
Setting up a cluster with workload distribution
I want to setup a server cluster which can keep by servers as busy as possible while still giving fair compute time to everyone. I have setup a basic Kubernetes setup but the issue is that if some ...
2
votes
0
answers
115
views
Kong-proxy not working inside Jelastic environment
We need a bit of help trying to install Kong in Kubernetes inside Jelastic environment. Me and My colleague have a production based kubernetes cluster with the following:
Load Balancer
1 Node with ...
2
votes
0
answers
779
views
Shall I do load balancing in nginx, pm2 or both?
PM2 allows to run NodeJS apps on multiple instances, i.e., different cores, allowing load balancing using the same port.
PORT=3000 pm2 start -i NUMBER_OF_CORES(e.g 2) app.js
But I could also do load ...
2
votes
2
answers
1k
views
AWS NLB HTTPs health check using mTLS
Is it possible to do a AWS NLB HTTPs health check using mTLS?
I tried setting up a TLS listener, loaded my cert, setup a TLS target group with HTTPs health check, but the health checks are still ...
2
votes
1
answer
4k
views
Best way to enable DDoS protection on many individual GCP compute instances without load balancing?
I've been scouring through the Google Cloud Armor docs for information about DDoS protection of a GCP compute VM instance. From what I've found, Google Cloud Armor Managed Protection provides ...
2
votes
1
answer
2k
views
SQL Server Load Balancing Splitting Read/Write Operations
Hello We have 3 nodes of SQL Server 2014 Standard Edition one of them as primary and the other one as Replication of the Primary using Transactional Replication database
We want to use the other 2 ...
2
votes
0
answers
328
views
Can an AWS Application Load Balancer mark a service as unhealthy "early"
I try to find out, if it is possible to configure an AWS Application Load Balancer in a way, that if the backend service responds with an error status code (e.G. 503 Service Unavailable) to a regular ...
2
votes
0
answers
237
views
From AWS to GCP - Is downtime unavoidable during migration?
I'm trying to migrate a bitnami wordpress from AWS to GCP. I would like to avoid downtime during the migration. As a new learner, I am not sure how to best handle this.
I have encountered some ...
2
votes
0
answers
464
views
How to setup FB's Katran load balancer
I'm trying to setup Katran Load balancer from https://github.com/tehnerd/katran on Ubuntu, but I am confused with the example explained and how the packets are forwarding through IPIP interface ...
2
votes
0
answers
281
views
How to load balance in nginx based on user category
There will be a web application served by gunicorn with pod instantiated in every node in Kubernetes cluster. External load balancer (limited to the round-robin or least connections methods) drives ...
2
votes
1
answer
431
views
How to test TLS False Start feature
I am currently enabled both ALPN and forward secrecy for my server using aws network load balancer which support tls up to 1.2. And I would like to know how to validate/test that TSL False Start is ...
2
votes
1
answer
5k
views
HAPROXY : reverse proxy with TLS termination
I'm a newbie with HAProxy, and I want to use it to redirects HTTPS incoming requests to my HTTP backends servers.
I know, how it is possible to do it with Nginx, like this :
#SSL for all
server {
...
2
votes
0
answers
230
views
How to scale Network Bandwidth for media server?
We are running a WebRTC Server to facilitate audio/video call feature on our app. But as our concurrent users keeps on increasing, we are facing network bandwidth issue.
Max cap on google cloud vm ...
2
votes
0
answers
552
views
Lets encrypt wildcard SSL not working behind AWS ELB
I have two servers behind an ELB on AWS. I am using Lets Encrypt newest wildcard SSL feature but I'm running into the following error ERR_SSL_PROTOCOL_ERROR the strange part is that sometimes it will ...
2
votes
1
answer
393
views
Load balancing prefer own subnet / availability zone first
I have 3 front end boxes that are each in their own availability zone. They all 3 run a reverse proxy server (in this case traefik).
How can I keep the traffic within the AZ to avoid the inter AZ ...
2
votes
1
answer
486
views
Best practices for load balancing high-bandwidth services?
I have a pretty good handle on load balancing web applications with nginx/HAProxy/etc. As I understand it, in these cases you're mostly limited by things like the number of concurrent connections and ...
2
votes
0
answers
404
views
nginx as load balancer not forwarding to ports
I am not getting the expected behaviour from my nginx configured as a load balancer.
The load balancer part is working, but I am trying to forward to different ports but it is just going out on the ...
2
votes
0
answers
435
views
Having trouble with gRPC calls behind an (AWS classic) load balancer
I have a server written in Python 3.6, using frameworks flask (1.0.2), and SQLAlchemy (2.4.0). I have some rest calls going out to third-party services such as vision APIs.
I have a few API calls ...
2
votes
1
answer
78
views
Does anyone have experience of load balancing an apt repository? Can it be done?
I'd just like a bit of a head start on this if anyone's any experience of it. Searching for things like "apt load balanced" gives remarkably little of use.
We currently have an apt repository on a ...
2
votes
0
answers
651
views
NIC team not load balancing
I'm trying to achieve a load-balanced NIC team on a Windows Server 2016 machine. This is a ProLiant using a 4x 1Gb 311FLR interface card which as of yesterday has the latest driver installed (100.20.0....
2
votes
1
answer
2k
views
How to make NGINX load balancing server without proxying the requests?
I could not find a solution for the issue so this is my question.
Say I have 3 servers, 2 of them are upstream servers, and 1 is a load balancer.
This is my basic configurations
Upstream servers
...
2
votes
0
answers
203
views
HAProxy multiple certificates error on first call
I have a load balancer running HAProxy 1.7.5-2 with the following setup:
multiple https-enabled frontends
each frontend binds the following (for different IPs): bind <ip>:443 ssl crt /opt/...
2
votes
0
answers
2k
views
Nginx php-fpm getting rid of 502 error on high traffic site
currently i have a server with following specs:
32 core
128gb RAM
1TB SSD hardisk
5Gbps network uplink
current setup are nginx+php-fpm without any load balancing setup
nginx.conf
...
2
votes
0
answers
203
views
What is best practice design for internal traffic between microservices?
I have two PHP written microservices A & B. Endpoints are a.example.com and b.example.com. Both services need to be public accessible. In addition, service B makes a lot of curl requests to a....
2
votes
0
answers
1k
views
FTP connection via Load Balancer cd works ls fails
Below is the configuration.
Client is a linux server IP: 10.204.21.143. This server is only reachable to HA Proxy server.
HA Proxy Server IP: 10.204.24.71 (Its a Solaris 11.3 Server)
Back end ...
2
votes
1
answer
5k
views
Apache (http) behind load balancer (http/https) - Redirect does not preserve https
I have two configurations - development and staging - with (supposedly) identical configurations: a set of HTTP-only Apache instances sitting behind a Citrix load balancer that allows both HTTP and ...
2
votes
0
answers
310
views
Is there a load balancer that will terminate a GRE tunnel?
I have a network in which several site routers send portions of their traffic to an inspection device via GRE tunnel. I am beginning to exceed the capacity of the inspection device.
I could always ...
2
votes
1
answer
4k
views
SMTP load balancing with remote host's IP passed through to SMTP servers?
I'm attempting to build a load-balanced SMTP cluster. The mail servers already exist and run Exim 4. Initially, I looked at using Nginx to do the load-balancing, however on the test system all the ...
2
votes
0
answers
770
views
When does the Nginx error happen, recv() failed (110: Connection timed out) while proxying upgraded connection
I am using Nginx 1.10.1 for my APP to balance connections on Websocket.
For example, the App A(multi-process) establish Websocket connections to B1, B2 through Nginx so that the connections could be ...