Questions tagged [scaling]
The scaling tag has no usage guidance.
142
questions
0
votes
1
answer
122
views
Does reverse proxying the WebSockets servers make sense from scaling perspective?
I have reverse proxy and multiple WebSocket servers behind it. I'm confused whether it makes any sense from scaling perspective, because I see it like that:
The WebSocket server A has 30,000 active ...
- 73
1
vote
0
answers
57
views
How to scale out WSGI servers
If I had a web application with a Flask/Django backend, I could use a single host to run both the WSGI server and the nginx web server/reverse proxy. Nginx would handle incoming requests, serving ...
- 111
0
votes
0
answers
27
views
How to handle scaling upto 3k concurrent connections [duplicate]
So here's our use case:
We have firmware that connects to server (simple php file - that takes post request) and add the data (350-500 bytes per request) to database.
Now here's a issue we have 3k ...
0
votes
0
answers
108
views
Firebird horizontally scaling using containers
I am trying to setup a firebird server within K8s and using docker containers. This has worked well with using Azure Files as a persistent volume storage, however when I try scaling past 1, there are ...
- 101
0
votes
2
answers
418
views
Kubernetes scales on same node
I installed traefik via Helm. Then I scaled it with
kubectl scale --replicas=2 deployment traefik -n traefik
Now I have two pods running on the same node, despite there is a second node that is up ...
- 123
0
votes
1
answer
56
views
Justifying Horizontal Scaling
When is horizontal scaling likely to solve your scaling problems?
Let's say you have single api node (no DB) and a desired goal of 10k RPS over 5 minutes where the p95 is < x ms. Requests are ...
- 99
0
votes
1
answer
676
views
How to minimize ecs autoscaling reaction time from terraform?
When you create an ECS autoscaling policy, two alarms tag along with it: one for scaling up ("out"), one for scaling down ("in").
The scale-out ones I see created appear to sample ...
- 103
-1
votes
1
answer
125
views
understanding Openstack physical architecture [closed]
So, please correct me if I am wrong:
I want to build my own cloud computing platform using openstack.
I buy a rack server- https://www.serverstack.in/
I install say 1TB of Hard disk. 30 GB of RAM and ...
1
vote
1
answer
961
views
ActiveMQ Artemis: Cannot join more than two brokers with JGroups and KUBE_PING
While testing Apache ActiveMQ Artemis 2.13.0 with JGroups and the KUBE_PING plugin on Kubernetes I have noticed that no more than two brokers form a cluster. Any other brokers are simply ignored, ...
- 285
-1
votes
2
answers
1k
views
What is going on when multiple requests are made to a host?
This is a very basic question about the mechanics of computers. What are some of the common ways that a host handles multiple requests during the code execution phase for applications with millions of ...
- 99
1
vote
0
answers
104
views
Experimental setup of PostgresXL on Kubernetes with Local volumes
I'm making a Gedankenexperiment about deploying PostgresXL on Kubernetes (k8s) where each datanode uses local (Directly Attached) storage.
Imagine we have the following nodes:
2x highend machines ...
- 111
0
votes
1
answer
137
views
Detect when scaling Azure SQL database via async TSQL command has failed
I have a scheduled task which runs each night to copy an existing production Azure SQL db to a dev environment. Once copied, I scale the database down (actually I put it into an elastic pool to share ...
- 111
3
votes
2
answers
3k
views
horizontal scaling and load-balancing for PostgreSQL with ProxySQL
I have a PostgreSQL DB running in Google Cloud SQL that I need to scale horizontally. Cloud SQL makes it easy to add read-only replicas, but does nothing to help with load-balancing traffic to the ...
- 297
1
vote
2
answers
668
views
Is there a such thing as vertical scaling without having to shutdown the machine?
I've never come across a hosting company/cloud company that provides true vertical scaling without having to turn off the machine and/or copy the website or VM on to another machine. I've only seen ...
- 111
2
votes
1
answer
76
views
Scaling up / reorganising VPS infrastructure for SMB
I work for a digital agency, where we design,
build and host websites for our (local) clients.
Currently, we have approx. 80-90 sites scattered on 11 VPS instances.
99% of those sites is WordPress ...
- 123
0
votes
1
answer
637
views
Nginx with docker load balancing app server (php)
I haven't found an solution so far, so I'm asking here:
This is the situation I'm locking an solution for:
We are planing an architecture that contains the following components
Docker Container (...
- 115
2
votes
1
answer
70
views
Can Kubernetes prioritize nodes when scaling?
I have a Kubernetes cluster on AWS set up with KubeAWS. We're using some sensitive third-party integrations that require white-listed IP addresses in their firewall.
Now, what I've done is that I've ...
0
votes
1
answer
75
views
Is it pointless to scale your containers in the same physical server?
This is a question I couldn't find an answer Googling, maybe the terms I should search are different.
Suppose you have a containerized app, NGINX Container, PHP Container and DB Container.
You need ...
- 993
0
votes
0
answers
264
views
AWS ECS scaling with custom load balancer
I am currently using AWS Elastic Container Service. It is running with a HAProxy server acting as our load balancer, along with a lambda that acts as a service discovery mechanism for the servers. Our ...
- 101
1
vote
1
answer
1k
views
Can aws vertical scaling of ec2 instance support 100,000 users per day? [duplicate]
I have a link sharing site (think reddit). It is hosted on godaddy deluxe shared hosting now. I am planning to migrate it to aws.
I have seen an aws webinar on scaling till 10 million users. But ...
- 111
2
votes
1
answer
682
views
How to scale horizontally a Parse Server?
My current setup is:
1 Parse Server - 2.6.3
1 MongoDB Server - 3.4.9
Both running on Ubuntu VMs.
In a few weeks, we are expecting our user base to grow significantly! We are currently using 2 VMs ...
- 198
0
votes
1
answer
1k
views
Using HAProxy for syslog traffic at scale
I have an environment that generates a frankly ludicrous amount of Syslog traffic - this is mostly due to a culture of leaving debug-level logging on in production applications (and changing this ...
- 1,417
0
votes
1
answer
1k
views
Do slow nodes bottleneck a Galera Cluster?
Let's say I have a 5 node cluster, with 3 SSD RAID 10 nodes and a 2 SSD RAID 1 nodes.
Will the RAID 1 nodes slow down the entire network?
How do the Galera cluster writes work? Does it have to wait ...
- 1
0
votes
1
answer
517
views
Configuring Redis for a read heavy application
Redis connection timeout even after upgrading to elasticache m4.xlarge
We are facing connection timeout.Our cache size is hardly 1.5Gb.We have been using m4.large instance and there was around 150-200 ...
- 101
-1
votes
1
answer
38
views
User account affects screen scaling
I have an Azure VM with a couple of local accounts. If I use MSTSC to connect and login with account1 then all is good. If I login with account2 then the scaling is messed up and text is so small it's ...
- 413
2
votes
2
answers
3k
views
Why is my AWS instances suddenly becoming irresponsive reporting high "stolen" CPU
The setup
I have a bunch of t2.small EC2 instances running hosting the image processing library called thumbor for simple on-the-fly image resizing. Originals are loaded from S3. In front of the ...
- 358
1
vote
1
answer
45
views
AWS Horizontaly Scaling application
I have a NodeJS program that has 50 workers ready to process requests. The script maintains connections to the service that distributes requests.
I want to autoscale this script so that when 45 ...
0
votes
0
answers
252
views
Advice about scaling out IIS and SQL Server 2014 on Windows Server 2012R2
We are running a dual processor server E5-2630 V3 / 64 GB RAM with Windows Server 2012 R2, this server has IIS and SQL Server 2014 installed, only one web service is running to serve a mobile ...
- 119
-2
votes
2
answers
465
views
Should I scale vertically or horizontally assuming equal pricing? [closed]
AWS instances usually have a linear pricing model:
i.e. 2 small instances are the same price as one medium instance (which has exactly 2x the performance specs).
So what would be the better choice? ...
- 173
1
vote
1
answer
127
views
Distributed image processing on AWS: how to know the address of master node?
Context: I am building a mobile application that will let users apply advanced filters to their pictures. Since the processing can't be done on the phone, it will be offloaded to EC2 instances.
I ...
- 314
2
votes
1
answer
127
views
Thought about using my server hardware effectively
I will receive my new server hardware in some days, and of course I am already planning on how to use it the most effective way.
My current thoughts are about scaling the web and database server on a ...
- 167
0
votes
1
answer
783
views
AWS autoscaling cooldown
I have 1 instance. If latency more then 1 second for 3 minutes, it will add up another instance.
And here the problems arises: after 50 min(because of scaling cooldown) this 2nd instance terminates. ...
- 119
1
vote
1
answer
350
views
Best practices for scaling and capacity planning : VM only ? VM+Container ? Container only ? Cluster ? Something else?
(I can't find a similar question which has been already answered but maybe I do not use the good words as I'm a french student ;))
The closest answer to what I'm looking for is : Scalable Web ...
- 309
1
vote
2
answers
714
views
Using Azure Traffic Manager for an immediate increase in capacity
I have a REST web-service on Azure which has very high but variable load, it's all set-up to auto scale using Paraleap so that it can handle the peak periods but keep costs down when things are ...
- 171
4
votes
1
answer
2k
views
Creating a stable, auto-scaling app server cluster
I have two servers, each running anywhere from 50-100 different legacy webapps, written in languages ranging from PHP to Python to Ruby-on-rails to NodeJS.
We're wanting to kill off these machines ...
- 177
6
votes
2
answers
1k
views
AWS - how to serve faster to oversea users
We have our infras relying on AWS in the us-east-1 region. (EC2, CloudFront, RDS, ElastiCache)
We are now having more and more users from the APAC. Users start to complain about network speed to our ...
- 283
2
votes
1
answer
1k
views
Google App Engine vertical scaling
I know Google Cloud (Google App Engine) can autoscale instances horizontally: you have 1 server with certain parameters, when it's overloaded autoscaler launches new server and balances load between ...
google-cloud-platform
0
votes
0
answers
675
views
Horizontal Versus Verticale Scaling for Large Scale RoR Application (High CPU and Memory Usage)
We are launching a high demand (several hundred simultaneous users) Ruby on Rails application and we are trying to determine the best way to scale. Currently, we have a setup that follows this ...
- 3
1
vote
2
answers
2k
views
pushing apache2 past 1500 concurrent connections
I am trying to scale to 4000 concurrent connections on a ubuntu/apache box.
It is 8 core / 64gb ram, so it is not hitting memory or cpu, or any resources for that matter. The problem is with ...
- 61
22
votes
2
answers
17k
views
How can I make Microsoft Management Console high-DPI aware in Windows 8.1?
Since Windows 8.1 doesn't allow system-wide "Windows XP style" high DPI support, how can I make the Microsoft Management Console apps (mmc.exe) high-DPI aware? There is no "Troubleshoot compatibility" ...
- 385
1
vote
2
answers
1k
views
Load Balancing MongoDB
I have an application written in java with tomcat that I am ready to start scaling for production. As I understand it, i shouldn't use a load balancer with mongodb router instances as it can cause ...
- 111
-1
votes
1
answer
114
views
What kind of scaling method is it, when you add new software to a single server to handle more users? [closed]
I have read about scaling (in terms of terminology and methods). This got me confused about the following:
On a single computer, running a web server (say apache), if the system administrator adds a ...
- 523
2
votes
2
answers
3k
views
How do I force apache to drop requests after a predetermined amount of time?
I'm setting up a system that has hard requirements on the response time. How do I force Apache2 to drop requests in the queue after 200ms if it hasn't been served?
Background
One of our internal ...
- 21
0
votes
3
answers
185
views
Grant mysql access to remote servers without IP
I'm setting up a hosting scheme that will involve a master server and clone servers all accessing a remote mysql DB on its own server. As traffic increases/decreases I will be adding or removing clone ...
- 115
4
votes
1
answer
3k
views
Can I use MongoDB with Amazon EC2 small instance?
I want to move my MongoDB from a virtual server to amazon web services. I know MongoDB provides a preconfigured AMI, with three provisioned EBS volumes. But this is only available for m1.large ...
- 522
13
votes
5
answers
841
views
How do services with large ingest rates install enough hard disks fast enough?
Amazon, Facebook and Google must take in TBs if not PBs per day, so does that mean they have people continuously installing new hard disks and cables in new racks in the same way you might build a ...
- 2,585
7
votes
2
answers
4k
views
HAProxy not balancing server load fairly
HAProxy doesn't seem to keep the connections to the servers balanced.
Keep this in mind:
using HAProxy v1.3.26
5 equally balanced server specs
algorithm is round robin, but no weights are applied ...
- 71
-1
votes
2
answers
2k
views
What ports to open in aws security group for aws?
I am building the backend for a turn based gamed. My experience is mostly with a lamp stack; I've dabbled in nginx on a node side project.
I just read Scaling PHP Applications by Stephen Corona of ...
- 101
0
votes
2
answers
2k
views
How can I perform IIS stress test 40,000 http requests per second?
I'm the co-founder of a startup which is in the beginning and growing rapidly. I want to test an stress scenario on my IIS server to help figure out the resource needed from our cloud service, like 40,...
- 133
0
votes
1
answer
418
views
How do I go about finding the bottleneck in a slow web based chat application
I am working on a one-to-one chat application running in production. It uses StropheJS to connect to Ejabberd server over BOSH (using ejabberd's default connection manager). The main problem we are ...
- 101