Questions tagged [scalability]
The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.
242
questions
1
vote
1
answer
40
views
Safely abort Ansible playbooks when server downtime runs out
Afaik ansible offers no possibility to safely exit a running playbook, so I am wondering which strategy would be wise to not leave hosts in inconstistent states:
Lets picture an infrastructure of ~300 ...
- 11
0
votes
0
answers
22
views
Which architecture would be ideal for thousands of tenants that need good isolation
We have a Python app that needs Redis and Mysql. It currently needs to be updated frequently (weekly).
This app will be used by thousands of clients soon that all need a separate installation that has ...
- 101
-2
votes
1
answer
62
views
What are the scalability strategies? [closed]
What are the scalability strategies for an infrastructure in a cloud?, I need to prepare a scalability plan document for a cybersecurity audit
0
votes
1
answer
73
views
What are the scalability concerns with pub/sub servers?
I'm looking into setting up a pub/sub service with websockets. From what I can tell the scalability bottlenecks will mainly be with memory, which affects how many sockets can be opened at a time, so ...
- 111
0
votes
0
answers
117
views
Cloud setup for occasional high to extreme CPU-intensive tasks (instant vertical scaling?)
I have a business workload that has very low CPU-usage most of the time, and occasionally needs to burst to very high CPU-usage. It currently runs on a dedicated server with 32 cores, but was hoping ...
- 161
1
vote
0
answers
37
views
RabbitMQ Stomp one central Node or domain based?
We have a server with about 400 instances of an application, each of these instances has its own domain.
We want to set up a RabbitMQ(other server) , also Stomp(websockets) for the Frontend and amqp ...
- 131
0
votes
1
answer
2k
views
Shards in Kubernetes
We have an application that we are running in kubernetes. However, this application only support a fixed number of people.
It has multiple systems:
DB
Authentication system
Web Application
Media ...
- 113
-2
votes
1
answer
254
views
What are the server requirements in terms of CPU, RAM and bandwith for etherpad-lite? [duplicate]
As my previous post was marked as duplicate of a very generic question, I want to post here again,as i found an answer :-)
For an event with 500 to 1000 participants we plan to use etherpads for ...
- 97
2
votes
0
answers
258
views
Vertically scale server in cloud without restart
For a current project of mine I need a cloud service which can (automatically) scale VMs vertically as the workload can not be scaled horizontally.
With scaling I mean assigning more RAM and/or CPU ...
- 121
1
vote
1
answer
595
views
How (if at all) is KVM used with enterprise workloads?
This is sort of similar to Q123566, but I want to add a few clarifications:
KVM is the Linux-kernel-based virtualization technology (specifically: a hypervisor) that underlies most non-Xen FOSS ...
1
vote
1
answer
345
views
AWS: Can we cosider having multiple EC2 instances and RDS for a single product as horizontal scaling?
What I read in stack overflow and other blogs-
https://stackoverflow.com/questions/11707879/difference-between-scaling-horizontally-and-vertically-for-databases/11715598#11715598
http://ht.ly/cAhY6
...
- 113
0
votes
1
answer
140
views
Can logstash be used as a kafka forwarder?
I am looking at the plugins for Logstash and I noticed it had both an input and output plugin for kafka. For a single topic, can Logstash be used to forward kafka topic messages to another kafka ...
1
vote
0
answers
31
views
Can't scale write bandwidth on Linux with Intel Optanes
I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/...
- 11
3
votes
2
answers
260
views
Nosql autoscaling of compute
Most of the nosql autoscaling faces issue due to the fact the data have to be migrated during peak load. What if data is stored in a shared storage like CLVM which has less overhead(compared to NFS or ...
- 239
1
vote
0
answers
35
views
Autoscaling cloud web applications- what method do people use to establish which metric is most suitable to scale off?
I understand with applications hosted in the Cloud, autoscaling is now a very popular method of ensuring applications can scale based on fluctuations load/work.
From my reading, I know that most, if ...
google-cloud-platform
0
votes
1
answer
36
views
Servlet hosting with peak capacity [closed]
I am hosting a website that is currently run on Google Cloud Storage, and a completely static interface. I am considering upgrading it to allow for better plotting tools, which will require it to run ...
- 103
2
votes
1
answer
156
views
Intel Scalable Processors
this should be a pretty straight forward question but might come out as ambiguous (might also be the wrong place to ask). I've been researching the newest and bluest Dell Poweredge and HPE server ...
- 247
1
vote
1
answer
257
views
Scaling AWS ASG by RequestCount in ELB
We've determined a base metric that the servers in our ASG can handle about 1000 requests per minute.
Given that information, we'd like to be able to control the scaling of our ASG based on the ...
- 323
1
vote
2
answers
177
views
Backup strategy for dedicated LEMP stack server
We currently have an application running on a dedicated server which utilizes a LEMP (Linux, Nginx, MariaDB, PHP) stack. Right now we are only doing backups at a set interval (every x hours). I have ...
- 263
0
votes
0
answers
1k
views
Distribute "RTMP to HLS" process on multiple servers
I have configured a simple live streaming service, for a limited broadcaster, according to this schema:
actual service configuration
There is a "origin" server where I've installed the NGINX and ...
1
vote
1
answer
1k
views
how to scale a high traffic server? [closed]
I'm very confused on techniques for scaling servers
Say you had one high traffic server running on one computer with one 12 core CPU, and one server for a database.
For a while that would work, but ...
- 119
0
votes
1
answer
482
views
LoadBalancing for whole subnet
Is it possible to configure HaProxy to balance traffic for whole subnet. I tried 192.168.50.0/24, but HaProxy gets error. This is for cloud environment, so if my server scales-out, I don't need ...
0
votes
1
answer
287
views
rails puma nginx concurrent access - cannot find the bottleneck
I have a simple rails app running on puma with an nginx proxy server in front of it configured in a standard way. They are running on an aws t2.micro instance.
The mysql db is running on another t2....
- 21
2
votes
0
answers
184
views
ProFTPd MySQL across multiple physical servers
I have a website that offers FTP space. It's a secondary function to the main site, but a feature that is proving popular. I use ProFTPd with MySQL which nicely sets the users up in their home ...
- 121
1
vote
0
answers
67
views
Multiple application instances and Docker usage
I have a classical web application (CRM tool) which requires nginx, python (flask), postgresql and redis to work.
I plan to sell this application to different companies and host them on my powerful ...
- 11
-2
votes
2
answers
59
views
Will EC2 server instance autoscale
Say I have a video streaming app on a ec2 medium server instance, and if concurrent users are too many, will the ec2 automatically provide additional resources for handle any number of users? if not, ...
- 117
1
vote
0
answers
18
views
Server and Database layout [duplicate]
MongoDB vs MySQL, Master-Master or Master-Slave?
I’m currently developing a service in Laravel for online learning. Basically imagine Memrise.com.
Now, my users are going to be doing lots of reads ...
- 33
1
vote
2
answers
810
views
Scaling a single WordPress website via AWS/EC2
I manage a website that is essentially just a news/blog powered by WordPress. Average users on the site is somewhere between 8-15. But we occasionally break news in our niche where we'll have anywhere ...
- 111
59
votes
5
answers
105k
views
Optimal value for Nginx worker_connections
Nginx worker_connections "sets the maximum number of simultaneous connections that can be opened by a worker process. This number includes all connections (e.g. connections with proxied servers, among ...
- 669
6
votes
2
answers
21k
views
Intel Xeon processors: Difference between 2S/4S and S2S/S4S scalability
While comparing Intel Xeon E5 and E7 processors, I've noticed that E5 processors are specified for 2S or 4S scalability, while E7 processors are specified for S2S, S4S, or S8S scalability.
I ...
- 1,626
-1
votes
1
answer
261
views
Run shell script on the event of "possible SYN flooding"
I'd like to write a script that gets all the stats I need (top IPs, used memory, netstat, etc) at the time I got an SYN flooding, and write to a report file.
So, is it possible to trigger a script/...
- 533
2
votes
1
answer
7k
views
Handle "possible SYN flooding on port 443. Sending cookies."
My website constantly has several users online all the time.
The server uses Apache/PHP, database and Memcached. On normal use, the application works well and fast.
However, the server appears to ...
- 533
0
votes
1
answer
2k
views
How much data can SQL Server handle without a DBA / other professionals?
We deploy clusters that use Cassandra, Elasticsearch and similar NoSQL technologies to index and process data. We go to quite some lengths to make sure we can consume and process records quickly.
One ...
- 426
0
votes
1
answer
254
views
AWS autoscaling triggers
I am going to move a very big wordpress website (in terms of DB) to AWS.
And I would like to understand the autoscaling triggers in order to find the best balance between costs and performance.
Are ...
- 23
0
votes
1
answer
2k
views
FreeRadius Scalability with multiple NAS worldwide
Our network setup consists of 5 network access servers in 5 different locations worldwide and it is expected to expand in the coming days to 15 network access servers and more in future. Currently we ...
- 59
2
votes
0
answers
128
views
How to aggregate a large cron mail volume
How do you handle a large volume of cron mails (from a thousand servers) in a smart way? Main use case: a cron error comes in, but its severity does not warrant immediate action. However, I do not ...
- 2,852
1
vote
0
answers
152
views
Make Varnish check for html static before serving
I was thinking of writing some logics to my application so that it can write the static page content to s3 or some CDN and serve primarily from there. But am not sure if this is possible.
For ...
- 273
1
vote
2
answers
984
views
Remote Desktop Services - Scale up vs scale out
I'm currently in the process of planning any required changes to an RDS infrastructure to cater for an upcoming increase in the number of users due to company expansion.
Currently, the system only ...
- 1,852
5
votes
0
answers
1k
views
Is RSS (receive side scaling) in Windows considered unstable?
When asking a customer to enable RSS in their data center to improve network performance (very high UDP packets-per-sec rate), I was told that they generally turn it off, because after various ...
0
votes
2
answers
73
views
Is possible to have the same domain route to different servers without using subdomains?
I'd like to split my application up onto three different servers. This would make things a little more scalable. But I'm worried about using subdomains since it might mess with our SEO. Is is possible ...
- 758
0
votes
1
answer
964
views
How to scale Cassandra cluster vertically
I have a 3 node Cassandra cluster which I set up a year ago and it is getting quite slow now. It is much cheaper for me to scale vertically than it would be to scale horizontally ( I received free RAM ...
- 111
1
vote
1
answer
266
views
Managing both servers and Docker containers with serf
I'm using Serf to instead of linking containers together so I can restart Docker containers without links breaking. On each server I run one container with the Serf ports exposed that every other ...
0
votes
0
answers
654
views
nginx: Dynamically limit requests based on path
We have a service that serves up user-created assets dynamically. So a user can upload a file and share it using a url like /path/to/asset/unique_id. We currently use the limit_conn module to protect ...
- 101
0
votes
0
answers
303
views
Direct server return loadbalancer for mariadb galera cluster with 2 networks
Is it possible to configure LVS (keepalived) loadbalancer with direct server return (DSR) for 2 leg network setup?
The desired architecture is as follows: mariadb galera cluster, where each node has ...
- 1
0
votes
0
answers
186
views
Scale automatically by monitoring the load in app server
I have a regular setup with 4 droplets in DigitalOcean. One for Haproxy as load balancer, two for app servers, run same Django application and one for database.
It's quite easy to add another app ...
- 153
9
votes
2
answers
2k
views
Scale HAProxy for more than 64k websockets
We are trying to design an architecture that will be able to handle more than 64k websockets.
We first tried with Amazon ELB, but its design doesn't allow unexpected spike of traffic nor websocket. (...
- 1,886
0
votes
1
answer
1k
views
Nginx+PHP scalability on Windows
I'm trying to understand Nginx+PHP scalability running Windows with, lets say, 100 requests doing a medium-term operations.
Analyzing source code I saw:
Nginx start a spawns itself several times ...
0
votes
1
answer
3k
views
Is it possible to do autoscaling for elasticsearch in AWS at peak load?
I'm new to ElasticSearch but I'm already using ElasticSearch on my production site.
I installed ElasticSearch in one EC2 instance. After using ElasticSearch for several month, now currently the CPU ...
- 121
0
votes
1
answer
186
views
Creating a scalable back-up cluster with one interface and retention
Currently I'm running a number of back-up servers to back-up other servers with, e.g. b01, b02, .., bn, all with their own IP's, running their own FTP / SSH services. However, I would like to create ...
- 3
3
votes
1
answer
2k
views
How to launch EC2 instance with preconfigured AWS Alarm
I wan't to kill a specific instance when some of it's hardware consumption metrics reaches a certain level. If i create an alarm for the scaling group (setting maximum cpu consumption threshhold to >=...
- 171