Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Filter by
Sorted by
Tagged with
1
vote
0answers
18 views

RabbitMQ Stomp one central Node or domain based?

We have a server with about 400 instances of an application, each of these instances has its own domain. We want to set up a RabbitMQ(other server) , also Stomp(websockets) for the Frontend and amqp ...
0
votes
0answers
35 views

Reverse proxy hardware requirements for high RPS [duplicate]

I am setting up a web service that is expected to process ~100,000 requests per second. For this, I want to setup a reverse proxy that forwards requests to several back-end servers. The requests come ...
0
votes
1answer
85 views

Shards in Kubernetes

We have an application that we are running in kubernetes. However, this application only support a fixed number of people. It has multiple systems: DB Authentication system Web Application Media ...
-2
votes
1answer
87 views

What are the server requirements in terms of CPU, RAM and bandwith for etherpad-lite? [duplicate]

As my previous post was marked as duplicate of a very generic question, I want to post here again,as i found an answer :-) For an event with 500 to 1000 participants we plan to use etherpads for ...
0
votes
0answers
32 views

Nginx: Active connections vs worker_connections

How information about Nginx Active connections from stub_status can help me to configure worker_connections wisely? Or it cannot? How these values may affect each other?
1
vote
0answers
72 views

Vertically scale server in cloud without restart

For a current project of mine I need a cloud service which can (automatically) scale VMs vertically as the workload can not be scaled horizontally. With scaling I mean assigning more RAM and/or CPU ...
1
vote
1answer
210 views

How (if at all) is KVM used with enterprise workloads?

This is sort of similar to Q123566, but I want to add a few clarifications: KVM is the Linux-kernel-based virtualization technology (specifically: a hypervisor) that underlies most non-Xen FOSS ...
1
vote
1answer
106 views

AWS: Can we cosider having multiple EC2 instances and RDS for a single product as horizontal scaling?

What I read in stack overflow and other blogs- https://stackoverflow.com/questions/11707879/difference-between-scaling-horizontally-and-vertically-for-databases/11715598#11715598 http://ht.ly/cAhY6 ...
0
votes
1answer
81 views

Can logstash be used as a kafka forwarder?

I am looking at the plugins for Logstash and I noticed it had both an input and output plugin for kafka. For a single topic, can Logstash be used to forward kafka topic messages to another kafka ...
1
vote
0answers
25 views

Can't scale write bandwidth on Linux with Intel Optanes

I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/...
3
votes
2answers
233 views

Nosql autoscaling of compute

Most of the nosql autoscaling faces issue due to the fact the data have to be migrated during peak load. What if data is stored in a shared storage like CLVM which has less overhead(compared to NFS or ...
1
vote
0answers
32 views

Autoscaling cloud web applications- what method do people use to establish which metric is most suitable to scale off?

I understand with applications hosted in the Cloud, autoscaling is now a very popular method of ensuring applications can scale based on fluctuations load/work. From my reading, I know that most, if ...
0
votes
1answer
30 views

Servlet hosting with peak capacity [closed]

I am hosting a website that is currently run on Google Cloud Storage, and a completely static interface. I am considering upgrading it to allow for better plotting tools, which will require it to run ...
2
votes
1answer
144 views

Intel Scalable Processors

this should be a pretty straight forward question but might come out as ambiguous (might also be the wrong place to ask). I've been researching the newest and bluest Dell Poweredge and HPE server ...
1
vote
1answer
189 views

Scaling AWS ASG by RequestCount in ELB

We've determined a base metric that the servers in our ASG can handle about 1000 requests per minute. Given that information, we'd like to be able to control the scaling of our ASG based on the ...
1
vote
2answers
135 views

Backup strategy for dedicated LEMP stack server

We currently have an application running on a dedicated server which utilizes a LEMP (Linux, Nginx, MariaDB, PHP) stack. Right now we are only doing backups at a set interval (every x hours). I have ...
0
votes
0answers
822 views

Distribute “RTMP to HLS” process on multiple servers

I have configured a simple live streaming service, for a limited broadcaster, according to this schema: actual service configuration There is a "origin" server where I've installed the NGINX and ...
1
vote
1answer
1k views

how to scale a high traffic server? [closed]

I'm very confused on techniques for scaling servers Say you had one high traffic server running on one computer with one 12 core CPU, and one server for a database. For a while that would work, but ...
0
votes
1answer
245 views

LoadBalancing for whole subnet

Is it possible to configure HaProxy to balance traffic for whole subnet. I tried 192.168.50.0/24, but HaProxy gets error. This is for cloud environment, so if my server scales-out, I don't need ...
0
votes
1answer
236 views

rails puma nginx concurrent access - cannot find the bottleneck

I have a simple rails app running on puma with an nginx proxy server in front of it configured in a standard way. They are running on an aws t2.micro instance. The mysql db is running on another t2....
2
votes
0answers
121 views

ProFTPd MySQL across multiple physical servers

I have a website that offers FTP space. It's a secondary function to the main site, but a feature that is proving popular. I use ProFTPd with MySQL which nicely sets the users up in their home ...
1
vote
0answers
63 views

Multiple application instances and Docker usage

I have a classical web application (CRM tool) which requires nginx, python (flask), postgresql and redis to work. I plan to sell this application to different companies and host them on my powerful ...
-2
votes
2answers
48 views

Will EC2 server instance autoscale

Say I have a video streaming app on a ec2 medium server instance, and if concurrent users are too many, will the ec2 automatically provide additional resources for handle any number of users? if not, ...
1
vote
0answers
18 views

Server and Database layout [duplicate]

MongoDB vs MySQL, Master-Master or Master-Slave? I’m currently developing a service in Laravel for online learning. Basically imagine Memrise.com. Now, my users are going to be doing lots of reads ...
1
vote
2answers
676 views

Scaling a single WordPress website via AWS/EC2

I manage a website that is essentially just a news/blog powered by WordPress. Average users on the site is somewhere between 8-15. But we occasionally break news in our niche where we'll have anywhere ...
45
votes
5answers
65k views

Optimal value for Nginx worker_connections

Nginx worker_connections "sets the maximum number of simultaneous connections that can be opened by a worker process. This number includes all connections (e.g. connections with proxied servers, among ...
4
votes
2answers
17k views

Intel Xeon processors: Difference between 2S/4S and S2S/S4S scalability

While comparing Intel Xeon E5 and E7 processors, I've noticed that E5 processors are specified for 2S or 4S scalability, while E7 processors are specified for S2S, S4S, or S8S scalability. I ...
-1
votes
1answer
176 views

Run shell script on the event of “possible SYN flooding”

I'd like to write a script that gets all the stats I need (top IPs, used memory, netstat, etc) at the time I got an SYN flooding, and write to a report file. So, is it possible to trigger a script/...
1
vote
1answer
4k views

Handle “possible SYN flooding on port 443. Sending cookies.”

My website constantly has several users online all the time. The server uses Apache/PHP, database and Memcached. On normal use, the application works well and fast. However, the server appears to ...
0
votes
1answer
2k views

How much data can SQL Server handle without a DBA / other professionals?

We deploy clusters that use Cassandra, Elasticsearch and similar NoSQL technologies to index and process data. We go to quite some lengths to make sure we can consume and process records quickly. One ...
0
votes
1answer
239 views

AWS autoscaling triggers

I am going to move a very big wordpress website (in terms of DB) to AWS. And I would like to understand the autoscaling triggers in order to find the best balance between costs and performance. Are ...
0
votes
1answer
1k views

FreeRadius Scalability with multiple NAS worldwide

Our network setup consists of 5 network access servers in 5 different locations worldwide and it is expected to expand in the coming days to 15 network access servers and more in future. Currently we ...
2
votes
0answers
121 views

How to aggregate a large cron mail volume

How do you handle a large volume of cron mails (from a thousand servers) in a smart way? Main use case: a cron error comes in, but its severity does not warrant immediate action. However, I do not ...
1
vote
0answers
125 views

Make Varnish check for html static before serving

I was thinking of writing some logics to my application so that it can write the static page content to s3 or some CDN and serve primarily from there. But am not sure if this is possible. For ...
1
vote
2answers
881 views

Remote Desktop Services - Scale up vs scale out

I'm currently in the process of planning any required changes to an RDS infrastructure to cater for an upcoming increase in the number of users due to company expansion. Currently, the system only ...
5
votes
0answers
1k views

Is RSS (receive side scaling) in Windows considered unstable?

When asking a customer to enable RSS in their data center to improve network performance (very high UDP packets-per-sec rate), I was told that they generally turn it off, because after various ...
0
votes
2answers
68 views

Is possible to have the same domain route to different servers without using subdomains?

I'd like to split my application up onto three different servers. This would make things a little more scalable. But I'm worried about using subdomains since it might mess with our SEO. Is is possible ...
0
votes
1answer
777 views

How to scale Cassandra cluster vertically

I have a 3 node Cassandra cluster which I set up a year ago and it is getting quite slow now. It is much cheaper for me to scale vertically than it would be to scale horizontally ( I received free RAM ...
1
vote
1answer
237 views

Managing both servers and Docker containers with serf

I'm using Serf to instead of linking containers together so I can restart Docker containers without links breaking. On each server I run one container with the Serf ports exposed that every other ...
0
votes
0answers
343 views

nginx: Dynamically limit requests based on path

We have a service that serves up user-created assets dynamically. So a user can upload a file and share it using a url like /path/to/asset/unique_id. We currently use the limit_conn module to protect ...
0
votes
0answers
282 views

Direct server return loadbalancer for mariadb galera cluster with 2 networks

Is it possible to configure LVS (keepalived) loadbalancer with direct server return (DSR) for 2 leg network setup? The desired architecture is as follows: mariadb galera cluster, where each node has ...
0
votes
0answers
182 views

Scale automatically by monitoring the load in app server

I have a regular setup with 4 droplets in DigitalOcean. One for Haproxy as load balancer, two for app servers, run same Django application and one for database. It's quite easy to add another app ...
9
votes
2answers
2k views

Scale HAProxy for more than 64k websockets

We are trying to design an architecture that will be able to handle more than 64k websockets. We first tried with Amazon ELB, but its design doesn't allow unexpected spike of traffic nor websocket. (...
0
votes
1answer
1k views

Nginx+PHP scalability on Windows

I'm trying to understand Nginx+PHP scalability running Windows with, lets say, 100 requests doing a medium-term operations. Analyzing source code I saw: Nginx start a spawns itself several times ...
0
votes
1answer
3k views

Is it possible to do autoscaling for elasticsearch in AWS at peak load?

I'm new to ElasticSearch but I'm already using ElasticSearch on my production site. I installed ElasticSearch in one EC2 instance. After using ElasticSearch for several month, now currently the CPU ...
0
votes
1answer
179 views

Creating a scalable back-up cluster with one interface and retention

Currently I'm running a number of back-up servers to back-up other servers with, e.g. b01, b02, .., bn, all with their own IP's, running their own FTP / SSH services. However, I would like to create ...
3
votes
1answer
2k views

How to launch EC2 instance with preconfigured AWS Alarm

I wan't to kill a specific instance when some of it's hardware consumption metrics reaches a certain level. If i create an alarm for the scaling group (setting maximum cpu consumption threshhold to >=...
-2
votes
2answers
127 views

Scaling Up a Small Wordpress Site

I apologize in advance if this has been asked/answered a lot. I don't know enough yet to know what I don't know. We have a Wordpress site on a typical LAMP shared hosting platform that was getting ...
0
votes
1answer
132 views

Is it viable to run a script that serves images from database?

I run a very dynamic game review site. All the images (screenshots, game thumbnails, user profile pics, etc.) are served via a PHP script on the server. It takes the id as a parameter and reads the ...
12
votes
3answers
799 views

What types of systems have to “scale up” rather than “scale out”?

I have been wondering for a long time if there are systems that have to "scale up" (onto a more powerful, more expensive server) rather than "scale out" by being split across many smaller servers. ...

1
2 3 4 5