Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

0
votes
1answer
31 views

Running Google App Engine on Scale [on hold]

I am very new to Google Cloud Platform, thus I have very little knowledge about it and this is my first project which I am trying to deploy on Google App Engine. I was looking for a Google community ...
0
votes
1answer
39 views

Infrastructure - different variants. What are the advantages of the virtualization layer? [on hold]

The infrastructure that I see most often: First infrastructure Can I manage the infrastructure equally effectively using only Container-Optimized OS, management and monitoring tools (e.g. Ansible...),...
1
vote
0answers
18 views

Can't scale write bandwidth on Linux with Intel Optanes

I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/...
3
votes
2answers
147 views

Nosql autoscaling of compute

Most of the nosql autoscaling faces issue due to the fact the data have to be migrated during peak load. What if data is stored in a shared storage like CLVM which has less overhead(compared to NFS or ...
1
vote
0answers
29 views

Autoscaling cloud web applications- what method do people use to establish which metric is most suitable to scale off?

I understand with applications hosted in the Cloud, autoscaling is now a very popular method of ensuring applications can scale based on fluctuations load/work. From my reading, I know that most, if ...
0
votes
1answer
22 views

Servlet hosting with peak capacity [closed]

I am hosting a website that is currently run on Google Cloud Storage, and a completely static interface. I am considering upgrading it to allow for better plotting tools, which will require it to run ...
2
votes
1answer
128 views

Intel Scalable Processors

this should be a pretty straight forward question but might come out as ambiguous (might also be the wrong place to ask). I've been researching the newest and bluest Dell Poweredge and HPE server ...
1
vote
1answer
121 views

Scaling AWS ASG by RequestCount in ELB

We've determined a base metric that the servers in our ASG can handle about 1000 requests per minute. Given that information, we'd like to be able to control the scaling of our ASG based on the ...
1
vote
2answers
63 views

Backup strategy for dedicated LEMP stack server

We currently have an application running on a dedicated server which utilizes a LEMP (Linux, Nginx, MariaDB, PHP) stack. Right now we are only doing backups at a set interval (every x hours). I have ...
0
votes
0answers
571 views

Distribute “RTMP to HLS” process on multiple servers

I have configured a simple live streaming service, for a limited broadcaster, according to this schema: actual service configuration There is a "origin" server where I've installed the NGINX and ...
0
votes
1answer
508 views

how to scale a high traffic server? [closed]

I'm very confused on techniques for scaling servers Say you had one high traffic server running on one computer with one 12 core CPU, and one server for a database. For a while that would work, but ...
0
votes
1answer
108 views

LoadBalancing for whole subnet

Is it possible to configure HaProxy to balance traffic for whole subnet. I tried 192.168.50.0/24, but HaProxy gets error. This is for cloud environment, so if my server scales-out, I don't need ...
0
votes
1answer
196 views

rails puma nginx concurrent access - cannot find the bottleneck

I have a simple rails app running on puma with an nginx proxy server in front of it configured in a standard way. They are running on an aws t2.micro instance. The mysql db is running on another t2....
2
votes
0answers
101 views

ProFTPd MySQL across multiple physical servers

I have a website that offers FTP space. It's a secondary function to the main site, but a feature that is proving popular. I use ProFTPd with MySQL which nicely sets the users up in their home ...
1
vote
0answers
47 views

Multiple application instances and Docker usage

I have a classical web application (CRM tool) which requires nginx, python (flask), postgresql and redis to work. I plan to sell this application to different companies and host them on my powerful ...
0
votes
0answers
613 views

How to scale backend Firebase service

I am building an application with a decent amount of Firebase service code running in the backend. It is possible that this App will end up reaching thousands and possibly hundreds of thousands of ...
-1
votes
2answers
44 views

Will EC2 server instance autoscale

Say I have a video streaming app on a ec2 medium server instance, and if concurrent users are too many, will the ec2 automatically provide additional resources for handle any number of users? if not, ...
1
vote
0answers
17 views

Server and Database layout [duplicate]

MongoDB vs MySQL, Master-Master or Master-Slave? I’m currently developing a service in Laravel for online learning. Basically imagine Memrise.com. Now, my users are going to be doing lots of reads ...
1
vote
2answers
563 views

Scaling a single WordPress website via AWS/EC2

I manage a website that is essentially just a news/blog powered by WordPress. Average users on the site is somewhere between 8-15. But we occasionally break news in our niche where we'll have anywhere ...
19
votes
5answers
26k views

Optimal value for Nginx worker_connections

Nginx worker_connections "sets the maximum number of simultaneous connections that can be opened by a worker process. This number includes all connections (e.g. connections with proxied servers, among ...
4
votes
2answers
9k views

Intel Xeon processors: Difference between 2S/4S and S2S/S4S scalability

While comparing Intel Xeon E5 and E7 processors, I've noticed that E5 processors are specified for 2S or 4S scalability, while E7 processors are specified for S2S, S4S, or S8S scalability. I ...
-1
votes
1answer
154 views

Run shell script on the event of “possible SYN flooding”

I'd like to write a script that gets all the stats I need (top IPs, used memory, netstat, etc) at the time I got an SYN flooding, and write to a report file. So, is it possible to trigger a script/...
1
vote
1answer
2k views

Handle “possible SYN flooding on port 443. Sending cookies.”

My website constantly has several users online all the time. The server uses Apache/PHP, database and Memcached. On normal use, the application works well and fast. However, the server appears to ...
0
votes
1answer
1k views

How much data can SQL Server handle without a DBA / other professionals?

We deploy clusters that use Cassandra, Elasticsearch and similar NoSQL technologies to index and process data. We go to quite some lengths to make sure we can consume and process records quickly. One ...
0
votes
1answer
205 views

AWS autoscaling triggers

I am going to move a very big wordpress website (in terms of DB) to AWS. And I would like to understand the autoscaling triggers in order to find the best balance between costs and performance. Are ...
0
votes
1answer
788 views

FreeRadius Scalability with multiple NAS worldwide

Our network setup consists of 5 network access servers in 5 different locations worldwide and it is expected to expand in the coming days to 15 network access servers and more in future. Currently we ...
2
votes
0answers
104 views

How to aggregate a large cron mail volume

How do you handle a large volume of cron mails (from a thousand servers) in a smart way? Main use case: a cron error comes in, but its severity does not warrant immediate action. However, I do not ...
1
vote
0answers
72 views

Make Varnish check for html static before serving

I was thinking of writing some logics to my application so that it can write the static page content to s3 or some CDN and serve primarily from there. But am not sure if this is possible. For ...
1
vote
2answers
677 views

Remote Desktop Services - Scale up vs scale out

I'm currently in the process of planning any required changes to an RDS infrastructure to cater for an upcoming increase in the number of users due to company expansion. Currently, the system only ...
5
votes
0answers
1k views

Is RSS (receive side scaling) in Windows considered unstable?

When asking a customer to enable RSS in their data center to improve network performance (very high UDP packets-per-sec rate), I was told that they generally turn it off, because after various ...
0
votes
2answers
63 views

Is possible to have the same domain route to different servers without using subdomains?

I'd like to split my application up onto three different servers. This would make things a little more scalable. But I'm worried about using subdomains since it might mess with our SEO. Is is possible ...
-1
votes
1answer
600 views

How to scale Cassandra cluster vertically

I have a 3 node Cassandra cluster which I set up a year ago and it is getting quite slow now. It is much cheaper for me to scale vertically than it would be to scale horizontally ( I received free RAM ...
1
vote
1answer
200 views

Managing both servers and Docker containers with serf

I'm using Serf to instead of linking containers together so I can restart Docker containers without links breaking. On each server I run one container with the Serf ports exposed that every other ...
0
votes
0answers
281 views

nginx: Dynamically limit requests based on path

We have a service that serves up user-created assets dynamically. So a user can upload a file and share it using a url like /path/to/asset/unique_id. We currently use the limit_conn module to protect ...
0
votes
0answers
268 views

Direct server return loadbalancer for mariadb galera cluster with 2 networks

Is it possible to configure LVS (keepalived) loadbalancer with direct server return (DSR) for 2 leg network setup? The desired architecture is as follows: mariadb galera cluster, where each node has ...
0
votes
0answers
177 views

Scale automatically by monitoring the load in app server

I have a regular setup with 4 droplets in DigitalOcean. One for Haproxy as load balancer, two for app servers, run same Django application and one for database. It's quite easy to add another app ...
8
votes
2answers
2k views

Scale HAProxy for more than 64k websockets

We are trying to design an architecture that will be able to handle more than 64k websockets. We first tried with Amazon ELB, but its design doesn't allow unexpected spike of traffic nor websocket. (...
0
votes
1answer
949 views

Nginx+PHP scalability on Windows

I'm trying to understand Nginx+PHP scalability running Windows with, lets say, 100 requests doing a medium-term operations. Analyzing source code I saw: Nginx start a spawns itself several times ...
0
votes
1answer
2k views

Is it possible to do autoscaling for elasticsearch in AWS at peak load?

I'm new to ElasticSearch but I'm already using ElasticSearch on my production site. I installed ElasticSearch in one EC2 instance. After using ElasticSearch for several month, now currently the CPU ...
0
votes
1answer
177 views

Creating a scalable back-up cluster with one interface and retention

Currently I'm running a number of back-up servers to back-up other servers with, e.g. b01, b02, .., bn, all with their own IP's, running their own FTP / SSH services. However, I would like to create ...
3
votes
1answer
1k views

How to launch EC2 instance with preconfigured AWS Alarm

I wan't to kill a specific instance when some of it's hardware consumption metrics reaches a certain level. If i create an alarm for the scaling group (setting maximum cpu consumption threshhold to >=...
-2
votes
2answers
118 views

Scaling Up a Small Wordpress Site

I apologize in advance if this has been asked/answered a lot. I don't know enough yet to know what I don't know. We have a Wordpress site on a typical LAMP shared hosting platform that was getting ...
0
votes
1answer
129 views

Is it viable to run a script that serves images from database?

I run a very dynamic game review site. All the images (screenshots, game thumbnails, user profile pics, etc.) are served via a PHP script on the server. It takes the id as a parameter and reads the ...
11
votes
3answers
725 views

What types of systems have to “scale up” rather than “scale out”?

I have been wondering for a long time if there are systems that have to "scale up" (onto a more powerful, more expensive server) rather than "scale out" by being split across many smaller servers. ...
0
votes
0answers
617 views

Horizontal Versus Verticale Scaling for Large Scale RoR Application (High CPU and Memory Usage)

We are launching a high demand (several hundred simultaneous users) Ruby on Rails application and we are trying to determine the best way to scale. Currently, we have a setup that follows this ...
1
vote
1answer
44 views

IIS FTP: Should i create sites or folders?

I need to create a service to host several ip cameras, in the beginning 500+. The ip cameras send the files over ftp, so, to identify each camera, the files must go to separated folders. Now the ...
1
vote
1answer
228 views

Is this load balancing / horizontal scaling scheme naive?

I offer my solution to the following problem, and ask you networking and server admin professionals to validate it or poke holes in it. I am interested in any obvious attack vectors or scalability ...
2
votes
1answer
50 views

Confused about horizontal scalling

Please correct me if I am wrong but I guess handling more requests and load by adding more machines or balancing the load between multiple servers is horizontal scalling. So, if I add more servers, ...
1
vote
2answers
435 views

Scaling web application across multiple services

We're developing our web application and have been working on reducing our load times. When we began developing the application, we signed up with a well known hosting provider offering "dedicated ...
2
votes
1answer
189 views

Scalability in a High Availability Environment - SQL Failover Cluster 2012

I have created an environment where 1 SAN is connected with 2 Nodes (part of SQL Server 2012 Failover Cluster) of SQL Server. Windows Server 2008 R2 is used, and single DB is stored in SAN. We have ...