Questions tagged [scalability]

The ability of a system, network, or process, to handle growing amounts of work in a graceful manner or its ability to be enlarged to accommodate that growth.

Filter by
Sorted by
Tagged with
0 votes
0 answers
36 views

Can Kafka handle cloud-scale load without horizontal sharding?

Per this kadek.com article, Kafka partition limits There are no hard limits on the number of partitions in Kafka clusters. But here are a few general rules: maximum 4000 partitions per broker (in ...
Harry's user avatar
  • 443
1 vote
1 answer
145 views

Safely abort Ansible playbooks when server downtime runs out

Afaik ansible offers no possibility to safely exit a running playbook, so I am wondering which strategy would be wise to not leave hosts in inconstistent states: Lets picture an infrastructure of ~300 ...
Aguirre23's user avatar
-2 votes
1 answer
67 views

What are the scalability strategies? [closed]

What are the scalability strategies for an infrastructure in a cloud?, I need to prepare a scalability plan document for a cybersecurity audit
fadi lamouchi's user avatar
0 votes
1 answer
81 views

What are the scalability concerns with pub/sub servers?

I'm looking into setting up a pub/sub service with websockets. From what I can tell the scalability bottlenecks will mainly be with memory, which affects how many sockets can be opened at a time, so ...
JBaczuk's user avatar
  • 111
0 votes
0 answers
139 views

Cloud setup for occasional high to extreme CPU-intensive tasks (instant vertical scaling?)

I have a business workload that has very low CPU-usage most of the time, and occasionally needs to burst to very high CPU-usage. It currently runs on a dedicated server with 32 cores, but was hoping ...
Albeit's user avatar
  • 161
1 vote
0 answers
48 views

RabbitMQ Stomp one central Node or domain based?

We have a server with about 400 instances of an application, each of these instances has its own domain. We want to set up a RabbitMQ(other server) , also Stomp(websockets) for the Frontend and amqp ...
demonking's user avatar
  • 131
0 votes
1 answer
2k views

Shards in Kubernetes

We have an application that we are running in kubernetes. However, this application only support a fixed number of people. It has multiple systems: DB Authentication system Web Application Media ...
AbrahamSustaita's user avatar
-2 votes
1 answer
335 views

What are the server requirements in terms of CPU, RAM and bandwith for etherpad-lite? [duplicate]

As my previous post was marked as duplicate of a very generic question, I want to post here again,as i found an answer :-) For an event with 500 to 1000 participants we plan to use etherpads for ...
Peter T.'s user avatar
  • 107
2 votes
0 answers
389 views

Vertically scale server in cloud without restart

For a current project of mine I need a cloud service which can (automatically) scale VMs vertically as the workload can not be scaled horizontally. With scaling I mean assigning more RAM and/or CPU ...
J Heschl's user avatar
  • 121
1 vote
1 answer
878 views

How (if at all) is KVM used with enterprise workloads?

This is sort of similar to Q123566, but I want to add a few clarifications: KVM is the Linux-kernel-based virtualization technology (specifically: a hypervisor) that underlies most non-Xen FOSS ...
JamesTheAwesomeDude's user avatar
1 vote
1 answer
533 views

AWS: Can we cosider having multiple EC2 instances and RDS for a single product as horizontal scaling?

What I read in stack overflow and other blogs- https://stackoverflow.com/questions/11707879/difference-between-scaling-horizontally-and-vertically-for-databases/11715598#11715598 http://ht.ly/cAhY6 ...
Veshraj Joshi's user avatar
0 votes
1 answer
158 views

Can logstash be used as a kafka forwarder?

I am looking at the plugins for Logstash and I noticed it had both an input and output plugin for kafka. For a single topic, can Logstash be used to forward kafka topic messages to another kafka ...
Archimedes Trajano's user avatar
1 vote
0 answers
32 views

Can't scale write bandwidth on Linux with Intel Optanes

I have a computer with 3 Intel Optane drives and iotop shows that sequential write to each one separately achieves ~2.2 GB/sec. I suppose that simultaneous writing on all three would result in ~6.6 GB/...
John Smith's user avatar
3 votes
2 answers
262 views

Nosql autoscaling of compute

Most of the nosql autoscaling faces issue due to the fact the data have to be migrated during peak load. What if data is stored in a shared storage like CLVM which has less overhead(compared to NFS or ...
kalyan's user avatar
  • 249
1 vote
0 answers
39 views

Autoscaling cloud web applications- what method do people use to establish which metric is most suitable to scale off?

I understand with applications hosted in the Cloud, autoscaling is now a very popular method of ensuring applications can scale based on fluctuations load/work. From my reading, I know that most, if ...
treetop's user avatar
  • 51
0 votes
1 answer
40 views

Servlet hosting with peak capacity [closed]

I am hosting a website that is currently run on Google Cloud Storage, and a completely static interface. I am considering upgrading it to allow for better plotting tools, which will require it to run ...
PearsonArtPhoto's user avatar
2 votes
1 answer
169 views

Intel Scalable Processors

this should be a pretty straight forward question but might come out as ambiguous (might also be the wrong place to ask). I've been researching the newest and bluest Dell Poweredge and HPE server ...
Tmanok's user avatar
  • 197
1 vote
1 answer
304 views

Scaling AWS ASG by RequestCount in ELB

We've determined a base metric that the servers in our ASG can handle about 1000 requests per minute. Given that information, we'd like to be able to control the scaling of our ASG based on the ...
jzimmerman2011's user avatar
1 vote
2 answers
199 views

Backup strategy for dedicated LEMP stack server

We currently have an application running on a dedicated server which utilizes a LEMP (Linux, Nginx, MariaDB, PHP) stack. Right now we are only doing backups at a set interval (every x hours). I have ...
nullReference's user avatar
0 votes
0 answers
1k views

Distribute "RTMP to HLS" process on multiple servers

I have configured a simple live streaming service, for a limited broadcaster, according to this schema: actual service configuration There is a "origin" server where I've installed the NGINX and ...
Federico B.'s user avatar
1 vote
1 answer
1k views

how to scale a high traffic server? [closed]

I'm very confused on techniques for scaling servers Say you had one high traffic server running on one computer with one 12 core CPU, and one server for a database. For a while that would work, but ...
Jamal H's user avatar
  • 119
0 votes
1 answer
577 views

LoadBalancing for whole subnet

Is it possible to configure HaProxy to balance traffic for whole subnet. I tried 192.168.50.0/24, but HaProxy gets error. This is for cloud environment, so if my server scales-out, I don't need ...
Šarūnas Rakauskas's user avatar
0 votes
1 answer
303 views

rails puma nginx concurrent access - cannot find the bottleneck

I have a simple rails app running on puma with an nginx proxy server in front of it configured in a standard way. They are running on an aws t2.micro instance. The mysql db is running on another t2....
Michael's user avatar
  • 21
2 votes
0 answers
229 views

ProFTPd MySQL across multiple physical servers

I have a website that offers FTP space. It's a secondary function to the main site, but a feature that is proving popular. I use ProFTPd with MySQL which nicely sets the users up in their home ...
Stephen 's user avatar
1 vote
0 answers
68 views

Multiple application instances and Docker usage

I have a classical web application (CRM tool) which requires nginx, python (flask), postgresql and redis to work. I plan to sell this application to different companies and host them on my powerful ...
Buzz Fizz's user avatar
-2 votes
2 answers
60 views

Will EC2 server instance autoscale

Say I have a video streaming app on a ec2 medium server instance, and if concurrent users are too many, will the ec2 automatically provide additional resources for handle any number of users? if not, ...
william007's user avatar
1 vote
0 answers
18 views

Server and Database layout [duplicate]

MongoDB vs MySQL, Master-Master or Master-Slave? I’m currently developing a service in Laravel for online learning. Basically imagine Memrise.com. Now, my users are going to be doing lots of reads ...
Axel Nilsson's user avatar
1 vote
2 answers
853 views

Scaling a single WordPress website via AWS/EC2

I manage a website that is essentially just a news/blog powered by WordPress. Average users on the site is somewhere between 8-15. But we occasionally break news in our niche where we'll have anywhere ...
Cistoran's user avatar
  • 111
64 votes
5 answers
121k views

Optimal value for Nginx worker_connections

Nginx worker_connections "sets the maximum number of simultaneous connections that can be opened by a worker process. This number includes all connections (e.g. connections with proxied servers, among ...
Aarti's user avatar
  • 719
7 votes
2 answers
23k views

Intel Xeon processors: Difference between 2S/4S and S2S/S4S scalability

While comparing Intel Xeon E5 and E7 processors, I've noticed that E5 processors are specified for 2S or 4S scalability, while E7 processors are specified for S2S, S4S, or S8S scalability. I ...
bwDraco's user avatar
  • 1,644
-1 votes
1 answer
301 views

Run shell script on the event of "possible SYN flooding"

I'd like to write a script that gets all the stats I need (top IPs, used memory, netstat, etc) at the time I got an SYN flooding, and write to a report file. So, is it possible to trigger a script/...
Nuno's user avatar
  • 633
2 votes
1 answer
8k views

Handle "possible SYN flooding on port 443. Sending cookies."

My website constantly has several users online all the time. The server uses Apache/PHP, database and Memcached. On normal use, the application works well and fast. However, the server appears to ...
Nuno's user avatar
  • 633
0 votes
1 answer
2k views

How much data can SQL Server handle without a DBA / other professionals?

We deploy clusters that use Cassandra, Elasticsearch and similar NoSQL technologies to index and process data. We go to quite some lengths to make sure we can consume and process records quickly. One ...
Basic's user avatar
  • 426
0 votes
1 answer
257 views

AWS autoscaling triggers

I am going to move a very big wordpress website (in terms of DB) to AWS. And I would like to understand the autoscaling triggers in order to find the best balance between costs and performance. Are ...
user350413's user avatar
0 votes
1 answer
2k views

FreeRadius Scalability with multiple NAS worldwide

Our network setup consists of 5 network access servers in 5 different locations worldwide and it is expected to expand in the coming days to 15 network access servers and more in future. Currently we ...
muzammil's user avatar
2 votes
0 answers
133 views

How to aggregate a large cron mail volume

How do you handle a large volume of cron mails (from a thousand servers) in a smart way? Main use case: a cron error comes in, but its severity does not warrant immediate action. However, I do not ...
Willem's user avatar
  • 2,922
1 vote
0 answers
158 views

Make Varnish check for html static before serving

I was thinking of writing some logics to my application so that it can write the static page content to s3 or some CDN and serve primarily from there. But am not sure if this is possible. For ...
Safwan Erooth's user avatar
1 vote
2 answers
1k views

Remote Desktop Services - Scale up vs scale out

I'm currently in the process of planning any required changes to an RDS infrastructure to cater for an upcoming increase in the number of users due to company expansion. Currently, the system only ...
dbr's user avatar
  • 1,862
5 votes
0 answers
2k views

Is RSS (receive side scaling) in Windows considered unstable?

When asking a customer to enable RSS in their data center to improve network performance (very high UDP packets-per-sec rate), I was told that they generally turn it off, because after various ...
Evgeniy Berezovsky's user avatar
0 votes
2 answers
79 views

Is possible to have the same domain route to different servers without using subdomains?

I'd like to split my application up onto three different servers. This would make things a little more scalable. But I'm worried about using subdomains since it might mess with our SEO. Is is possible ...
jwerre's user avatar
  • 778
0 votes
1 answer
998 views

How to scale Cassandra cluster vertically

I have a 3 node Cassandra cluster which I set up a year ago and it is getting quite slow now. It is much cheaper for me to scale vertically than it would be to scale horizontally ( I received free RAM ...
user2924127's user avatar
1 vote
1 answer
273 views

Managing both servers and Docker containers with serf

I'm using Serf to instead of linking containers together so I can restart Docker containers without links breaking. On each server I run one container with the Serf ports exposed that every other ...
Vincent den Boer's user avatar
0 votes
0 answers
869 views

nginx: Dynamically limit requests based on path

We have a service that serves up user-created assets dynamically. So a user can upload a file and share it using a url like /path/to/asset/unique_id. We currently use the limit_conn module to protect ...
Levi Nunnink's user avatar
0 votes
0 answers
330 views

Direct server return loadbalancer for mariadb galera cluster with 2 networks

Is it possible to configure LVS (keepalived) loadbalancer with direct server return (DSR) for 2 leg network setup? The desired architecture is as follows: mariadb galera cluster, where each node has ...
faraway's user avatar
0 votes
0 answers
189 views

Scale automatically by monitoring the load in app server

I have a regular setup with 4 droplets in DigitalOcean. One for Haproxy as load balancer, two for app servers, run same Django application and one for database. It's quite easy to add another app ...
brsbilgic's user avatar
  • 153
9 votes
2 answers
2k views

Scale HAProxy for more than 64k websockets

We are trying to design an architecture that will be able to handle more than 64k websockets. We first tried with Amazon ELB, but its design doesn't allow unexpected spike of traffic nor websocket. (...
Bastien974's user avatar
  • 1,906
0 votes
1 answer
1k views

Nginx+PHP scalability on Windows

I'm trying to understand Nginx+PHP scalability running Windows with, lets say, 100 requests doing a medium-term operations. Analyzing source code I saw: Nginx start a spawns itself several times ...
Mauro H. Leggieri's user avatar
0 votes
1 answer
3k views

Is it possible to do autoscaling for elasticsearch in AWS at peak load?

I'm new to ElasticSearch but I'm already using ElasticSearch on my production site. I installed ElasticSearch in one EC2 instance. After using ElasticSearch for several month, now currently the CPU ...
Petra Barus's user avatar
0 votes
1 answer
192 views

Creating a scalable back-up cluster with one interface and retention

Currently I'm running a number of back-up servers to back-up other servers with, e.g. b01, b02, .., bn, all with their own IP's, running their own FTP / SSH services. However, I would like to create ...
Evianon's user avatar
3 votes
1 answer
2k views

How to launch EC2 instance with preconfigured AWS Alarm

I wan't to kill a specific instance when some of it's hardware consumption metrics reaches a certain level. If i create an alarm for the scaling group (setting maximum cpu consumption threshhold to >=...
zango123's user avatar
  • 171

1
2 3 4 5