Questions tagged [high-load]
All aspects of high-loaded systems development and maintenance.
201
questions
1
vote
0answers
19 views
PHP high I/O after a DDoS attack
I've had a large scale DDoS attack on my website.
After I've enabled captcha challenge through CloudFlare and the attack stopped, PHP's I/O was still loaded at 99%, and the website was working very ...
0
votes
0answers
43 views
How to improve performance of Nginx for high PHP processing load?
I wonder how I could improve the performance of my server?
It is configured with Ubuntu 18.04 (LTS), 4 GB RAM, 100 GB SSD, 2 CPU, with Nginx 1.14.0 and PHP 7.2-fpm to handle running and serving a site ...
0
votes
0answers
15 views
My GitHub Pages website went viral. 120k page views in 24h. Where do I go from here?
So I built nesteggly.com. Literally an MVP I cooked up over the past couple of months to help my girlfriend plan her retirement. Being a 100% static website and not thinking many people would find it ...
github
3
votes
1answer
68 views
High CPU Load and High I/O wait time : Mysql process
i am fairly new to the role and the technology. we have a Network server that receives the telemetry data from sensors and temeletry data is stored in MYSQL dabatase. we have a front end portal which ...
0
votes
0answers
33 views
What could cause significant delays in server-server requests with high concurrency?
Setup
4x blade setup in a single chassis each with 48 cores and 1 TB memory. VMs managed with Proxmox.
A "parent" service with 7 VMs running Linux (Debian)/Apache/PHP calling several microservices ...
8
votes
3answers
378 views
How to tune TCP for high-frequency connections between two nodes
I've been scratching my head for the past few days, trying to come up with a solution for the following problem:
In our data center we have a F5 running on BigIP hardware that acts as a single ...
1
vote
2answers
64 views
How to make high availability web page? [closed]
When we need a high availability service (it doesn't meter what kind of service: it can be a database, a queue system, our application) we spread it info many machines to make sure when one machine is ...
0
votes
1answer
49 views
Is it considered “safe” to run a task with high I/O on a server for 3 days straight, or would you add pauses in it?
I want to hash the contents of 4 million JPEG files taking up 32TB of a 48TB RAID6 partition in CentOS 7. It's a Hetzner SX131 10 x 6TB box.
Having run a test on 10,000 files I think the full job is ...
0
votes
0answers
101 views
How to setup shared storage on DigitalOcean load balanced droplets
I have a WordPress site that periodically peaks in traffic, this does not happen often enough to warrant a beefy server. So I was planning on setting up a load balanced cluster of small droplets.
One ...
0
votes
1answer
27 views
Load is 4000, CPU flatlined, remote reboot does nothing
I have a Debian 9 server and the load is over 4000.
"top" claims there are 18,132 processes sleeping.
Initially, I saw many "ps" processes, hundreds, so I killed them all by name.
I don't see any ...
1
vote
1answer
58 views
How do I know if my linux server can't keep up with network traffic and what to do about it?
Suppose I have a web-server serving html-pages under high load. Let's assume that for some reason the bottleneck is not cpu, not ram and not disk but rather the network itself. How can I tell that a ...
0
votes
0answers
190 views
Wordpress Cause Too Many Child Process and Very High CPU Load
I have a Wordpress site with daily 25K visitor, +3K post and +22K comment. on a VPS with 2 CPU and 8 GB Ram with SSD disk, Centos installed. it was stable but from 20 days i found a very high CPU load ...
0
votes
0answers
32 views
Need to correlate ps and load average
Let's say that I have 4 CPUs. In that case, load average should not go beyond 4 for better performance, it means only 4 threads can be run at a time (i.e., only 4 should be in R status in ps output). ...
-1
votes
1answer
116 views
LAMP stack with AWS performance [duplicate]
I am planning to move my LAMP stack to AWS as the number of users increases. Current estimations suggest, that the Server has to handle roughly 100.000 users accessing the static landing page, out of ...
0
votes
1answer
251 views
Testing Concurrent Users using Jmeter
If I have to load test an app for 40,000 users per hour with each user's average spent time of one minute then what should be my test approach?
Will running a test for 666 Threads/Users (40000/60=...
0
votes
1answer
295 views
NGINX + PHP-FPM issues with burst requests
I have NGINX setup with PHP7.2-FPM and am having issues with burst requests.
The average amount of active processes (fpm children) is 15.
I have these settings (48 core server):
listen.backlog = ...
0
votes
0answers
20 views
Are Load Spikes During Setup Considered for Provisioning?
I have a developer running automated tests which spike above 50% during setup, as seen in the below image.
He is arguing that the tests are unstable and difficult to troubleshoot, so downsizing is an ...
1
vote
2answers
3k views
mysqld taking 800% CPU since traffic increased on my site, how to fix
i have centos 7 x64 64 GB RAM and 500 GB of SSD dedicated server.,
And recently cpu usage was really high,
$ uptime
13:50:30 up 169 days, 1:53, 1 user, load average: 37.48, 37.64, 33.60
so i ...
0
votes
1answer
32 views
VServer shutdown on high cpu load - normal?
I rented a VServer to perform some distributed computation tasks.
Unfortunately I had to notice that after some minutes of almost full cpu load my vserver shut down.
I also got an email, notifying me,...
1
vote
1answer
2k views
NGINX: Request Limit timeout behavior for queries in the queue (burst)
Currently, we have a queue size of 3000 requests.
location /api/v2 {
limit_req zone=bursted burst=3000;
include /etc/nginx/proxy.conf;
}
The rate limit is 10 requests per second.
...
0
votes
0answers
95 views
Optimizing nginx with SSL for bot traffic without sessions
The service I run, cronitor.io, has a telemetry collection API that sees bursts of traffic around 1000rps. (overall baseline is much lower, call it 100rps)
Most of our requests come from things like ...
0
votes
1answer
2k views
Server load handling : One single batch request vs multiple requests
I was talking to a developer about different apis for create, update and delete and he was saying that it was better to have a single batch request to server to do operations like create, update and ...
0
votes
0answers
42 views
How to migrate an established HTTPS-session from one server to another?
There are many HTTPS-servers (Nginx or Haproxy or something else?):
single balancer,
and multiple workers.
Is it possible to migrate an established HTTPS session (with HTTP request headers already ...
-1
votes
2answers
77 views
server average load exact formula
I was in assumption cpu average load is calculated depend on number of process in running state (R state) + process waiting for I/O ( D state). But today I noticed that server is showing high load ...
5
votes
2answers
4k views
Fast pinging without requiring the response [closed]
I am trying to measure one way latency between two machines and I would like to use ping to send ICMP packets from one machine to another. The interval between the packets should be 1 micro second (...
0
votes
0answers
19 views
How high can server load be before sendmail would not be able to function anymore [duplicate]
I have a virtual server that runs multiple VPS on it, when we backup to a usb external hard drive the load increases to about 10 on the mail server with sendmail we get this in the log file
rejecting ...
0
votes
3answers
5k views
High load average, when should I be worried? [duplicate]
I have a server which runs a few hundred processes simultaneously, most of them are idle, it is some sort of web crawler it sleeps between requests for various reasons.
So as a result, my load ...
5
votes
1answer
928 views
How does a typical http(s) load balancer work?
I know that there are some situations that we encounter heavy http(s) load on a server and we should use a load balancer to distribute load among several back-end servers.
But I've a confusion here! ...
0
votes
1answer
508 views
Very high load average results in server lag
We have a CentOS 6.9 server, with 4 core CPU and 32GB RAM.
Everyday at around the same time the load average gradually changes from 0.0 upto 11 when we finally have to restart the server.
CPU: ...
0
votes
0answers
366 views
Linux Instance running Apache high System Load while low CPU and memory usage
I am running an Apache web server on AWS EC2 (c4.xlarge). My site's peak hour is during 8pm - 10pm. For some reason, during the peak hour, the system load just goes off to the roof, while CPU and ...
1
vote
1answer
1k views
Very High CPU load Low to Medium RAM usage on VPS (mysql over 100% CPU)
I'm on a VPS Virtuozzo server with:
8GB RAM
6 CPU
SSD Hard Drive
Debian 8.8
PHP 5.6.30
MySQL 5.5.55
There only one website that is served.
Its a wordpress with SSL enabled website with around 22000 ...
2
votes
0answers
198 views
How come website be random slow? Open sleep processes?
My website is randomly very slow by high MYSQL CPU, and I have no idea what the problem is. Hopefully I will come closer to the solution with this post.
If I check the mysql processes, I see a lot of ...
0
votes
2answers
380 views
e2fsck takes lot of time to run
I am running e2fsck on one of my disk partitions (ext4) but it seems to take eternity. It is already running now for almost 10 hours or so and it is still at 42%. The size of the partition is around ...
1
vote
0answers
38 views
Unexplained load on linux vm - not processor, disk io / disk sleep
I have a 2 processor server with Centos7 that's showing unexplained bursty load. top, htop report matching load averages to the graph below but processes do not show up any matching load. No Ds in the ...
5
votes
3answers
4k views
High CPU usage without useful information from top command
Over the past 2 days I started having problems with a server which has a few users on it. The server is an OpenVZ VPS. Normally when I experience high CPU usage, I always use top command to find out ...
0
votes
1answer
225 views
High load and ram usage on rackspace server
Running an 8 GB General Purpose v1 Ubuntu / NGINX server on Rackspace and received notification average load was reaching near its peak. Ram usage is also high.
We have multiple sites running on ...
1
vote
1answer
102 views
Varnish load balancing - does all data flow through varnish making it a bottleneck
When using varnish as a load balancing server, does all data flow through the single varnish load balancer thus bottlenecked by upload speed on well optimized websites serving thousands concurrent ...
-1
votes
1answer
186 views
Server with very high load
I have a problem with my server, which hosts several sites with circa 400 concurrent visits at peak time.
The problem is that every few hours the load of the server gets very high for a minute or so, ...
2
votes
2answers
1k views
FreeBSD shows high load, cannot find bottleneck
So we have set up a server(11.0-RELEASE-p2) that hosts around 150-200 jails. The server has 24 cores and 192gb of ram. When using top it shows no sign of stress - except the high load. All jails ...
0
votes
2answers
469 views
CPU usage spikes when calling website
I have a quick question for something I couldn't find while searching. I'm a total server noob so please don't get angry.
When I track CPU usage using ssh top I can the user process causing about 20 ...
-1
votes
2answers
243 views
Why there are so many “ss” process on my server (CentOS with nginx serving the web)?
There are about 500 concurrent users. It's because some famous people on social network repost a link.
This happened before. And our server were performing good.
But this time, the server is getting ...
6
votes
2answers
5k views
High system interrupt rate
My server has 24 CPU cores, 96G memory, installed CentOS 7.2 x86_64.
After starting my program with a large data set, my program will use about 50G memory, and the Linux system will show a high rate ...
0
votes
1answer
139 views
Is it safe for a server running an http API to have 100% CPU usage?
I have an API (based on php, and connecting to separate mysql database server) that is called lots of times, and the software that is calling it can wait for the result for a long time and it will not ...
0
votes
1answer
69 views
Apache increasingly eats resources until restarted
My apache2 (Ubuntu 12.04) over some (variable) period of time comes to unusual system resources utilization.
I'm positive that I don't have that amount of traffic and dos/ddos are pretty much out of ...
0
votes
0answers
112 views
Will the load average of my Linux box increase if it reaches file descriptors or TCP connections limit?
Will the load average of my Linux box increase if it reaches file descriptors or TCP connections limit ?
-1
votes
1answer
87 views
How to upgrade 2 years old server? [closed]
Two years ago I bought a server with the following characteristics:
Platform: Supermicro X9SRi-F Motherboard
RAM: 8*8GB ECC 2133 DDR4 Reg (64GB)
CPU: Intel(R) Xeon(R) CPU E5-2660 v3 @ 2.60GHz 10 ...
22
votes
6answers
3k views
Why is response time exploding when request frequency drops?
Correction: response time (%D) is Ī¼s not ms! 1
This doesn't change anything about the weirdness of this pattern but it means that it is practically way less devastating.
Why is response time ...
0
votes
2answers
743 views
KeepAlive on or off for a server handling almost exclusively a single request per client?
The Apache in question is running on a Ubuntu-EC2 instance. It basically handles about a million requests per hour. Essentially a client will POST a JSON and that's it - so an interaction of a client ...
2
votes
3answers
785 views
How to detect if Apache is (on the verge of) being overwhelmed by requests?
I'm maintaining and planning an EC2 server instance running Apache2 on Ubuntu which receives currently up to about 10000 (very simple) requests per hour. It's just some data coming in by POST and a ...
-1
votes
2answers
70 views
How can I handle heavy Database interaction at peak hours? [duplicate]
We run an application more like competition organizing websites like HackerEarth.com, HackerRank.com. When the tasks start, we see huge load on our server. The problem is, we need to interact with ...
