Questions tagged [high-load]

All aspects of high-loaded systems development and maintenance.

Filter by
Sorted by
Tagged with
0 votes
1 answer
76 views

How multiple load balancers work

Assume we face x requests per seconds, where x is magic number of requests which single load balancer cannot handle. So we have to use multiple load balancers to handle all requests, yes? But how? I ...
Szyszka947's user avatar
0 votes
1 answer
89 views

How to handle kubernetes workload crash-loop under load

Here is what I consider a quite generic situation for which I'm not sure what the best solution is. Consider you have a k8s workload where pods need 10-30seconds to be Ready. If at some point you get ...
mveroone's user avatar
  • 474
1 vote
1 answer
68 views

Find High Load Culprit (Apache) on CentOS 7

I have a CentOS 7 server on AWS w/ 4 CPU and 8 GB RAM. Starting late last week I started getting HIGH load spikes several times a day w/ Apache appearing to be the culprit. It's fully up-to-date w/ ...
Joel Firestone's user avatar
0 votes
1 answer
884 views

Nginx cache for frequent and different requests

I have a service. This service has a GET handle(/api/v1/retrieve_blocks). This handle's requests and responces are small, no more than 1024 characters. regular situation: this handle is constantly ...
сергей прудников's user avatar
1 vote
1 answer
397 views

nginx container uses only one out of 4 cores

created an Nginx container with 4 static CPUs docker run -tid --cpus 4 --cpuset-cpus 6,7,8,9 --net=host --name mynginx nginx docker exec -ti mynginx cat /etc/nginx/nginx.conf|grep worker_processes ...
ananthan's user avatar
  • 1,510
0 votes
1 answer
34 views

Stress Test Interpretation

I ran a basic stress test and am having trouble interpreting the results. Setup Super simple node.js API (returns a string for a GET request) deployed on heroku's free tier Increased RPS until I ...
stk1234's user avatar
  • 99
0 votes
1 answer
492 views

Postgres process spawns taking up CPU resources

Do you know why PostgreSQL would spin up a single process using a random command/name and then eat up CPU and memory? Killing the process does not effect the Django application which is utilizing ...
TheLegendaryCopyCoder's user avatar
0 votes
1 answer
564 views

Very low memory usage during heavy load test

I have a wordpress website wich I did a heavy load test on. As you can see below the CPU usage is of course high but at the same time the RAM usage never goes higher than 0,4%. The load test doesn't ...
deepbluecake123's user avatar
0 votes
1 answer
769 views

How to check what triggered high CPU usage on past days, on Digital Ocean?

I want to investigate what caused a high cpu usage for several hours on 1/16. Digital Ocean graph shows a prolonged high cpu usage in the course of about 12 hours. Is there a log somewhere that I can ...
user5248's user avatar
  • 103
1 vote
0 answers
474 views

High Load Average in Solaris Operating System - Due to high read I/O

In Linux OS, the load average is dependent on multiple factors like CPU utilization, number of uninterruptible sleep processes, and others. On the other hand, Solaris OS load average is dependent on ...
cybermizz's user avatar
2 votes
0 answers
408 views

MariaDB high %sys load on AMD compared to Intel

we have run into a issue with MariaDB and AMD Epyc 7402. We also have much less potent Intel servers that do not suffer from this problem, using exact same configuration (we are using ansible). Under ...
Integral's user avatar
0 votes
1 answer
158 views

linux system slowdown debugging, high sys usage

I have a remote linux system that became super slow yesterday. Since the remote luks unlocking I've setup doesn't seem to work reliable and I won't be able to physically access the machine within the ...
xogoxec344's user avatar
2 votes
3 answers
461 views

MariaDB crazy at 500% cpu time

GLOBAL STATUS MariaDB [(none)]> SHOW GLOBAL STATUS; +--------------------------------------------------------------+--------------------------------------------------+ | Variable_name ...
Mahmoud Moussa's user avatar
0 votes
2 answers
503 views

Distributing load over multiple load balancers

Given a website that could have many hundreds of thousands of concurrent users at peak times how can one manage the laod where load balancer resources can only support 40,000 concurrent connections? (...
user6916458's user avatar
0 votes
1 answer
390 views

Mysql High cpu load

I have a dedicated server with 48 cores, 128 GB of Ram, 2 nvme with RAID. I have a pretty large WordPress site with 5 GB of MySQL database. The concurrent traffic for the site is from 200 to 700 users....
Dev. Soliman's user avatar
0 votes
0 answers
327 views

High average load + low cpu usage + low disk usage + normal network usage + normal memory usage = ok or not?

I see high CPU average load several times a day on my server. For example, 21:20 and 22:45 on the following figure: However, my CPU, disk, and network are all OK: Disk Network CPU Memory Also do ...
ch271828n's user avatar
  • 143
2 votes
0 answers
437 views

High Docker disk read utilization on startup

My Docker server is very slow to start up. It's in Swarm mode, and each service restart (or just server reboot) it uses 100% of disk utilization, however it takes about an hour to start up. I tried ...
Piotr Maślanka's user avatar
0 votes
2 answers
678 views

Windows 10 VM pegs CPU at 100%

We have a Windows 10 VM with one vCPU and 8 gigs of RAM. It runs an HVAC design software that various users can RDP in and use. We've noticed that sometimes, the CPU will (seemingly randomly) max at ...
CacheMoney's user avatar
1 vote
2 answers
352 views

How to diagnose what Java process is doing in kernel space

We have a problem with one Spark (Java) application on our Hadoop cluster. When this workload gets scheduled on 3 machines in our cluster kernel space CPU usage gets a very high. Example recording ...
notaras's user avatar
  • 11
0 votes
1 answer
709 views

Nginx socket reverse proxy got 503 responses on concurrent requests

I am using Nginx as a reverse proxy for my PHP base WebSocket application and I try to load test the WebSocket server with Nginx reverse proxy. And I got 503 errors when concurrent users reach around ...
Set Kyar Wa Lar's user avatar
2 votes
1 answer
2k views

RDS MySQL Insights: Top Query "commit"

We are trying to reduce the load on our AWS RDS instance by going through the performance insights. The top SQL statement listed in the insight is "commit": In particular, the commit ...
Simon Ninon's user avatar
0 votes
0 answers
21 views

Using core affinity for Debian servers: isolate core to specific tasks?

I currently have an 8-core web server that is running into load problems due to heavy amounts of image processing--Imagemagick and other associated software will often spike the server's load up to 50+...
Casey Grimes's user avatar
4 votes
2 answers
804 views

CPU load for high performance computing

Is there a reasonable/safe level of CPU load in the context of high performance computing? I understand the meaning of load average for servers in general, but do not know what to expect for servers ...
ascendants's user avatar
0 votes
1 answer
828 views

Directadmin Warning The system load average is X

I am not a server guru, could somebody help me understand what part of my server is under load and what can I do to fix this? My best guess is too many connection to node server + mysql, becuse most ...
Exlord's user avatar
  • 101
1 vote
0 answers
254 views

PHP high I/O after a DDoS attack

I've had a large scale DDoS attack on my website. After I've enabled captcha challenge through CloudFlare and the attack stopped, PHP's I/O was still loaded at 99%, and the website was working very ...
HTMHell's user avatar
  • 173
1 vote
0 answers
1k views

How to improve performance of Nginx for high PHP processing load?

I wonder how I could improve the performance of my server? It is configured with Ubuntu 18.04 (LTS), 4 GB RAM, 100 GB SSD, 2 CPU, with Nginx 1.14.0 and PHP 7.2-fpm to handle running and serving a site ...
C.A. Vuyk's user avatar
  • 632
3 votes
1 answer
2k views

High CPU Load and High I/O wait time : Mysql process

i am fairly new to the role and the technology. we have a Network server that receives the telemetry data from sensors and temeletry data is stored in MYSQL dabatase. we have a front end portal which ...
cjonnala's user avatar
8 votes
3 answers
2k views

How to tune TCP for high-frequency connections between two nodes

I've been scratching my head for the past few days, trying to come up with a solution for the following problem: In our data center we have a F5 running on BigIP hardware that acts as a single ingress ...
Christoph's user avatar
  • 203
1 vote
2 answers
378 views

How to make high availability web page? [closed]

When we need a high availability service (it doesn't meter what kind of service: it can be a database, a queue system, our application) we spread it info many machines to make sure when one machine is ...
Simon's user avatar
  • 109
0 votes
1 answer
73 views

Is it considered "safe" to run a task with high I/O on a server for 3 days straight, or would you add pauses in it?

I want to hash the contents of 4 million JPEG files taking up 32TB of a 48TB RAID6 partition in CentOS 7. It's a Hetzner SX131 10 x 6TB box. Having run a test on 10,000 files I think the full job is ...
Codemonkey's user avatar
  • 1,086
0 votes
1 answer
115 views

Load is 4000, CPU flatlined, remote reboot does nothing

I have a Debian 9 server and the load is over 4000. "top" claims there are 18,132 processes sleeping. Initially, I saw many "ps" processes, hundreds, so I killed them all by name. I don't see any ...
Corepuncher's user avatar
1 vote
1 answer
253 views

How do I know if my linux server can't keep up with network traffic and what to do about it?

Suppose I have a web-server serving html-pages under high load. Let's assume that for some reason the bottleneck is not cpu, not ram and not disk but rather the network itself. How can I tell that a ...
Gherman's user avatar
  • 145
1 vote
0 answers
2k views

Wordpress Cause Too Many Child Process and Very High CPU Load

I have a WordPress site with daily 25K visitor, +3K post and +22K comment. on a VPS with 2 CPU and 8 GB Ram with SSD disk, Centos installed. it was stable but from 20 days I found a very high CPU load ...
Ahmad's user avatar
  • 11
0 votes
0 answers
41 views

Need to correlate ps and load average

Let's say that I have 4 CPUs. In that case, load average should not go beyond 4 for better performance, it means only 4 threads can be run at a time (i.e., only 4 should be in R status in ps output). ...
KALAI SELVAN's user avatar
-1 votes
1 answer
176 views

LAMP stack with AWS performance [duplicate]

I am planning to move my LAMP stack to AWS as the number of users increases. Current estimations suggest, that the Server has to handle roughly 100.000 users accessing the static landing page, out of ...
mo_st's user avatar
  • 39
0 votes
1 answer
975 views

Testing Concurrent Users using Jmeter

If I have to load test an app for 40,000 users per hour with each user's average spent time of one minute then what should be my test approach? Will running a test for 666 Threads/Users (40000/60=...
Cedric's user avatar
  • 1
0 votes
1 answer
599 views

NGINX + PHP-FPM issues with burst requests

I have NGINX setup with PHP7.2-FPM and am having issues with burst requests. The average amount of active processes (fpm children) is 15. I have these settings (48 core server): listen.backlog = ...
user2693017's user avatar
0 votes
0 answers
22 views

Are Load Spikes During Setup Considered for Provisioning?

I have a developer running automated tests which spike above 50% during setup, as seen in the below image. He is arguing that the tests are unstable and difficult to troubleshoot, so downsizing is an ...
SeanVDH's user avatar
  • 101
1 vote
2 answers
9k views

mysqld taking 800% CPU since traffic increased on my site, how to fix

i have centos 7 x64 64 GB RAM and 500 GB of SSD dedicated server., And recently cpu usage was really high, $ uptime 13:50:30 up 169 days, 1:53, 1 user, load average: 37.48, 37.64, 33.60 so i ...
user avatar
0 votes
1 answer
38 views

VServer shutdown on high cpu load - normal?

I rented a VServer to perform some distributed computation tasks. Unfortunately I had to notice that after some minutes of almost full cpu load my vserver shut down. I also got an email, notifying me,...
Art1st's user avatar
  • 3
2 votes
1 answer
5k views

NGINX: Request Limit timeout behavior for queries in the queue (burst)

Currently, we have a queue size of 3000 requests. location /api/v2 { limit_req zone=bursted burst=3000; include /etc/nginx/proxy.conf; } The rate limit is 10 requests per second. ...
Piotr Gwóźdź's user avatar
0 votes
0 answers
106 views

Optimizing nginx with SSL for bot traffic without sessions

The service I run, cronitor.io, has a telemetry collection API that sees bursts of traffic around 1000rps. (overall baseline is much lower, call it 100rps) Most of our requests come from things like ...
Encoderer's user avatar
  • 267
0 votes
1 answer
3k views

Server load handling : One single batch request vs multiple requests

I was talking to a developer about different apis for create, update and delete and he was saying that it was better to have a single batch request to server to do operations like create, update and ...
Syed Suhail Ahmed's user avatar
0 votes
0 answers
70 views

How to migrate an established HTTPS-session from one server to another?

There are many HTTPS-servers (Nginx or Haproxy or something else?): single balancer, and multiple workers. Is it possible to migrate an established HTTPS session (with HTTP request headers already ...
user2743554's user avatar
-1 votes
2 answers
139 views

server average load exact formula

I was in assumption cpu average load is calculated depend on number of process in running state (R state) + process waiting for I/O ( D state). But today I noticed that server is showing high load ...
Sunil Bhoi's user avatar
5 votes
2 answers
7k views

Fast pinging without requiring the response [closed]

I am trying to measure one way latency between two machines and I would like to use ping to send ICMP packets from one machine to another. The interval between the packets should be 1 micro second (...
Grey's user avatar
  • 151
0 votes
0 answers
19 views

How high can server load be before sendmail would not be able to function anymore [duplicate]

I have a virtual server that runs multiple VPS on it, when we backup to a usb external hard drive the load increases to about 10 on the mail server with sendmail we get this in the log file rejecting ...
Sl33py's user avatar
  • 155
3 votes
3 answers
15k views

High load average, when should I be worried? [duplicate]

I have a server which runs a few hundred processes simultaneously, most of them are idle, it is some sort of web crawler it sleeps between requests for various reasons. So as a result, my load ...
AL-Kateb's user avatar
  • 333
5 votes
1 answer
1k views

How does a typical http(s) load balancer work?

I know that there are some situations that we encounter heavy http(s) load on a server and we should use a load balancer to distribute load among several back-end servers. But I've a confusion here! ...
Ehsan Khodarahmi's user avatar
0 votes
1 answer
925 views

Very high load average results in server lag

We have a CentOS 6.9 server, with 4 core CPU and 32GB RAM. Everyday at around the same time the load average gradually changes from 0.0 upto 11 when we finally have to restart the server. CPU: ...
NewServerGuy's user avatar

1
2 3 4 5