Questions tagged [ulimit]
The ulimit tag has no usage guidance.
182
questions
0
votes
0
answers
25
views
Understanding ulimits / process limits, or maybe something else. New processes stop opening (fork errors)
I'm a little bit lost and need some help understand what exactly is happening with my server.
So this is a Proxmox (Debian) server with several LXC containers running in it, and from time to time ...
- 1,001
0
votes
0
answers
42
views
haproxy "max open files" reduces automatically after startup
I was trying to fix the following error being logged by haproxy...
Proxy https-in reached process FD limit at 544. Please check 'ulimit-n' and restart
...and added LimitNOFILE=1024 in haproxy's ...
- 479
0
votes
0
answers
300
views
What is the maximum Ulimit -n open files we can configure in Linux?
I'm doing load test using Gatling, For my business requirements i have to process more than 30 lakhs request. I'm using redhat operating system machine (16gb 4 core) for my testing. I have ...
- 101
0
votes
1
answer
109
views
why OS can't automatically manage soft limit?
Yesterday oracle user had an error when he tried to login via ssh "error: do_exec_pty: fork: Resource temporarily unavailable". After I increased nproc soft limit he logged in. Then I ...
- 1
1
vote
2
answers
1k
views
Wildfly : Too many open files
We recently got a "too many open files" error in our production Wildfly 17 on debian 9. A simple restart of the wildfly service got rid of the error but I'd like to avoid the problem to come ...
- 321
0
votes
0
answers
1k
views
"ulimit -r unlimited" in docker image. "cannot modify limit: Operation not permitted"
I'm trying to set my real-time priority to unlimited on my CentOS 7 (CentOS Linux release 7.9.2009 (Core)) image running in Docker.
I'm executing (as root):
ulimit -r unlimited
I'm receiving the ...
0
votes
1
answer
1k
views
How to setup HAProxy for more than 500,000 connections running inside a Docker Container on a Linux host?
I'd like my HAProxy Load Balancer to be able to handle at least 1M connections. I need this to deploy a stress test.
I tried setting:
maxconn 1000000
in my haproxy.cfg but HAProxy failed to start ...
- 103
0
votes
1
answer
3k
views
CentOS: ulimit hard/soft limits keep reset to default values
On CentOS7 I am trying to change the values of ulimit as following:
ulimit -Hn 262144
ulimit -Sn 100000
But the value is being reset to its default values just after signing out:
[root@server001]# ...
- 127
2
votes
1
answer
3k
views
CentOS7: su /bin/bash: Resource temporarily unavailable
Whenever I try to change to testuser, I get resource temporarily unavailable message. The nproc and nofile limits are set to 65k. testuser runs multiple java programs.
Did not exceed the nproc and ...
- 21
0
votes
1
answer
2k
views
/etc/profile[278]: ulimit: 1048576: limit exceeded [Operation not permitted] [closed]
[root@bteir airwide]# su - ins
Last login: Wed Aug 12 22:31:40 CDT 2020 on pts/0
/etc/profile[278]: ulimit: 1048576: limit exceeded [Operation not permitted]
ins ins>
This log is kept on writing ...
6
votes
2
answers
12k
views
It should be set to 65000 to avoid operational disruption
I'm following Taking Solr to Production | Apache Solr Reference Guide 8.5, however unable to overcome warning while restarting solr service:
# service solr restart
*** [WARN] *** Your open file limit ...
- 13k
0
votes
1
answer
1k
views
Hitting a process limit, but unsure how
I run a server, mostly for using with random Docker containers and as a Gitlab-CI runner. Every once in a while, when the server has been running for a week or so, I run into process resource limits.
...
- 161
1
vote
0
answers
2k
views
How to interpret the number of open and max file descriptors for nginx?
I want to get the currently open file descriptors and upper limit of open file descriptors on an AWS Linux instance. The reason is to determine whether to increase the limits for nginx to have enough ...
- 215
1
vote
0
answers
658
views
Cannot login with root after change limits.conf
I have changed my /etc/security/limits.conf and now cannot log in with root.
I do NOT have physical access to server console.
I DO know the root password.
I have tried:
ssh root@localhost 'echo "...
- 61
0
votes
1
answer
8k
views
Increasing ulimit open files not applied in RHEL 8.1
I have a fully-updated Red Hat Enterprise Linux (RHEL) 8.1 x86_64 system where, as a local user in a local terminal (i.e. not remotely via SSH), when I run ulimit -Sn it says 1024 and ulimit -Hn ...
- 845
0
votes
1
answer
863
views
Increase open files limit of systemd service
I have systemd running inside a docker container and I'm trying to set Number of File Descriptors limit for the service. I set the limit on the docker container to 262k, but for some reason the /sbin/...
- 111
1
vote
1
answer
230
views
OS limits ignored by bamboo
Our developers wants bamboo because of integrations to other Atlassian software and we have regularly problems with this buildserver. Often the buildjobs fail with OutOfMemory exceptions like this:
...
- 496
0
votes
1
answer
72
views
for what need i max open file for service like mysql
For what reason do I need max_open_files for a service like mysql?
I'm using one tomcat istance and only the tomcat service has access to my mysql databases.
For my tomcat istance 20 users have access ...
- 67
0
votes
1
answer
2k
views
Docker failed to start
Today I have an issue with docker, It stopped and I cannot start it
systemctl status docker
● docker.service - Docker Application Container Engine
Loaded: loaded (/usr/lib/systemd/system/docker....
- 113
3
votes
0
answers
3k
views
Permission issue preventing increase in Open Files Limit in Ubuntu
My Digital Ocean droplet's ulimit -n yields 1024. Now it's a dedicated machine with Ubuntu 16.04, 32GB Ram, 16 Cores. I want to crank it up to 65535.
The problem:
I followed a bunch of steps to ...
- 2,263
0
votes
2
answers
417
views
Managed hosting, VPS & RAM - Virtual Memory?
I'm talking to a web host that's just starting up. They have shared hosting and managed VPS's. With shared hosting I understand that they have a script checking if a process goes over memory limits ...
- 246
3
votes
1
answer
3k
views
"Too many open files" Apache error even with increased ulimit and sysctl
I'm load testing an Amazon Linux EC2 instance running Apache (event MPM) and PHP-FPM using Locust. When I run my load test with 200 users (~28 requests per second), everything is fine. When I boost ...
- 161
1
vote
2
answers
4k
views
Apache2 full CPU Usage after exiting with error ('unable to create worker thread')
I've got my Apache2.4 (mpm_worker) instance exiting with following log:
[Mon May 27 11:27:33.196177 2019] [core:warn] [pid 567365:tid 139765793668032] AH00045: child process 567368 still did not exit,...
- 61
1
vote
0
answers
59
views
Why open files limits set correctly on dedicated server but not on KVM machines?
I have set open files for all users on a dedicated server A in /etc/security/limits.conf like below:
* hard nofile 1048576
* soft nofile 983040
And in /etc/pam.d/common-session I have ...
- 583
1
vote
2
answers
2k
views
Is it safe to set a very high ulimit for a process?
I currently have the following entry in /etc/security/limits.d/90-nproc.conf based on Mongo DB's recommended ulimit settings.
mongod soft nofile 64000
mongod soft nproc 64000
I ...
- 584
3
votes
1
answer
5k
views
Changing ulimit on systemd
I've found this link, showing how to change the ulimits on systemd.
/etc/systemd/system/<servicename>.d/override.conf
[Service]
LimitNOFILE=49152
I found a website suggesting to change the ...
- 33
1
vote
0
answers
2k
views
why soft limit in /proc/{pid}/limits is different with ulimit -Sn
I found hard limit value in /proc/{pid}/limits match the output of ulimit -Hn while soft limit value doesn't
my example output:
tomcat@myLinux:/home/azhang$ ulimit -Sn
1024
tomcat@myLinux:/home/...
- 111
0
votes
1
answer
2k
views
Add LimitNOFILE on haproxy init script
I want to add open files limit to HAProxy 1.8 process to 1024576. But since I use version 1.8, I cannot add LimitNOFILE to init scripts, instead of systemd file. How can I add limitNOFILE to those ...
0
votes
1
answer
131
views
debian and yum packages - is there a way we can set max mem % and CPU % limits?
Is there a hard limit we can set on Debian and RPM packages? My thought is to put 20% CPU, 20% Memory and 200 MB Disk Usage hard limits. So the package can play within those limits and not beyond that....
- 105
1
vote
0
answers
486
views
change maximum number of open files for user on solaris 9
i need to change ulimit -n for the user permanently, on solaris 10 you can do
projadd -K "process.max-file-descriptor=(basic,8192,deny)" proj.files
but on solaris 9 projadd or projmod doesn't have -K ...
0
votes
1
answer
2k
views
ulimit for root keeps resetting
Using CentOS 6.6
In /etc/security/limits.conf I have set the following:
* soft nofile 65535
* hard nofile 65535
root soft nofile 65535
root hard nofile 65535
In etc/security/limits.d/90-nproc.conf ...
- 216
0
votes
1
answer
1k
views
Where does Linux get ulimit values for certain users?
I see that different users in my Debian system has different max open files limits. I read the post but would like to get some understanding of the details. I do not have any settings into /etc/...
- 101
6
votes
2
answers
2k
views
How to change stack depth limits in /etc/security/limits.d/ and have the changes apply to services at boot
My system
Series of Ubuntu 14.04.5 (x86_64) Servers, kept updated
My application required I increase stack depth for postgres
I created a file in /etc/security/limits.d/myapplication.conf
The ...
- 463
0
votes
1
answer
639
views
seting rtprio limit in system without PAM
I have minimal linux system without PAM (custom complied linux based appliance) and I want to set system wide (all users) rtprio to 99.
My idea is to do this with help of sysctl. But looking on ...
- 11
0
votes
1
answer
271
views
systemd DefaultLimitCPUSoft?
I discovered that on my Ubuntu 16.04 VPS a process is getting killed due to CPU usage.
Running ulimit -t shows 86400.
systemctl show | grep LimitCPU shows
DefaultLimitCPU=18446744073709551615
...
- 3
0
votes
1
answer
1k
views
RHEL setting a user specific max number of open files
I've set up below values in /etc/security/limits.conf in my RHEL machine.
* hard nofile 65535
@student hard nofile 100000
Is this the correct approach when setting a user specific max number of ...
- 211
1
vote
1
answer
2k
views
Where is default soft limit config file debian?
I have a process running as root that is capped to 1024 ( in reality lsof shows me up to 1031 for it) open files but I don't find the file to modify this limit.
Here is the output of cat /proc/PID/...
- 111
1
vote
1
answer
4k
views
Could not set limit for 'nofile' - "Operation not permitted" in a LXD unprivileged container
I am running a centos7 unprivileged LXD container on a ubuntu 17.04 host.
I have a problem setting ulimit for NOFILE inside the container, if it is running in unprivileged mode.
Bellow are the steps ...
- 17.1k
0
votes
1
answer
5k
views
unable to set higher ulimit value for max open files
On Ubuntu 16.04 AWS system with 32 GB ram and 4 CPU, the following commands fail,
root@ip-10-0-0-189:/home/ubuntu# sysctl -w fs.file-max=10000000 **(ten million)**
fs.file-max = 10000000
root@ip-10-0-...
- 103
2
votes
1
answer
2k
views
How to set max file descriptors for a container?
I want to run elasticsearch in a container (namely nspawn) and it requires the number of max file descriptors to be higher than the default 1024.
This is done, in the container, in the systemd ...
- 3,577
0
votes
1
answer
639
views
Ubuntu 16.10 Server MariaDB (MySql) open_file_limit won't go higher than 16364
I'm running on Ubuntu 16.10 (yakkety yak) with MariaDB 10.x and experience the very same issue as Ubuntu 16.04 Server MySql open_file_limit won't go higher than 65536 with one exception, my open ...
- 39
1
vote
0
answers
599
views
ulimit not reflected for Jenkins master which is running on Red Hat
I already saw "ulimit not reflected for jenkins slave" and the steps did not work for me. Please, help. I am using Jenkins on Red Hat and I have the same problem.
I set ulimit to 99999 and when I ...
- 29
0
votes
0
answers
239
views
Cannot login via ssh into CentOs machine after setting ulimit for open files to unlimited [duplicate]
I have set ulimit for open files on my centos machine by editing /etc/security/limits.conf post which I am unable to login into the machine.
This was the change made in /etc/security/limits.conf file....
- 101
0
votes
2
answers
4k
views
mpm_prefork:error (11)Resource temporarily unavailable: AH00159: fork: Unable to fork new process
After having some issues I have rebuilt my server on a new, clean Fedora 24 platform. It's a fairly busy server, and now when it starts up, I get a flood of these messges in apache's error_log:
[Thu ...
- 137
0
votes
0
answers
663
views
xtrabackup: too many open files (more than 1048576)
When using xtrabackup to backup a mysql database with lots of tables, the proces fails with Error 24: ‘Too many open files’.
This is a FAQ on the Percona website: https://www.percona.com/doc/percona-...
- 31
0
votes
1
answer
338
views
Linux - Open file inheritance
For testing, I've changed my global open file limit to 3000:
#sysctl -w fs.file-max=3000
fs.file-max = 3000
#cat /proc/sys/fs/file-nr
2016 0 3000
I've created some files:
i=1; while [ "$...
- 621
1
vote
0
answers
514
views
Nginx at startup does not have fd limit set in /etc/security/limits.conf
I have the following configuration for increasing the number of file descriptors available to processes of all users.
cat /etc/security/limits.conf
* hard nofile 65536
* soft nofile 65536
When the ...
- 111
1
vote
1
answer
1k
views
Centos Monit ulimit not working
Centos 5.9 I have set the below in /etc/security/limits.conf but when mMonit starts my processes the ulimit is still 1024. If I do ulimit -a it correctly shows 500000 as max open files. In /etc/sysctl....
- 173
1
vote
0
answers
315
views
Unable to access Ubuntu EC2 ssh, Connection to Server-IP Closed
My server was having error due to high traffic and it showed this message often when I access the website
Error: EMFILE: too many open files, open '/home/ubuntu/chat2/public/style.css'
at Error (...
- 111
18
votes
1
answer
14k
views
Ubuntu 16.04 Server MySql open_file_limit won't go higher than 65536
I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit.
Here's what I've done so far:
sudo nano /etc/security/limits.conf (reference)
* soft nofile ...
- 181