Questions tagged [max-file-descriptors]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
77 views

Ubuntu 21.10 ulimit (open file descriptors) not applying correctly

The situation is strange because I have 2 identical servers with the same application but on one server i get a ulimit error from the custom application ulimit error: too many open files but on the ...
user avatar
  • 274
0 votes
0 answers
65 views

kafka + File handle leak due a large number of pipe/eventpoll leak

we have kafka cluster on linux rhel version - 7.6 we notice too many open files on kafka machines but when we did lsof >/tmp/res_file form file /tmp/res_file , we can see many lines as java ...
user avatar
2 votes
1 answer
309 views

Passing 8192 sockets via systemd socket activation - fails with E2BIG

I am trying to have systemd start up a daemon and pass it 8,192 listening sockets. I have a .service and .socket file that work reliably with a more "normal" number of listening sockets, ...
user avatar
  • 1,305
0 votes
1 answer
270 views

Does the maximum amount of open descriptors in a server include it's children?

I know that Linux limits the maximum amount of open descriptors, usually to 1024. Now say I need to create a server which will handle more than 1024 users, 2000 for example, without tampering with the ...
user avatar
  • 1
1 vote
1 answer
1k views

Where is default soft limit config file debian?

I have a process running as root that is capped to 1024 ( in reality lsof shows me up to 1031 for it) open files but I don't find the file to modify this limit. Here is the output of cat /proc/PID/...
user avatar
0 votes
1 answer
605 views

Ubuntu 16.10 Server MariaDB (MySql) open_file_limit won't go higher than 16364

I'm running on Ubuntu 16.10 (yakkety yak) with MariaDB 10.x and experience the very same issue as Ubuntu 16.04 Server MySql open_file_limit won't go higher than 65536 with one exception, my open ...
user avatar
  • 39
17 votes
1 answer
14k views

Ubuntu 16.04 Server MySql open_file_limit won't go higher than 65536

I'm running Ubuntu 16.04 Server on XenServer and I'm running into an issue with MySql's open file limit. Here's what I've done so far: sudo nano /etc/security/limits.conf (reference) * soft nofile ...
user avatar
  • 171
3 votes
2 answers
2k views

How to calculate ulimit -n (file descriptors) for a dedicated squid server

I have a production squid server that was having some issues serving content and reporting that it was out of file descriptors. I was successfully able to increase it from 1024 (default) to 4096 and ...
user avatar
2 votes
0 answers
811 views

socat Resource temporarily unavailable

I am using socat as a bridge between some devices and running socat (a couple hundreds of instances) like this: socat -d -d -d -x -d -lf "/var/log/some_log_file" TCP4-LISTEN:6126,fork,max-children=1,...
user avatar
0 votes
0 answers
546 views

How do I increase file descriptor limit in custom program

I'm writing a piece of server software in C++ and intend on having each instance manage 10k-20k simultaneous connections. I already have it functioning and able to handle plenty of remote connections ...
user avatar
  • 121
9 votes
1 answer
7k views

Default value of /proc/sys/fs/file-max

I am aware that /proc/sys/fs/file-max defines the maximum number of open file descriptors and can be set on runtime or during boot. However: what is its default value? Checking 10 servers in my ...
user avatar
  • 225
0 votes
0 answers
144 views

Monitoring via SSH cause max-file-descriptor notice

We have Solaris 10 servers at our company and we are using an monitoring application which polls the servers via ssh. Every time the polling is done we notice max-file-descriptor kern. notice on the ...
user avatar
6 votes
2 answers
43k views

mkdir: "no space left on device" on specific folders after Apache Tomcat reached max-file ulimit

The question: I have a tomcat running a java application that occasionally accumulates socket handles and reaches the ulimit we configured (both soft and hard) for max-open-files, which is 100K. When ...
user avatar
  • 253
2 votes
2 answers
3k views

Increase FD limitation then SSH not working?

I'm using CentOS 6.3 64bit, and having trouble with increase FD limitation: SSH not working after changed the limitation, every-times I logged on my server, after typed password, then "connection ...
user avatar
  • 121
2 votes
2 answers
4k views

Nginx's Too many open files, is setting of worker_rlimit_nofile enough?

Is setting the right value of worker_rlimit_nofile in nginx.conf enough solve the issue of Too many open files in nginx? Or do I still need to update the sysctl.conf and limits.conf?
user avatar
  • 5,341
5 votes
1 answer
8k views

How do you force a process to flush the data written to an open file descriptor under Linux?

I have a binary process (with no sources available) running on an embedded Linux system. The process opens a log file (/tmp/dmaosd.log) where it logs what it's doing. The problem is the log gets ...
user avatar
  • 435
5 votes
4 answers
9k views

How to increase max FD limit for a daemon process running under a headless user?

To increase the FD limit for a daemon process running under a headless user on a Ubuntu Linux machine we did following changes in /etc/security/limits.conf soft nofile 10000 hard nofile 10000 We ...
user avatar
9 votes
3 answers
19k views

Is there a maximum of open files per process in Linux?

My question is pretty simple and is actually stated in the title. One of my applications throws errors regarding "too many open files" at me, even tho the limit for the user the application runs with ...
user avatar
  • 213
4 votes
1 answer
2k views

Strace Apache process output showing 24 seconds wait?What can be the reason?

Performed strace on one one of the apache children and its showing 24 seconds between two system calls.How can i determine what is the cause of this behavior.It looks like both children are taking ...
user avatar
  • 1,470
16 votes
6 answers
48k views

Why (or how) does the number of open file descriptors in use by root exceed ulimit -n?

Our server recently ran out of file descriptors, and in regards to that I have some questions. ulimit -n is supposed to give me the maximum number of open file descriptors. That number is 1024. I ...
user avatar
  • 581
12 votes
4 answers
15k views

How can lsof report a higher number of open files than what ulimit says should be allowed?

How can lsof report more open files than what ulimit says is the limit? prod_web3(i-ca0b05aa):~$ sudo lsof | wc -l 4399 prod_web3(i-ca0b05aa):~$ ulimit -n 1024
user avatar
  • 1,507
2 votes
1 answer
3k views

Increasing file descriptor limit on Debian does not work! Help!

I am running Debian 6 and I am trying to increase the file descriptor limit but it does not want to work. This is what I have done: I edited /etc/sysctl.conf by adding fs.file-max = 64000 at the end ...
user avatar
  • 103
1 vote
1 answer
562 views

max file descriptors with nginx and IM erlang server

I'm using nginx for serving static files and as a proxy for an Erlang IM server. Each user is using two long-polling http connections. OS is ubuntu server. On peak hours I see: > sudo more /proc/...
user avatar
  • 121
1 vote
1 answer
4k views

Getting MongoDB to use max open file descriptors in /etc/security/limits.conf

I've got a MongoDB server that runs out of file descriptors for open connections. I changed the settings in /etc/security/limits.conf so that every user gets a hard and soft limit of 65000 of open ...
user avatar
  • 21
4 votes
3 answers
8k views

Squid running out of file descriptors on Ubuntu

I am running Squid 2.7 on Ubuntu 10.04 64bits. I had the problem of Squid running out of file descriptors, with the following error showing in /var/log/squid/cache.log: WARNING! Your cache is ...
user avatar
  • 373
1 vote
6 answers
6k views

Apache Crashes Every Night Due To "Too Many Open Files"

I am running a SmartMachine on Joyent. I beleive these are some sort of virtual machine running Solaris. We have a web application on this machine running on Apache, PHP, and MySQL. It handles our ...
user avatar
4 votes
1 answer
3k views

How does RHEL 5 (Linux kernel 2.6.18) determine the default fs.file-max setting?

If fs.file-max is not set in /etc/sysctl.conf on RHEL 5 or its derivatives, how does the kernel determine the default value? Is there a formula used to set the fs.file-max value based on the amount of ...
user avatar
7 votes
2 answers
34k views

How to configure linux file descriptor limit with fs.file-max and ulimit

Server applications running on linux often require large quantities of open file handlers, for ex. HBase ulimit, Hadoop epoll limit This wiki entry should serve as documentary for Linux file limits ...
13 votes
3 answers
31k views

How to track down a file descriptor leak?

I have a java process (Glassfish) which is leaking file descriptors. I know this because I get the helpful java.io.IOException: Too many open files exception. I can look in /proc/PID#/fd and see all ...
user avatar
  • 567
1 vote
1 answer
4k views

File-descriptors setting on /etc/sysctl.conf

I have recently learnt that to be able to increase the amount of virtualhosts that we can serve via Apache depends on file-descriptors. they say the value should be added to /etc/sysctl.conf as fs....
user avatar
  • 1,197
80 votes
5 answers
166k views

Practical maximum open file descriptors (ulimit -n) for a high volume system

We recently began load testing our application and noticed that it ran out of file descriptors after about 24 hours. We are running RHEL 5 on a Dell 1955: CPU: 2 x Dual Core 2.66GHz 4MB 5150 / ...
user avatar
  • 903