In computer networks, rate limiting is used to control the rate of traffic sent or received on a network interface.

learn more… | top users | synonyms (1)

2
votes
2answers
2k views

Nginx - What is does the nodelay option do when limiting requests?

With the nginx HttpLimitReq module requests can be limited by IP. However, I'm not understanding what the "nodelay" option does. If the excess requests within the limit burst delay are not ...
0
votes
0answers
12 views

Dynamic rate limiting in NGINX using map [duplicate]

It's pretty well documented that you can do something like: map $http_authorization $rate_unauthed { "" $binary_remote_addr; default ""; } limit_req_zone $rate_unauthed zone=repositories:10m ...
-1
votes
1answer
21 views

exim quota limiting SMTP per minute [closed]

I have tried to set a quota limit per minute in exim configuration over cpanel server for mail server use. I have code but it doesn't seem to work, SMTP connections still exceed the quota limit. What ...
0
votes
0answers
29 views

delay after 5 requests: rate limits? (and how to disable them)

I'm using the following configuration for my nginx server: upstream django { server unix:///var/www/example.com/django/ws/django.socket; } upstream io_nodes { ip_hash; server 127.0.0.1:8080; ...
1
vote
0answers
31 views

Rate limiting bots (specific IPs) in NGINX

I would like to rate-limit (but not block) various crawlers. Based on other examples of similar questions, I've come up with this: http { ## 10MB zone, 5 reqs per sec limit_req_zone $limit ...
1
vote
1answer
102 views

Debian exim4 rate limits

I try to limit on exim4 the outgoing mails per day per domain, i found this: acl_check_ratelimit: accept authenticated = * endpass ratelimit = 40 / 1d / per_rcpt / ...
0
votes
0answers
27 views

How to limit IP address if X amount of connections are made in certain time period?

Is there any solution that I can use in order to limit IP addresses depending on their connection. So in simple terms if a user connect to the site 60 times in a minute then block them for x amount ...
2
votes
1answer
32 views

Configuring RRL on a DNS server using BIND

I'd like to configure a DNS server to use Response Rate Limiting (RRL) to mitigate DNS DDoS attacks. Whatever, I have to configure it top use RRL with the 'slip' parameter at 2. I've made some ...
4
votes
2answers
1k views

using trickle to slow down browser

according to trickle's man page, http://linux.die.net/man/1/trickle i can limit the download speed of a process, e.g. trickle -u 10 -d 20 ncftp to Launch ncftp(1) limiting its upload capacity to 10 ...
0
votes
1answer
206 views

Logging HAProxy connection limiting

I have some simple connection and connection rate limiting in HAProxy: # Store IPs to limit connection rate stick-table type ip size 200k expire 5m store gpc0,conn_cur,conn_rate(10s) ...
0
votes
2answers
45 views

Massive blockingof ips done right

I run a website which is being abused every day with bots trying to send spam, not respecting robots.txt and so on. The biggest problem, however is repeating attempts to massively harvest website. ...
1
vote
1answer
3k views

Logstash, Kibana and email alerts

I am trying to setup email alerts using logstash. Right now it emails me EVERY time the pattern "Error" is parsed into my log file which can lead to a lot of unnecessary emails. I'd like to create a ...
1
vote
0answers
59 views

tc qdisc tbf - calculate sensible latency and burst from rate

I want to create a simple script that lets me limit the outgoing speed of an interface somewhere between 56k (modem speed) and 1MBit/s. I found that something along the following does the job: tc ...
2
votes
1answer
42 views

Postfix and smtpd_client_rate_limit to detect compromissed accounts

Some of our clients are administrators who need to send corporative messages to no more than 300 clients, specifying all of these clients together in the "To:" fields, instead of individual messages ...
0
votes
0answers
53 views

How to redirect to an other link when excess request (limit_req) with Nginx

I have been trying to limit the requests coming from a single IP address successful with module limit_req in Nginx. But now I want to redirect to an other web-page for showing some messages.How could ...
7
votes
2answers
3k views

How to rate-limit in nginx, but including/excluding certain IP addresses?

I'm able to use limit_req to rate-limit all requests to my server. However I'd like to remove the rate restriction for certain IP addresses (i.e. whitelist) and use a different rate restriction for ...
0
votes
0answers
163 views

tc-tbf rate limiting works on 100Mbit Ethernet, but not Gigabit ethernet, with Windows

I have a linux box I use as a firewall with Shorewall. I have traffic shaping enabled in order to prioritize traffic from one computer used for videoconferencing. My business has an upload speed of ...
1
vote
1answer
207 views

Nginx: How to limit request rate based on user agent

Trying to get the following behavior working in nginx A default rate limit of 1r/s for each ip when using a browser. A rate limit of 10r/s for bing and google spiders. Reject bad bots. Unfortunately ...
0
votes
2answers
262 views

Rate limit exim per user basis

How can I implement "rate limit" in Exim so that every user in my exim can send specific number of emails per day. List A of Users can send 100 emails per day and the list B of users can send 500 ...
1
vote
0answers
164 views

Linux Traffic Controller (Linux tc): hierarchical token bucket (htb) packet queue size

In my Linux router, I am using the following configuration to limit the rate of traffic towards port 44444 of a client in the LAN (client address is 192.168.10.2, connected through the router's eth1 ...
1
vote
1answer
171 views

Limit max bandwidth per IP

I have some partners, that uses one of my linux servers as a gateway. The problem is I need to limit bandwidth per client ip address on this gateway. My partners client ip ranges are not known to me. ...
0
votes
1answer
100 views

apache rate limit best practice

I have the following business scenario: 1. apache http server load balances client request to application servers via ajp 2. all the resource intensive work is done on application servers for each ...
0
votes
1answer
62 views

rate limit apache httpd server

I have an apache server that acts as a load balancer to pass off requests to tomcat application servers. I wish to rate limit the http access by ips, and potentially throttle requests, how can this ...
0
votes
0answers
28 views

Filezilla Throttle File transfer rate not user

Is it possible to throttle the file being transferred rather than a user. We have lots of users using the same username/pw and need to throttle each session. Is that possible?
0
votes
0answers
29 views

How to limit rapid-fire connections to HTTP port with iptables?

I'd like to prevent malicious bots from hitting my Apache server too quickly. A couple issues/problems: I don't fully understand the relationship between --limit and --limit-burst and how they work, ...
8
votes
6answers
14k views

Postfix throttling for outgoing messages

I need Postfix to send outgoing messages (from local PHP) with a certain rate. Say, one message in 120 seconds. Any messages exceeding this rate should be queued (delayed) and delivered later. ...
3
votes
2answers
2k views

How to rate limit outgoing SMTP connections for Postfix

I have a postfix instance running on a VM. The VM provider shuts us down if we exceed a threshold of SMTP connections per minute - something like 10. In a typical day we might send 1000 messages, so ...
2
votes
2answers
1k views

HAProxy stops accepting connections

I've been using HAProxy to loadbalance my appservers for many months without problems. Recently some traffic spikes have lead me to setting the maxconn parameter to rate-limit connections to my ...
0
votes
1answer
51 views

nginx rate limitinf unknown directive

I'm trying to set up a rate limit for bots using my website, but if i add limit_req_zone $binary_remote_addr zone=one:10m rate=1r/s; or anything of the sort to /etc/nginx/nginx.conf in the http ...
3
votes
3answers
1k views

Limit number of requests to a specific set of URLs by IP address

I am working on a site, which is going to allow downloads to users, there will be around 2,000,000 files which can be downloaded. We want to discourage people from crawling and taking all of these ...
0
votes
2answers
302 views

How to prevent nginx throttling conflicting with maintenance mode?

We use the HttpLimitReqModule nginx mondule for rate throttling and have found that it conflicts with our "maintenance mode" because both components are using http status code 503. When throttling is ...
1
vote
1answer
72 views

Relax ssh rate-limit rules for certain ip addresses

We've written some tools to automate common development tasks. One tool, for example, ensures all our git repositories are up-to-date. For this to work, our tool needs to connect to our git server and ...
0
votes
1answer
274 views

Linux Traffic Shaping with “tc”: QoS filter for requests directly on the host not applied?

I'm trying to reduce the interface thoughput to debug my application on slower network speed. I've remembered a tc statement to do this on a interface which was working in the past. I used it on a ...
3
votes
1answer
2k views

Nginx $http_x_forwarded_for not always being set

I've noticed in our access logs that sometimes, the $http_x_forwarded_for variable has not been set, and instead, the correct IP is the one set to $remote_addr. Is it possible to set ...
1
vote
1answer
271 views

nginx 301'ing limit_req rate limited requests instead of error page

I have a bulk search form on apache servers behind nginx. I'd like to protect that location so that the second request in a 10 minute period gets 301'd to a "Would you like to use our API" page ...
-3
votes
1answer
132 views

Google-style “Your network is generating too much traffic” bounce for postfix

I'm being attacked from a botnet and I found out about it because I got this email from mailer-daemon telling me there's no space left on device. The mail.log was filled up with messages like Dec 5 ...
1
vote
0answers
134 views

nginx and cloudlfare ip confusion?

I am using the below config in http block of my nginx.conf to get real ip while using Cloudflare acceleration service: ## Cloudflare settings to get Real IP's set_real_ip_from ...
2
votes
1answer
113 views

Protect a public-facing PostgreSQL server against abuse

I have a Postgres database containing public information that I'd like to expose to the internet, for anyone to use. What steps can I take to prevent: Excessively expensive queries that could hog ...
-1
votes
2answers
237 views

Nginx Rate Limiting by Referrer?

I've successfully set up rate limiting on IP addresses like so, limit_req_zone $binary_remote_addr zone=one:10m rate=1r/s; But I was wondering if its possible to do the same on referrers? For ...
0
votes
1answer
1k views

How efficient is iptables' hashlimit module?

I'm looking for a solution to rate-limit on an ip basis. How many packets can the hashlimit iptables module handle on a recent Intel x86_64 CPU core? 1.000/sec? 1.000.000/sec?
17
votes
1answer
10k views

NGINX - throttle requests to prevent abuse

The reason I want to do this is because users develop against our API with JavaScript, and some developers screw up and cause visitors to slam the server with AJAX requests. When this happens, I want ...
3
votes
0answers
523 views

Limiting bandwidth with hashlimit (e.g. kb/s — not connections!) doesn't work, though the man page says it should

According to the iptables-extensions man page hashlimit can do bandwidth limiting: "flows exceeding 512kbyte/s" => --hashlimit-mode srcip,dstip,srcport,dstport --hashlimit-above 512kb/s ...
2
votes
1answer
109 views

Mail server - limit connections on port 25 to 1 PC alone

I have a situation where only one PC on a network (network is behind a single public IP address) can connect to the mail server on port 25 (send out emails using Outlook, perform successful telnet ...
1
vote
1answer
71 views

lighttpd rate limits per directory

I'm creating a site with a large number of small tools. One is a tool which uses a Python cgi-script that interacts with the Natural Language Toolkit (nltk), which is disk and CPU intensive. I have ...
0
votes
1answer
100 views

Rate Limit Xen DomU Network Traffic

Is there a solid way to rate limit Xen DomU Network I/O Traffic? I found an answer on here using tc but I get this error: Object "qdisk" is unknown, try "tc help". I guess a solution to either of ...
2
votes
2answers
1k views

DNS query limit WinServer 2008R2

Situation: I am currently seeing a huge wave of incoming DNS requests arriving in burst of around 85 queries per 2-3 seconds from one IP. Then another IP sends a new wave and so on (currently my DNS ...
0
votes
1answer
1k views

Is using iptables to rate limit on port 80 considered wasteful?

I was thinking of adding the following rule to my IP tables: -A INPUT -p tcp -m state --state NEW -m recent --update --dport 80 --seconds 5 --hitcount 10 -j DROP -A INPUT -p tcp -m state --state NEW ...
1
vote
1answer
147 views

Will traffic control software cause tcp packets to be dropped

I am testing our client-server applications using NetLimiter which is a traffic control software. I found that, when client is receiving files from server and I use NetLimiter to set the download rate ...
0
votes
2answers
622 views

Dynamic throttling of bandwidth

I am planning on setting up streaming server. Streaming is done kind of like YT does it; there will be a large number of audio content and each user can listen to it right on the website. In order ...
0
votes
1answer
480 views

How to use limit_conn and limit_req modules of Nginx when it is behind HAProxy

I'm using limit_conn_zone (with limit_conn) and limit_req_zone (with limit_req) in Nginx which sits behind a HAProxy. They both run on the same host. I see whenever a limit is breached in Nginx ...