In computer networks, rate limiting is used to control the rate of traffic sent or received on a network interface.

learn more… | top users | synonyms (2)

9
votes
6answers
13k views

Postfix throttling for outgoing messages

I need Postfix to send outgoing messages (from local PHP) with a certain rate. Say, one message in 120 seconds. Any messages exceeding this rate should be queued (delayed) and delivered later. ...
1
vote
2answers
76 views

How to rate limit outgoing SMTP connections for Postfix

I have a postfix instance running on a VM. The VM provider shuts us down if we exceed a threshold of SMTP connections per minute - something like 10. In a typical day we might send 1000 messages, so ...
2
votes
2answers
1k views

HAProxy stops accepting connections

I've been using HAProxy to loadbalance my appservers for many months without problems. Recently some traffic spikes have lead me to setting the maxconn parameter to rate-limit connections to my ...
-1
votes
1answer
22 views

nginx rate limitinf unknown directive

I'm trying to set up a rate limit for bots using my website, but if i add limit_req_zone $binary_remote_addr zone=one:10m rate=1r/s; or anything of the sort to /etc/nginx/nginx.conf in the http ...
3
votes
3answers
925 views

Limit number of requests to a specific set of URLs by IP address

I am working on a site, which is going to allow downloads to users, there will be around 2,000,000 files which can be downloaded. We want to discourage people from crawling and taking all of these ...
0
votes
2answers
176 views

How to prevent nginx throttling conflicting with maintenance mode?

We use the HttpLimitReqModule nginx mondule for rate throttling and have found that it conflicts with our "maintenance mode" because both components are using http status code 503. When throttling is ...
1
vote
1answer
48 views

Relax ssh rate-limit rules for certain ip addresses

We've written some tools to automate common development tasks. One tool, for example, ensures all our git repositories are up-to-date. For this to work, our tool needs to connect to our git server and ...
0
votes
1answer
154 views

Linux Traffic Shaping with “tc”: QoS filter for requests directly on the host not applied?

I'm trying to reduce the interface thoughput to debug my application on slower network speed. I've remembered a tc statement to do this on a interface which was working in the past. I used it on a ...
1
vote
0answers
51 views

Debian exim4 rate limits

I try to limit on exim4 the outgoing mails per day per domain, i found this: acl_check_ratelimit: accept authenticated = * endpass ratelimit = 40 / 1d / per_rcpt / ...
0
votes
1answer
513 views

Nginx $http_x_forwarded_for not always being set

I've noticed in our access logs that sometimes, the $http_x_forwarded_for variable has not been set, and instead, the correct IP is the one set to $remote_addr. Is it possible to set ...
1
vote
1answer
118 views

nginx 301'ing limit_req rate limited requests instead of error page

I have a bulk search form on apache servers behind nginx. I'd like to protect that location so that the second request in a 10 minute period gets 301'd to a "Would you like to use our API" page ...
0
votes
0answers
99 views

Logging HAProxy connection limiting

I have some simple connection and connection rate limiting in HAProxy: # Store IPs to limit connection rate stick-table type ip size 200k expire 5m store gpc0,conn_cur,conn_rate(10s) ...
0
votes
0answers
70 views

Limit concurrent connections in nginx across multiple servers

I am running a download service with free and paid premium membership types. The free membership should be restricted to one concurrent download. I know how to accomplish this when only one server ...
-3
votes
1answer
103 views

Google-style “Your network is generating too much traffic” bounce for postfix

I'm being attacked from a botnet and I found out about it because I got this email from mailer-daemon telling me there's no space left on device. The mail.log was filled up with messages like Dec 5 ...
1
vote
0answers
83 views

nginx and cloudlfare ip confusion?

I am using the below config in http block of my nginx.conf to get real ip while using Cloudflare acceleration service: ## Cloudflare settings to get Real IP's set_real_ip_from ...
2
votes
1answer
67 views

Protect a public-facing PostgreSQL server against abuse

I have a Postgres database containing public information that I'd like to expose to the internet, for anyone to use. What steps can I take to prevent: Excessively expensive queries that could hog ...
0
votes
0answers
356 views

Is CSF's recommended Connection Tracking Limit (CT_LIMIT) of 300 connections reasonable?

CSF recommends setting CT_LIMIT to 300 to block small ddos attacks as per http://configserver.com/free/csf/readme.txt I Would like to enable this connection limiting / tracking via CSF, as I have ...
-1
votes
2answers
152 views

Nginx Rate Limiting by Referrer?

I've successfully set up rate limiting on IP addresses like so, limit_req_zone $binary_remote_addr zone=one:10m rate=1r/s; But I was wondering if its possible to do the same on referrers? For ...
0
votes
1answer
1k views

How efficient is iptables' hashlimit module?

I'm looking for a solution to rate-limit on an ip basis. How many packets can the hashlimit iptables module handle on a recent Intel x86_64 CPU core? 1.000/sec? 1.000.000/sec?
13
votes
1answer
8k views

NGINX - throttle requests to prevent abuse

The reason I want to do this is because users develop against our API with JavaScript, and some developers screw up and cause visitors to slam the server with AJAX requests. When this happens, I want ...
3
votes
0answers
373 views

Limiting bandwidth with hashlimit (e.g. kb/s — not connections!) doesn't work, though the man page says it should

According to the iptables-extensions man page hashlimit can do bandwidth limiting: "flows exceeding 512kbyte/s" => --hashlimit-mode srcip,dstip,srcport,dstport --hashlimit-above 512kb/s ...
2
votes
1answer
94 views

Mail server - limit connections on port 25 to 1 PC alone

I have a situation where only one PC on a network (network is behind a single public IP address) can connect to the mail server on port 25 (send out emails using Outlook, perform successful telnet ...
1
vote
1answer
56 views

lighttpd rate limits per directory

I'm creating a site with a large number of small tools. One is a tool which uses a Python cgi-script that interacts with the Natural Language Toolkit (nltk), which is disk and CPU intensive. I have ...
0
votes
1answer
64 views

Rate Limit Xen DomU Network Traffic

Is there a solid way to rate limit Xen DomU Network I/O Traffic? I found an answer on here using tc but I get this error: Object "qdisk" is unknown, try "tc help". I guess a solution to either of ...
1
vote
2answers
806 views

DNS query limit WinServer 2008R2

Situation: I am currently seeing a huge wave of incoming DNS requests arriving in burst of around 85 queries per 2-3 seconds from one IP. Then another IP sends a new wave and so on (currently my DNS ...
0
votes
1answer
830 views

Is using iptables to rate limit on port 80 considered wasteful?

I was thinking of adding the following rule to my IP tables: -A INPUT -p tcp -m state --state NEW -m recent --update --dport 80 --seconds 5 --hitcount 10 -j DROP -A INPUT -p tcp -m state --state NEW ...
1
vote
1answer
109 views

Will traffic control software cause tcp packets to be dropped

I am testing our client-server applications using NetLimiter which is a traffic control software. I found that, when client is receiving files from server and I use NetLimiter to set the download rate ...
0
votes
2answers
419 views

Dynamic throttling of bandwidth

I am planning on setting up streaming server. Streaming is done kind of like YT does it; there will be a large number of audio content and each user can listen to it right on the website. In order ...
0
votes
0answers
102 views

Dovecot: Limit time between connects?

some of my Postbox users are checking mail every 10 or 20 Seconds. It is somehow possible configure Dovecot to limit the time between every login to 1 minute?
0
votes
1answer
372 views

How to use limit_conn and limit_req modules of Nginx when it is behind HAProxy

I'm using limit_conn_zone (with limit_conn) and limit_req_zone (with limit_req) in Nginx which sits behind a HAProxy. They both run on the same host. I see whenever a limit is breached in Nginx ...
2
votes
1answer
177 views

Best way for automated ban / throttle of aggressive clients on a Linux / Apache webserver for a period of time?

I notice occasional spikes on my server load and when I check access logs I notice a pattern for some automated forum poster that tries to repeatedly access a comment/reply URL. What would be the best ...
3
votes
2answers
1k views

nginx rate limiting with X-Forwarded-For header

I'm looking into rate-limiting using nginx's HttpLimitReqModule. However, requests are all coming from the same IP (a loadbalancer), with the real IP address in the headers. Is there a way to have ...
0
votes
2answers
946 views

Incoming rate limiting

I have a ubuntu machine with two interfaces. eth1 is the NAT interface and eth2 is the WAN iterface. I have a 4 mbps internet connection. I want to limit it to 2 mbps for the eth1 NAT network. So I ...
2
votes
1answer
366 views

Reasonable rate limiting settings with PF firewall

I have the following settings in my pf.conf to dissuade abusive clients (I get a few a day that are obviously just scraping content indiscriminately and slow everything down): pass in on $ext_if ...
0
votes
1answer
1k views

e-mail ratelimit exim

Server1 sending to Server2: Connecting to domain.com [1.1.1.1]:25 ... connected SMTP<< 451 Temporary local problem - please try later SMTP>> QUIT LOG: MAIN SMTP error from remote ...
1
vote
0answers
133 views

How to slow down ftp upload on windows 7

I have an application that uses ftp on windows 7 or 8 and it fails trying to upload a file (time out, server sends back RST packets so it's definitely the server that's unhappy) to a specific server. ...
-1
votes
2answers
375 views

How to rate limit per MAC address?

I need to rate limit an API server. Is it possible to configure a machine to rate limit requests per MAC address? If not, are there any other viable options? I want to rate limit per MAC, because ...
1
vote
2answers
161 views

Easy Apache module to throttle requests based on machine load?

I have an Apache server that is serving a django application with mod_wsgi. I'm wondering if there is a simple way to throttle requests at the apache level based on the machine's load. Ideally I want ...
1
vote
1answer
179 views

ICMP rate-limit on time-exceeded messages

How can I set ICMP rate-limiting in a Cisco router? Here on the manual page they only talk about ICMP unreachable messages: ip icmp rate-limit unreachable [df] [ms] [log [packets] [interval-ms]] ...
2
votes
0answers
914 views

VLAN based rate limiting using tc

I have been trying to perform VLAN based rate limiting on an academic project I am working on. The project uses Openflow (with Beacon controller) and the network is emulated using Mininet. The network ...
5
votes
1answer
561 views

Mysterious bandwidth limit

For some unknown reason, our server box running Windows Server 2008 R2 has a per connection bandwidth limit of 0.2 MB/s. Meaning, while one TCP connection can pull at max 0.2 MB/s, 60 parallel ...
0
votes
4answers
973 views

How to tune Linux kernel to withstand DDoS? (HAProxy)

Please do not reply with "this is not possible", as it's waste of time. I am developing cloud appliance and I have a valid reason to protect this layer against DDoS, and there are few companies doing ...
1
vote
2answers
627 views

What is the main difference between iptables and EC2's “security groups”?

If I block traffic via a security group, I assume I don't have to pay for it. But if I block traffic via iptables installed on my server then I assume it would be me that pays for any incoming ...
6
votes
3answers
3k views

Rate limiting with UFW: setting limits

UFW's man page mentions that it can setup iptables rate limiting for me: ufw supports connection rate limiting, which is useful for protecting against brute-force login attacks. ufw ...
2
votes
1answer
232 views

How can I prevent postfix from sending thousands of emails?

I have a Django installation that is configured to email administrators (five of us) whenever an error occurs. All of the generated emails are directed to postfix and then on to the mail server for ...
-1
votes
1answer
811 views

squid proxy 2.7 limit bandwidth [closed]

I have a squid 2.7 proxy and i'm letting some friends use it for fun in school etc. However since i got a bandwidth limit on my vps that is hosting the proxy I need somehow to throttle the amount of ...
2
votes
1answer
1k views

How soon does nginx's token bucket replenish when limiting at requests per minute?

We've decided that we want to experiment and limit requests per minute instead of requests per second on our sites. However, I am confused by the burst parameter in this context. I am under the ...
3
votes
3answers
987 views

Throttle connections to web service if load gets too high?

I have a web site that communicates via XMLRPC with an XMLRPC server web service. (The web service is written in Python using xmlrpclib.) I believe that xmlrpclib will block while it is handling one ...
3
votes
1answer
1k views

Rate Limiting with HP ProCurve 5406 QOS

Is it possible to enable an absolute value rate limit using QOS on a HP ProCurve 5406 switch for a particular IP address on a specific port? We have a 10Mbps head end connection for multiple ...
2
votes
1answer
1k views

Rate Limiting Outbound E-mail Message on a WHM/cPanel/Exim/CentOS 5 system. .

I have a client who is using Interspire e-mail marketer to send out his e-mail messages, and this guy sends something like 100,000 e-mails per session and does this around 3-4 times per month. He's ...