Questions tagged [useragent]
The useragent tag has no usage guidance.
63
questions
1
vote
1
answer
40
views
lighttpd 1.4.46+ serve specific file based on $HTTP["useragent"]
I have a lighttpd server version 1.4.46+ on Linux which serves file1.xml and file2.xml from htdocs directory as is. There are clients that request these files, each of those send a User-Agent header ...
- 13
1
vote
0
answers
106
views
Add some text to curl's user agent string? (i.e. curl with a UA that includes curl's default UA & my text)
I am writing a shell script which uses curl(1) to download files. By default curl will set a HTTP User-Agent (UA) to something like curl/7.74.0. I want to be a good internet citizen and set the UA to ...
- 31.1k
1
vote
1
answer
558
views
Excessive requests to /favicon.ico every few minutes from a single user
A significant fraction of the requests to my webserver over the last few months are from a single user requesting /favicon.ico:
# tail -n 3 access_log
XXX - - [24/Jan/2021:17:40:18 +0000] "GET /...
- 13
0
votes
2
answers
126
views
What is the point of a bot spoofing various ancient user agents while "GET / HTTP/1.1"?
I found the following interesting traffic in my apache log:
213.159.213.236 - - [16/Dec/2019:03:02:03 -0500] "GET / HTTP/1.1" 200 3797 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FSL 7.0....
- 103
0
votes
1
answer
829
views
keepalive_disable parameters nginx for particular useragent/browsers
I am using keepalive_disable in nginx conf
this requires for
Syntax: keepalive_disable none | browser ...;
Default: keepalive_disable msie6;
Context: http, server, location
Now i have two ...
- 1
1
vote
0
answers
14
views
How to find userAgent of Google API callers?
I have a Google Cloud project that has YouTube API active through some known API Key. I am trying to find out the user agents of its callers in order to break them down by type (this is an old project ...
google-cloud-platform
1
vote
1
answer
1k
views
Nginx : whitelisting browsers
I'm trying to setup a whitelist of browsers allowed to visit a static website hosted by a nginx server.
I found in the documentation a reference to modern_browser directive.
It seems interesting but ...
- 11
2
votes
1
answer
1k
views
Getting "302 Found" even after redirecting to a specific file in the .htaccess
I have an Apache server hosted on an EC2 instance which points to a domain that I own. Now, what I essentially want to get done is that the web server should return a .json file when the user tries to ...
- 23
0
votes
1
answer
2k
views
Block website scraper in Haproxy
I am using Haproxy. I want to block scrapers from my website. In the haproxy.cfg , I have created a rule.
acl blockedagent hdr_sub(user-agent) -i -f /etc/haproxy/badbots.lst
http-request deny if ...
- 35
0
votes
1
answer
4k
views
How to whitelist User Agent string?
I'm trying to whitelist a very specific User Agent string in Nginx. The below examples demonstrate how to whitelist general types of browsers (eg mozilla or chrome), but the string I want to whitelist ...
- 211
1
vote
1
answer
2k
views
Does IIS Request Filtering Rules use Regex for the deny strings?
I'm trying to block user-agent X (literally, just "X") in IIS using Request Filtering Rules. We've done this in the past for other more specific user-agents without problems.
However, now that the ...
- 123
0
votes
1
answer
2k
views
Proxy changing my user agent build string
I'm making 2 connections to a web server. The first one is not using a proxy and the second one is using a proxy.
In the web server access.log I can see my user agent reported in two different ways.
...
0
votes
2
answers
79
views
Analyzing HTTP traffic [closed]
I am trying to solve the problem for a while and i couldn't find a proper answer online. I have a file with mobile traffic (from an Android device) and I am trying to check whether an http request is ...
- 101
0
votes
2
answers
451
views
nginx IF statement matches with non-alphanumerical characters
I'm trying to stop some pesky bots by blocking ther user agents in nginx. What is the best way to put multiple user-agents/matches in the same if statement when they have non-alphanumerical characters ...
- 101
2
votes
0
answers
140
views
iis doesnt compress content only for requests containing "/gecko/" in user-agent
Very weird behavior. My server returns gzipped response for all other requests.
in the images you could see that for user agent "/gecko/" the request is not gzipped and for "/gescko/" it is. i'm ...
- 123
2
votes
1
answer
2k
views
Block web requests based on a portion of the user agent string - Not working
I'm trying to block web requests based on if they contain any of a group of strings. As far as I can tell between my own knowledge and searching online, what I have is correct. However, I'm still ...
- 337
2
votes
0
answers
536
views
Very long useragent
We have requests in our server log with a very long useragent:
HEADER: user-agent=Mozilla/5.0 (Windows NT 6.1; WOW64; rv:32.0; WUID=4bddaa48430e60af6132822cd6fab6c4; WTB=2873; WUID=...
- 129
1
vote
0
answers
65
views
Identifying UserAgent strings that don't support TLSv1.1
I've created a tally from IIS logs of the last 18 months by User Agent string and created some Excel formulas to extract # of visits from XP/Vista machines using Internet Explorer.
Could someone ...
- 131
0
votes
1
answer
310
views
Azure VM Unwanted User-Agent Filtering/Blocking
I recently migrated our WP site to a Debian 8 VM running on Azure.
Since then, we are unable to process credit card payments through the RedSys payment gateway.
It seems that upon successful payment, ...
- 211
0
votes
1
answer
159
views
How to filter JS:ScriptIP-INF (TRJ) in BBClone Webstatistic
I`m using the webstatistic bbclone on my server.
In the last month my virus scanner sometimes blocks the details page.
it displays the detection of
JS:ScriptIP-INF (TRJ)
on my bblone. But I ...
- 185
0
votes
0
answers
350
views
nginx: parse UA and try_files by UA parts
What is given:
nginx version: nginx/1.9.3;
/var/www/site/js/site.chrome.js - code specific for chrome;
/var/www/site/js/site.firefox.js - code specific for firefox;
site.chrome.js and site.firefox.js ...
-3
votes
2
answers
105
views
Bombarded with hundreds of probably automated page refreshes every few hours
It seems like some Internet Explorer users are sending my web server hundreds of requests per minute (for a few minutes) to refresh the page with a user-agent like this:
Mozilla/4.0 (compatible; MSIE ...
- 189
0
votes
0
answers
1k
views
NGINX $http_user_agent cause 404 response
The following conditional when matching a user-agent with substring 'MSIE 8' causes a 404 redirect?
#Begin IE8 Hack
if ($http_user_agent ~* 'MSIE 8') {
#set $hack "I";
}
#End IE8 Hack
...
- 101
1
vote
1
answer
5k
views
Blocking UserAgent libwww-perl with .htaccess not working?
The server is running on Apache, and trying to block libwww-perl, but not sure why it's not working. I've put the following in my .htaccess, but when I run the test I still get the notification that ...
- 123
0
votes
1
answer
362
views
Windows Phone user-agents?
I've been analyzing my access logs and found two very different ways Windows Phones advertise themselves. Here are two examples for a Nokia Lumia 800:
Mozilla/5.0 (compatible; MSIE 9.0; Windows Phone ...
- 135
9
votes
1
answer
12k
views
Haproxy: reject traffic by user agent from file
I am trying to reject connections from specific user agents (by matching a substring of the user-agent header) using an haproxy ACL with -f option to read from a file. However it is not working, it ...
- 221
0
votes
1
answer
2k
views
NGiNX Custom Cache param based on regex match
My question(s) are as follows:
How do I set custom variables based on regexp against a useragent?
How do I set custom headers for the reverse-proxy request?
How do I use these values as caching ...
- 293
0
votes
3
answers
12k
views
user agent in http or https request
Is there any way that I can differentiate,
the HTTP or HTTPS packets are coming from browser or not ?
specially for https request.There is User-Agent field in packet in Http,but I could not found ...
- 201
0
votes
1
answer
4k
views
mod_security not blocking empty useragent requests
I can't get mod_security to block empty useragent requests. I am not very saavy with it so after searching I found this rule:
SecMarker BEGIN_UA_CHECK
SecRule &REQUEST_HEADERS:User-Agent "@eq 0" \...
- 51
0
votes
1
answer
1k
views
How to filter request using IP restrictions OR a filtering rule
We have an IIS site right now that has an allow list for a specific list of IP addresses, and all other IPs denied by default. We want to add another rule, that states that if the request coming in as ...
- 143
1
vote
0
answers
901
views
Nginx shows no user agent string
I have been dealing with an issue on one of my servers for quite a while now. In short, the server receives massive spikes in load - up to 50 - but the site gets almost no traffic. I know this can be ...
- 111
10
votes
2
answers
9k
views
Is this user agent string related to Safari?
Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit/536.26
(KHTML, like Gecko) GSA/3.2.1.25875 Mobile/11D167 Safari/8536.25
What's that "GSA" part?
I've tried to figure it out, but ...
- 515
0
votes
1
answer
271
views
Nginx: security vs conditionals
I was reading around looking for some security steps that can be taken in Nginx to protect apps I'm serving using Nginx as a reverse proxy. I found this code which has some good things in it to ...
- 163
1
vote
1
answer
3k
views
IIS not sending ASP.Net cookies to IE10 (and only to IE10)
I have IIS 7.5 server running ASP.Net application, which for some reason doesn't send ASP.Net authentication cookies to IE10. This happens only when request comes in from IE10 browser and only over ...
- 143
2
votes
3
answers
2k
views
Need Explanation of User Agent
I'm analyzing user agent field of different types of web server logs. Ex. Apache Access Log/W3C/iplant etc. I found some lines in the log files have following type of user agents. I'm confused since ...
9
votes
3
answers
27k
views
How can I block a user agent from all sites on my server?
I originally this posted at webmasters.stackexchange.com, but was told I'd get a better reception here.
For the last few days, I've been suffering from what appears to be a (presumably inadvertent) ...
- 914
3
votes
3
answers
12k
views
nginx not blocking user agents
I have this in my .conf file for my website in attempt to block 2 user agents from constantly probing my server.
## Block http user agent - morpheus fucking scanner ##
if ($http_user_agent ~* "...
0
votes
3
answers
316
views
How can I test for a URLs existeance before redirecting to it?
I am using Apache's mod_rewrite to redirect mobile users to my mobile site based on their http_user_agent. However not all pages have a mobile equivalent. Also mobile pages end in .html and "full" ...
- 2,758
-3
votes
1
answer
170
views
.htaccess user agents and website security [closed]
I have been looking around and trying to work out the best way to protect a few websites of mine.
Appart from the obvious manual monitoring of the site logs and banning extreme/suspicious activity. I ...
- 137
-1
votes
2
answers
418
views
Please deconstruct a user agent string for me
Okay I give up. Given the user agent string below, which browser is being used? It might be IE8, since I can't envision firefox sending this. If it is IE8, why the hell is the "Mozilla" string in ...
- 165
0
votes
1
answer
4k
views
NGINX MIME TYPE
I have my nginx conf file so that when ever a mobile device visits my site the url gets rewritten to m.mysite.com I did it by adding the following
set $mobile_rewrite do_not_perform;
if ($...
31
votes
1
answer
6k
views
illegitimate traffic from user agent Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)
This is a rapidly changing event that has no answer yet.
Please do not post your findings or assumptions as answers; reserve
the answer field for when you actually have an answer.
If you ...
1
vote
1
answer
355
views
Access Logs - Useragent changes after first request
Has anyone noticed Internet Explorer useragents changing in their access logs?
- - 12.345.6.789 - - [24/Feb/2012:15:59:59 -0800] "GET HTTP/1.1" 200 4759 "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT ...
- 161
0
votes
2
answers
15k
views
How to create .htaccess and block UserAgent libwww-perl?
I have been testing my website with a SEO checkup tool and one of the warnings I got was this:
Your server appears to allow access from User-agent Libwww-perl.
Botnet scripts that automatically ...
- 173
1
vote
2
answers
3k
views
How is a User Agent passed along from a load balancer?
I have an application that sits behind an F5 load balancer. The application needs to be aware of the User Agent and IP address of the inital request.
For example:
User Agent: Mozilla/5.0 (...
- 197
8
votes
1
answer
5k
views
Serve different files for specific user agents using nginx
Using nginx, how do you serve different static files for different user agents? For example, if the current user is using an iPhone, they should be served mobile_index.html, whereas all other user ...
- 225
2
votes
3
answers
2k
views
What is a SIP B2BUA, and how is it different from a UA?
I've been reading some stuff SIP related, and I'm confused, about what is a SIP back-to-back user agent(B2BUA) and a 'normal' user agent?
Can anyone explain the differences?
From what I read I can'...
- 143
7
votes
2
answers
23k
views
check several user agent in nginx
I need to redirect the traffic to one backend or another according to the user-agent. Is that the right thing to do ?
server {
listen 80;
server_name my_domain.com;
if ($...
- 518
1
vote
2
answers
2k
views
Search Engine Bot - Large amount of hits
I've started tracking user-agent strings on a website at the start of each session. Looking at the data for this month so far I'm seeing on search engine bot that keeps coming up a lot..
Mozilla/5.0 (...
- 307
4
votes
2
answers
5k
views
Blocking by user-agent string in httpd.conf not effective
I'd like to block some spiders and bad bots by user-agent text string for all of my virtual hosts via httpd.conf but have yet to find success. Below are the contents of my http.conf file. Any ideas ...
