Questions tagged [useragent]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
1 vote
1 answer
123 views

lighttpd 1.4.46+ serve specific file based on $HTTP["useragent"]

I have a lighttpd server version 1.4.46+ on Linux which serves file1.xml and file2.xml from htdocs directory as is. There are clients that request these files, each of those send a User-Agent header ...
FearDC's user avatar
  • 13
1 vote
0 answers
151 views

Add some text to curl's user agent string? (i.e. curl with a UA that includes curl's default UA & my text)

I am writing a shell script which uses curl(1) to download files. By default curl will set a HTTP User-Agent (UA) to something like curl/7.74.0. I want to be a good internet citizen and set the UA to ...
Amandasaurus's user avatar
  • 32.2k
1 vote
1 answer
869 views

Excessive requests to /favicon.ico every few minutes from a single user

A significant fraction of the requests to my webserver over the last few months are from a single user requesting /favicon.ico: # tail -n 3 access_log XXX - - [24/Jan/2021:17:40:18 +0000] "GET /...
anon novice's user avatar
0 votes
2 answers
159 views

What is the point of a bot spoofing various ancient user agents while "GET / HTTP/1.1"?

I found the following interesting traffic in my apache log: 213.159.213.236 - - [16/Dec/2019:03:02:03 -0500] "GET / HTTP/1.1" 200 3797 "-" "Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1; FSL 7.0....
Logg's user avatar
  • 103
0 votes
1 answer
1k views

keepalive_disable parameters nginx for particular useragent/browsers

I am using keepalive_disable in nginx conf this requires for Syntax: keepalive_disable none | browser ...; Default: keepalive_disable msie6; Context: http, server, location Now i have two ...
Shoaib's user avatar
  • 1
1 vote
0 answers
18 views

How to find userAgent of Google API callers?

I have a Google Cloud project that has YouTube API active through some known API Key. I am trying to find out the user agents of its callers in order to break them down by type (this is an old project ...
Sagi Mann's user avatar
  • 111
1 vote
1 answer
1k views

Nginx : whitelisting browsers

I'm trying to setup a whitelist of browsers allowed to visit a static website hosted by a nginx server. I found in the documentation a reference to modern_browser directive. It seems interesting but ...
Dexer's user avatar
  • 11
2 votes
1 answer
2k views

Getting "302 Found" even after redirecting to a specific file in the .htaccess

I have an Apache server hosted on an EC2 instance which points to a domain that I own. Now, what I essentially want to get done is that the web server should return a .json file when the user tries to ...
jait's user avatar
  • 23
0 votes
1 answer
2k views

Block website scraper in Haproxy

I am using Haproxy. I want to block scrapers from my website. In the haproxy.cfg , I have created a rule. acl blockedagent hdr_sub(user-agent) -i -f /etc/haproxy/badbots.lst http-request deny if ...
Cyberzinga's user avatar
0 votes
1 answer
5k views

How to whitelist User Agent string?

I'm trying to whitelist a very specific User Agent string in Nginx. The below examples demonstrate how to whitelist general types of browsers (eg mozilla or chrome), but the string I want to whitelist ...
user421936's user avatar
1 vote
1 answer
2k views

Does IIS Request Filtering Rules use Regex for the deny strings?

I'm trying to block user-agent X (literally, just "X") in IIS using Request Filtering Rules. We've done this in the past for other more specific user-agents without problems. However, now that the ...
Effing's user avatar
  • 123
0 votes
1 answer
2k views

Proxy changing my user agent build string

I'm making 2 connections to a web server. The first one is not using a proxy and the second one is using a proxy. In the web server access.log I can see my user agent reported in two different ways. ...
Ivan Maria Spadacenta's user avatar
0 votes
2 answers
84 views

Analyzing HTTP traffic [closed]

I am trying to solve the problem for a while and i couldn't find a proper answer online. I have a file with mobile traffic (from an Android device) and I am trying to check whether an http request is ...
kobibo's user avatar
  • 101
0 votes
2 answers
463 views

nginx IF statement matches with non-alphanumerical characters

I'm trying to stop some pesky bots by blocking ther user agents in nginx. What is the best way to put multiple user-agents/matches in the same if statement when they have non-alphanumerical characters ...
alexwatever's user avatar
2 votes
0 answers
147 views

iis doesnt compress content only for requests containing "/gecko/" in user-agent

Very weird behavior. My server returns gzipped response for all other requests. in the images you could see that for user agent "/gecko/" the request is not gzipped and for "/gescko/" it is. i'm ...
Yuval Perelman's user avatar
2 votes
1 answer
3k views

Block web requests based on a portion of the user agent string - Not working

I'm trying to block web requests based on if they contain any of a group of strings. As far as I can tell between my own knowledge and searching online, what I have is correct. However, I'm still ...
d.lanza38's user avatar
  • 357
2 votes
0 answers
719 views

Very long useragent

We have requests in our server log with a very long useragent: HEADER: user-agent=Mozilla/5.0 (Windows NT 6.1; WOW64; rv:32.0; WUID=4bddaa48430e60af6132822cd6fab6c4; WTB=2873; WUID=...
wutzebaer's user avatar
  • 129
1 vote
0 answers
78 views

Identifying UserAgent strings that don't support TLSv1.1

I've created a tally from IIS logs of the last 18 months by User Agent string and created some Excel formulas to extract # of visits from XP/Vista machines using Internet Explorer. Could someone ...
Kevin Denham's user avatar
0 votes
1 answer
348 views

Azure VM Unwanted User-Agent Filtering/Blocking

I recently migrated our WP site to a Debian 8 VM running on Azure. Since then, we are unable to process credit card payments through the RedSys payment gateway. It seems that upon successful payment, ...
akseli's user avatar
  • 211
0 votes
1 answer
162 views

How to filter JS:ScriptIP-INF (TRJ) in BBClone Webstatistic

I`m using the webstatistic bbclone on my server. In the last month my virus scanner sometimes blocks the details page. it displays the detection of JS:ScriptIP-INF (TRJ) on my bblone. But I ...
Radon8472's user avatar
  • 185
0 votes
0 answers
373 views

nginx: parse UA and try_files by UA parts

What is given: nginx version: nginx/1.9.3; /var/www/site/js/site.chrome.js - code specific for chrome; /var/www/site/js/site.firefox.js - code specific for firefox; site.chrome.js and site.firefox.js ...
Dmitry N. Medvedev's user avatar
-3 votes
2 answers
112 views

Bombarded with hundreds of probably automated page refreshes every few hours

It seems like some Internet Explorer users are sending my web server hundreds of requests per minute (for a few minutes) to refresh the page with a user-agent like this: Mozilla/4.0 (compatible; MSIE ...
sina's user avatar
  • 209
0 votes
0 answers
1k views

NGINX $http_user_agent cause 404 response

The following conditional when matching a user-agent with substring 'MSIE 8' causes a 404 redirect? #Begin IE8 Hack if ($http_user_agent ~* 'MSIE 8') { #set $hack "I"; } #End IE8 Hack ...
Ben Crowhurst's user avatar
1 vote
1 answer
5k views

Blocking UserAgent libwww-perl with .htaccess not working?

The server is running on Apache, and trying to block libwww-perl, but not sure why it's not working. I've put the following in my .htaccess, but when I run the test I still get the notification that ...
Luke7625762353's user avatar
0 votes
1 answer
369 views

Windows Phone user-agents?

I've been analyzing my access logs and found two very different ways Windows Phones advertise themselves. Here are two examples for a Nokia Lumia 800: Mozilla/5.0 (compatible; MSIE 9.0; Windows Phone ...
pieroxy's user avatar
  • 135
9 votes
1 answer
12k views

Haproxy: reject traffic by user agent from file

I am trying to reject connections from specific user agents (by matching a substring of the user-agent header) using an haproxy ACL with -f option to read from a file. However it is not working, it ...
raugfer's user avatar
  • 221
0 votes
1 answer
2k views

NGiNX Custom Cache param based on regex match

My question(s) are as follows: How do I set custom variables based on regexp against a useragent? How do I set custom headers for the reverse-proxy request? How do I use these values as caching ...
Tracker1's user avatar
  • 293
0 votes
3 answers
13k views

user agent in http or https request

Is there any way that I can differentiate, the HTTP or HTTPS packets are coming from browser or not ? specially for https request.There is User-Agent field in packet in Http,but I could not found ...
user95711's user avatar
  • 211
0 votes
1 answer
4k views

mod_security not blocking empty useragent requests

I can't get mod_security to block empty useragent requests. I am not very saavy with it so after searching I found this rule: SecMarker BEGIN_UA_CHECK SecRule &REQUEST_HEADERS:User-Agent "@eq 0" \...
san671's user avatar
  • 51
0 votes
1 answer
1k views

How to filter request using IP restrictions OR a filtering rule

We have an IIS site right now that has an allow list for a specific list of IP addresses, and all other IPs denied by default. We want to add another rule, that states that if the request coming in as ...
M.R.'s user avatar
  • 143
1 vote
0 answers
972 views

Nginx shows no user agent string

I have been dealing with an issue on one of my servers for quite a while now. In short, the server receives massive spikes in load - up to 50 - but the site gets almost no traffic. I know this can be ...
DavidT's user avatar
  • 111
10 votes
2 answers
11k views

Is this user agent string related to Safari?

Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) GSA/3.2.1.25875 Mobile/11D167 Safari/8536.25 What's that "GSA" part? I've tried to figure it out, but ...
MaxArt's user avatar
  • 515
0 votes
1 answer
286 views

Nginx: security vs conditionals

I was reading around looking for some security steps that can be taken in Nginx to protect apps I'm serving using Nginx as a reverse proxy. I found this code which has some good things in it to ...
Ryan Burnette's user avatar
1 vote
1 answer
3k views

IIS not sending ASP.Net cookies to IE10 (and only to IE10)

I have IIS 7.5 server running ASP.Net application, which for some reason doesn't send ASP.Net authentication cookies to IE10. This happens only when request comes in from IE10 browser and only over ...
Cozzamara's user avatar
  • 143
2 votes
3 answers
2k views

Need Explanation of User Agent

I'm analyzing user agent field of different types of web server logs. Ex. Apache Access Log/W3C/iplant etc. I found some lines in the log files have following type of user agents. I'm confused since ...
Nilani Algiriyage's user avatar
9 votes
3 answers
27k views

How can I block a user agent from all sites on my server?

I originally this posted at webmasters.stackexchange.com, but was told I'd get a better reception here. For the last few days, I've been suffering from what appears to be a (presumably inadvertent) ...
Tom Wright's user avatar
3 votes
3 answers
13k views

nginx not blocking user agents

I have this in my .conf file for my website in attempt to block 2 user agents from constantly probing my server. ## Block http user agent - morpheus fucking scanner ## if ($http_user_agent ~* "...
ProfessionalAmateur's user avatar
1 vote
3 answers
369 views

How can I test for a URLs existeance before redirecting to it?

I am using Apache's mod_rewrite to redirect mobile users to my mobile site based on their http_user_agent. However not all pages have a mobile equivalent. Also mobile pages end in .html and "full" ...
ckliborn's user avatar
  • 2,778
-3 votes
1 answer
171 views

.htaccess user agents and website security [closed]

I have been looking around and trying to work out the best way to protect a few websites of mine. Appart from the obvious manual monitoring of the site logs and banning extreme/suspicious activity. I ...
hozza's user avatar
  • 137
-1 votes
2 answers
444 views

Please deconstruct a user agent string for me

Okay I give up. Given the user agent string below, which browser is being used? It might be IE8, since I can't envision firefox sending this. If it is IE8, why the hell is the "Mozilla" string in ...
P a u l's user avatar
  • 165
0 votes
1 answer
4k views

NGINX MIME TYPE

I have my nginx conf file so that when ever a mobile device visits my site the url gets rewritten to m.mysite.com I did it by adding the following set $mobile_rewrite do_not_perform; if ($...
justanotherprogrammer's user avatar
31 votes
1 answer
6k views

illegitimate traffic from user agent Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)

This is a rapidly changing event that has no answer yet. Please do not post your findings or assumptions as answers; reserve the answer field for when you actually have an answer. If you ...
1 vote
1 answer
357 views

Access Logs - Useragent changes after first request

Has anyone noticed Internet Explorer useragents changing in their access logs? - - 12.345.6.789 - - [24/Feb/2012:15:59:59 -0800] "GET HTTP/1.1" 200 4759 "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT ...
kmfk's user avatar
  • 161
0 votes
2 answers
15k views

How to create .htaccess and block UserAgent libwww-perl?

I have been testing my website with a SEO checkup tool and one of the warnings I got was this: Your server appears to allow access from User-agent Libwww-perl. Botnet scripts that automatically ...
MicBehrens's user avatar
1 vote
2 answers
3k views

How is a User Agent passed along from a load balancer?

I have an application that sits behind an F5 load balancer. The application needs to be aware of the User Agent and IP address of the inital request. For example: User Agent: Mozilla/5.0 (...
Derek Hunziker's user avatar
8 votes
1 answer
5k views

Serve different files for specific user agents using nginx

Using nginx, how do you serve different static files for different user agents? For example, if the current user is using an iPhone, they should be served mobile_index.html, whereas all other user ...
summatix's user avatar
  • 235
2 votes
3 answers
2k views

What is a SIP B2BUA, and how is it different from a UA?

I've been reading some stuff SIP related, and I'm confused, about what is a SIP back-to-back user agent(B2BUA) and a 'normal' user agent? Can anyone explain the differences? From what I read I can'...
BraCa's user avatar
  • 143
7 votes
2 answers
24k views

check several user agent in nginx

I need to redirect the traffic to one backend or another according to the user-agent. Is that the right thing to do ? server { listen 80; server_name my_domain.com; if ($...
Luc's user avatar
  • 518
1 vote
2 answers
2k views

Search Engine Bot - Large amount of hits

I've started tracking user-agent strings on a website at the start of each session. Looking at the data for this month so far I'm seeing on search engine bot that keeps coming up a lot.. Mozilla/5.0 (...
Justin808's user avatar
  • 307
4 votes
2 answers
5k views

Blocking by user-agent string in httpd.conf not effective

I'd like to block some spiders and bad bots by user-agent text string for all of my virtual hosts via httpd.conf but have yet to find success. Below are the contents of my http.conf file. Any ideas ...
Ferdinand.Bardamu's user avatar