Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [useragent]

The tag has no usage guidance.

0
votes
1answer
155 views

Nginx : whitelisting browsers

I'm trying to setup a whitelist of browsers allowed to visit a static website hosted by a nginx server. I found in the documentation a reference to modern_browser directive. It seems interesting but ...
2
votes
1answer
47 views

Getting “302 Found” even after redirecting to a specific file in the .htaccess

I have an Apache server hosted on an EC2 instance which points to a domain that I own. Now, what I essentially want to get done is that the web server should return a .json file when the user tries to ...
0
votes
1answer
481 views

Block website scraper in Haproxy

I am using Haproxy. I want to block scrapers from my website. In the haproxy.cfg , I have created a rule. acl blockedagent hdr_sub(user-agent) -i -f /etc/haproxy/badbots.lst http-request deny if ...
0
votes
1answer
1k views

How to whitelist User Agent string?

I'm trying to whitelist a very specific User Agent string in Nginx. The below examples demonstrate how to whitelist general types of browsers (eg mozilla or chrome), but the string I want to whitelist ...
0
votes
1answer
538 views

Does IIS Request Filtering Rules use Regex for the deny strings?

I'm trying to block user-agent X (literally, just "X") in IIS using Request Filtering Rules. We've done this in the past for other more specific user-agents without problems. However, now that the ...
0
votes
1answer
1k views

Proxy changing my user agent build string

I'm making 2 connections to a web server. The first one is not using a proxy and the second one is using a proxy. In the web server access.log I can see my user agent reported in two different ways. ...
0
votes
2answers
69 views

Analyzing HTTP traffic [closed]

I am trying to solve the problem for a while and i couldn't find a proper answer online. I have a file with mobile traffic (from an Android device) and I am trying to check whether an http request is ...
0
votes
2answers
140 views

nginx IF statement matches with non-alphanumerical characters

I'm trying to stop some pesky bots by blocking ther user agents in nginx. What is the best way to put multiple user-agents/matches in the same if statement when they have non-alphanumerical characters ...
2
votes
0answers
87 views

iis doesnt compress content only for requests containing “/gecko/” in user-agent

Very weird behavior. My server returns gzipped response for all other requests. in the images you could see that for user agent "/gecko/" the request is not gzipped and for "/gescko/" it is. i'm ...
1
vote
1answer
1k views

Block web requests based on a portion of the user agent string - Not working

I'm trying to block web requests based on if they contain any of a group of strings. As far as I can tell between my own knowledge and searching online, what I have is correct. However, I'm still ...
1
vote
0answers
315 views

Very long useragent

We have requests in our server log with a very long useragent: HEADER: user-agent=Mozilla/5.0 (Windows NT 6.1; WOW64; rv:32.0; WUID=4bddaa48430e60af6132822cd6fab6c4; WTB=2873; WUID=...
1
vote
0answers
32 views

Identifying UserAgent strings that don't support TLSv1.1

I've created a tally from IIS logs of the last 18 months by User Agent string and created some Excel formulas to extract # of visits from XP/Vista machines using Internet Explorer. Could someone ...
0
votes
1answer
134 views

Azure VM Unwanted User-Agent Filtering/Blocking

I recently migrated our WP site to a Debian 8 VM running on Azure. Since then, we are unable to process credit card payments through the RedSys payment gateway. It seems that upon successful payment, ...
0
votes
1answer
132 views

How to filter JS:ScriptIP-INF (TRJ) in BBClone Webstatistic

I`m using the webstatistic bbclone on my server. In the last month my virus scanner sometimes blocks the details page. it displays the detection of JS:ScriptIP-INF (TRJ) on my bblone. But I ...
0
votes
0answers
234 views

nginx: parse UA and try_files by UA parts

What is given: nginx version: nginx/1.9.3; /var/www/site/js/site.chrome.js - code specific for chrome; /var/www/site/js/site.firefox.js - code specific for firefox; site.chrome.js and site.firefox.js ...
-3
votes
2answers
83 views

Bombarded with hundreds of probably automated page refreshes every few hours

It seems like some Internet Explorer users are sending my web server hundreds of requests per minute (for a few minutes) to refresh the page with a user-agent like this: Mozilla/4.0 (compatible; MSIE ...
0
votes
0answers
799 views

NGINX $http_user_agent cause 404 response

The following conditional when matching a user-agent with substring 'MSIE 8' causes a 404 redirect? #Begin IE8 Hack if ($http_user_agent ~* 'MSIE 8') { #set $hack "I"; } #End IE8 Hack ...
1
vote
1answer
5k views

Blocking UserAgent libwww-perl with .htaccess not working?

The server is running on Apache, and trying to block libwww-perl, but not sure why it's not working. I've put the following in my .htaccess, but when I run the test I still get the notification that ...
0
votes
1answer
327 views

Windows Phone user-agents?

I've been analyzing my access logs and found two very different ways Windows Phones advertise themselves. Here are two examples for a Nokia Lumia 800: Mozilla/5.0 (compatible; MSIE 9.0; Windows Phone ...
7
votes
1answer
7k views

Haproxy: reject traffic by user agent from file

I am trying to reject connections from specific user agents (by matching a substring of the user-agent header) using an haproxy ACL with -f option to read from a file. However it is not working, it ...
0
votes
1answer
1k views

NGiNX Custom Cache param based on regex match

My question(s) are as follows: How do I set custom variables based on regexp against a useragent? How do I set custom headers for the reverse-proxy request? How do I use these values as caching ...
0
votes
3answers
8k views

user agent in http or https request

Is there any way that I can differentiate, the HTTP or HTTPS packets are coming from browser or not ? specially for https request.There is User-Agent field in packet in Http,but I could not found ...
0
votes
1answer
3k views

mod_security not blocking empty useragent requests

I can't get mod_security to block empty useragent requests. I am not very saavy with it so after searching I found this rule: SecMarker BEGIN_UA_CHECK SecRule &REQUEST_HEADERS:User-Agent "@eq 0" \...
0
votes
1answer
946 views

How to filter request using IP restrictions OR a filtering rule

We have an IIS site right now that has an allow list for a specific list of IP addresses, and all other IPs denied by default. We want to add another rule, that states that if the request coming in as ...
1
vote
0answers
453 views

Nginx shows no user agent string

I have been dealing with an issue on one of my servers for quite a while now. In short, the server receives massive spikes in load - up to 50 - but the site gets almost no traffic. I know this can be ...
5
votes
2answers
5k views

Is this user agent string related to Safari?

Mozilla/5.0 (iPhone; CPU iPhone OS 7_1 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) GSA/3.2.1.25875 Mobile/11D167 Safari/8536.25 What's that "GSA" part? I've tried to figure it out, but ...
0
votes
1answer
230 views

Nginx: security vs conditionals

I was reading around looking for some security steps that can be taken in Nginx to protect apps I'm serving using Nginx as a reverse proxy. I found this code which has some good things in it to ...
1
vote
1answer
2k views

IIS not sending ASP.Net cookies to IE10 (and only to IE10)

I have IIS 7.5 server running ASP.Net application, which for some reason doesn't send ASP.Net authentication cookies to IE10. This happens only when request comes in from IE10 browser and only over ...
2
votes
3answers
870 views

Need Explanation of User Agent

I'm analyzing user agent field of different types of web server logs. Ex. Apache Access Log/W3C/iplant etc. I found some lines in the log files have following type of user agents. I'm confused since ...
9
votes
3answers
23k views

How can I block a user agent from all sites on my server?

I originally this posted at webmasters.stackexchange.com, but was told I'd get a better reception here. For the last few days, I've been suffering from what appears to be a (presumably inadvertent) ...
1
vote
3answers
8k views

nginx not blocking user agents

I have this in my .conf file for my website in attempt to block 2 user agents from constantly probing my server. ## Block http user agent - morpheus fucking scanner ## if ($http_user_agent ~* "...
0
votes
3answers
244 views

How can I test for a URLs existeance before redirecting to it?

I am using Apache's mod_rewrite to redirect mobile users to my mobile site based on their http_user_agent. However not all pages have a mobile equivalent. Also mobile pages end in .html and "full" ...
-3
votes
1answer
160 views

.htaccess user agents and website security [closed]

I have been looking around and trying to work out the best way to protect a few websites of mine. Appart from the obvious manual monitoring of the site logs and banning extreme/suspicious activity. I ...
-1
votes
2answers
357 views

Please deconstruct a user agent string for me

Okay I give up. Given the user agent string below, which browser is being used? It might be IE8, since I can't envision firefox sending this. If it is IE8, why the hell is the "Mozilla" string in ...
0
votes
1answer
3k views

NGINX MIME TYPE

I have my nginx conf file so that when ever a mobile device visits my site the url gets rewritten to m.mysite.com I did it by adding the following set $mobile_rewrite do_not_perform; if ($...
31
votes
1answer
6k views

illegitimate traffic from user agent Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.0.10) Gecko/2009042316 Firefox/3.0.10 (.NET CLR 3.5.30729)

This is a rapidly changing event that has no answer yet. Please do not post your findings or assumptions as answers; reserve the answer field for when you actually have an answer. If you ...
1
vote
1answer
349 views

Access Logs - Useragent changes after first request

Has anyone noticed Internet Explorer useragents changing in their access logs? - - 12.345.6.789 - - [24/Feb/2012:15:59:59 -0800] "GET HTTP/1.1" 200 4759 "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT ...
0
votes
2answers
15k views

How to create .htaccess and block UserAgent libwww-perl?

I have been testing my website with a SEO checkup tool and one of the warnings I got was this: Your server appears to allow access from User-agent Libwww-perl. Botnet scripts that automatically ...
1
vote
2answers
2k views

How is a User Agent passed along from a load balancer?

I have an application that sits behind an F5 load balancer. The application needs to be aware of the User Agent and IP address of the inital request. For example: User Agent: Mozilla/5.0 (...
7
votes
1answer
4k views

Serve different files for specific user agents using nginx

Using nginx, how do you serve different static files for different user agents? For example, if the current user is using an iPhone, they should be served mobile_index.html, whereas all other user ...
1
vote
3answers
1k views

What is a SIP B2BUA, and how is it different from a UA?

I've been reading some stuff SIP related, and I'm confused, about what is a SIP back-to-back user agent(B2BUA) and a 'normal' user agent? Can anyone explain the differences? From what I read I can'...
3
votes
2answers
16k views

check several user agent in nginx

I need to redirect the traffic to one backend or another according to the user-agent. Is that the right thing to do ? server { listen 80; server_name my_domain.com; if ($...
1
vote
2answers
2k views

Search Engine Bot - Large amount of hits

I've started tracking user-agent strings on a website at the start of each session. Looking at the data for this month so far I'm seeing on search engine bot that keeps coming up a lot.. Mozilla/5.0 (...
3
votes
2answers
4k views

Blocking by user-agent string in httpd.conf not effective

I'd like to block some spiders and bad bots by user-agent text string for all of my virtual hosts via httpd.conf but have yet to find success. Below are the contents of my http.conf file. Any ideas ...
3
votes
2answers
691 views

The Java/1.4.1_04 user agent clashes (404) with some jQuery / Javascript

Since I put up a new javascript file on my server a few days ago I've been getting strange 404's logs. It seems that some Java user-agent clashes with some part of the jQuery (1.6.2). I send an ...
1
vote
2answers
1k views

User agent blacklist recommended

Perishable Press publishes a managed user agent blacklist frequently, which blocks bad bots which htaccess directives. Article to be found here: http://perishablepress.com/press/2009/03/29/4g-...
0
votes
1answer
437 views

Help With Adding Mobile User Agent Exceptions To Varnish-Cache

This is the code I've added to the vcl file, so that it caches content for desktop users and mobile users separately: if (req.http.User-Agent ~ "(iPhone|Android|240x320|400X240|AvantGo|BlackBerry|...
1
vote
2answers
143 views

Access log Explanation

I am some what new to access_log and just started monitoring it for one of my new sites. The questions I have, is when viewing via -f tail, this is the average output: 000.000.000.000 - - [22/Jun/...
2
votes
1answer
175 views

Contional declaration in Apache httpd

We want to be able to set Cache-Control headers based on User-Agent in Apache For example, if a User-Agent contains substring foo we want to set Cache-Control to 10 minutes. But if not set it to 1 ...
2
votes
0answers
268 views

Vanilla .Net 4.0 website cannot identify some AppleWebKit based browsers

We are seeing some Safari browsers failing to cross-authenticate our website after we upgrade to .net 4.0 from .net 3.5. After much investigation, it turns out to be a problem with ASP.Net ...