Take the 2-minute tour ×
Server Fault is a question and answer site for professional system and network administrators. It's 100% free, no registration required.

I believe this question is more suited to serverfault (please correct me if not).

Even though pages do load the fact 404s are returned without a browser prevents other services (google adwords and other services) to believe pages specified don't exist.

This issue appears very similar to this question (except there are no 301 Moved Permanently for any pages). The domain is yorkshirebadges.co.uk.

For example, loading yorkshirebadges.co.uk or yorkshirebadges.co.uk/index.php reports no 404s during network inspection. But every other page (/contact.php, /products.php) report a not found.

Mod_rewrite is being used on the site, I checked this out but didn't see any obvious errors. It's included below for reference:

RewriteEngine on
RewriteRule ^store/material/([^/\.]+)/price/?([^/\.]+)?$ products.php?prodType=$1&price=$2
RewriteRule ^store/price/?([^/\.]+)?$ products.php?price=$1;
RewriteRule ^store/material/?([^/\.]+)?$ products.php?prodType=$1
RewriteRule ^store/([^/\.]+)/?$ products.php?prodCat=$1
RewriteRule ^store/([^/\.]+)/price/([^/\.]+)$ products.php?prodCat=$1&price=$2
RewriteRule ^store/Type/?([^/\.]+) products.php?prodType=$1
RewriteRule ^store/([^/\.]+)/?([^/\.]+)?$ view-product-details.php?cat=$1&prodName=$2
RewriteRule ^store/([^/\.]+)/material/?([^/\.]+)?$ products.php?prodCat=$1&prodType=$2
RewriteRule analytics http://www.google.com/analytics

<IfModule mod_suphp.c>
  suPHP_ConfigPath /home/yorkshir
<Files php.ini>
  order allow,deny
  deny from all
</Files>
</IfModule>

Chrome Network Inspection (and firebug on firefox) report 404s on all pages except the index, the server is apache2.

Tail off 300 errors:

[Tue Jun 26 03:03:12 2012] [error] [client 180.76.5.171] File does not exist: /home/yorkshir/public_html/404.shtml
[Tue Jun 26 03:03:12 2012] [error] [client 180.76.5.171] File does not exist: /home/yorkshir/public_html/robots.txt
[Tue Jun 26 02:41:55 2012] [error] [client 208.115.111.66] File does not exist: /home/yorkshir/public_html/404.shtml
[Tue Jun 26 02:41:55 2012] [error] [client 208.115.111.66] File does not exist: /home/yorkshir/public_html/robots.txt
[Tue Jun 26 01:49:07 2012] [error] [client 207.46.13.211] File does not exist: /home/yorkshir/public_html/404.shtml
[Tue Jun 26 01:49:07 2012] [error] [client 207.46.13.211] File does not exist: /home/yorkshir/public_html/robots.txt
[Tue Jun 26 01:36:11 2012] [error] [client 157.55.16.229] File does not exist: /home/yorkshir/public_html/404.shtml
[Tue Jun 26 01:36:11 2012] [error] [client 157.55.16.229] File does not exist: /home/yorkshir/public_html/robots.txt

Here's the tail -20 of the access log: Requesting /about.php , /contact.php , /products.php

82.6.68.117 - - [26/Jun/2012:03:02:23 -0500] "GET /about.php HTTP/1.1" 404 11222 "http://www.yorkshirebadges.co.uk/products.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:25 -0500] "GET /images/owl.jpg HTTP/1.1" 200 9355 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:25 -0500] "GET /images/about_page.jpg HTTP/1.1" 200 229018 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:25 -0500] "GET /images/down.jpg HTTP/1.1" 200 104835 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:25 -0500] "GET /images/battle.jpg HTTP/1.1" 200 310599 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    50.22.81.158 - - [26/Jun/2012:03:02:26 -0500] "POST /blog/wp-cron.php?doing_wp_cron=1340697746.7433919906616210937500 HTTP/1.0" 200 - "-" "WordPress/3.4; http://yorkshirebadges.co.uk/blog"
    128.30.52.71 - - [26/Jun/2012:03:02:26 -0500] "GET /about.php HTTP/1.1" 404 11222 "-" "W3C_Validator/1.3"
    50.22.81.158 - - [26/Jun/2012:03:02:27 -0500] "POST /blog/wp-cron.php?doing_wp_cron=1340697747.9865610599517822265625 HTTP/1.0" 200 - "-" "WordPress/3.4; http://yorkshirebadges.co.uk/blog"
    82.6.68.117 - - [26/Jun/2012:03:02:27 -0500] "GET /about.php HTTP/1.1" 404 11222 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:29 -0500] "GET /images/contact_pressed.jpg HTTP/1.1" 200 3807 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    50.22.81.158 - - [26/Jun/2012:03:02:31 -0500] "POST /blog/wp-cron.php?doing_wp_cron=1340697751.6464710235595703125000 HTTP/1.0" 200 - "-" "WordPress/3.4; http://yorkshirebadges.co.uk/blog"
    82.6.68.117 - - [26/Jun/2012:03:02:30 -0500] "GET /contact.php HTTP/1.1" 404 9363 "http://www.yorkshirebadges.co.uk/about.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:32 -0500] "GET /images/goes-to-charity.jpg HTTP/1.1" 200 33675 "http://www.yorkshirebadges.co.uk/contact.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    82.6.68.117 - - [26/Jun/2012:03:02:32 -0500] "GET /images/contact_page.jpg HTTP/1.1" 200 233192 "http://www.yorkshirebadges.co.uk/contact.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    50.22.81.158 - - [26/Jun/2012:03:02:34 -0500] "POST /blog/wp-cron.php?doing_wp_cron=1340697754.7831890583038330078125 HTTP/1.0" 200 - "-" "WordPress/3.4; http://yorkshirebadges.co.uk/blog"
    128.30.52.65 - - [26/Jun/2012:03:02:34 -0500] "GET /contact.php HTTP/1.1" 404 9363 "-" "W3C_Validator/1.3"
    50.22.81.158 - - [26/Jun/2012:03:02:36 -0500] "POST /blog/wp-cron.php?doing_wp_cron=1340697756.0506579875946044921875 HTTP/1.0" 200 - "-" "WordPress/3.4; http://yorkshirebadges.co.uk/blog"
    82.6.68.117 - - [26/Jun/2012:03:02:35 -0500] "GET /contact.php HTTP/1.1" 404 9363 "http://www.yorkshirebadges.co.uk/contact.php" "Mozilla/5.0 (X11; Linux i686) AppleWebKit/535.19 (KHTML, like Gecko) Ubuntu/11.04 Chromium/18.0.1025.151 Chrome/18.0.1025.151 Safari/535.19"
    66.249.73.153 - - [26/Jun/2012:03:02:46 -0500] "GET /blog/wp-content/uploads/2012/06/Wentworth-Lace-Wars1.jpg HTTP/1.1" 200 19402 "-" "Googlebot-Image/1.0"
    180.76.5.171 - - [26/Jun/2012:03:03:12 -0500] "GET /robots.txt HTTP/1.1" 404 - "-" "Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)"
share|improve this question
    
Can you add an extract from the Apache error log to the question? If you have access, can you also enable rewrite logging? –  meulop Jun 25 '12 at 8:56
    
N.b. I did a quick packet capture, and the pages are returning a HTTP 404 error to browsers as well - the browser is displaying the page content as if it was a custom 404 page. –  meulop Jun 25 '12 at 12:34
    
thanks @meulop (Limited logs as on shared server) but added logs: tail of Access and last HTTP 300 errors. –  user885983 Jun 26 '12 at 8:20
    
Thanks. Is there anything in the PHP code that can generate HTTP 404 errors? –  meulop Jun 27 '12 at 10:43
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Browse other questions tagged or ask your own question.