I've noticed something odd today.
if i go to http://www.google.com/robots.txt, IE11 shows me the contents of google's robot file. However if i go to my site (still in development) using the same browser and point it to robots.txt, IE asks if i want to open or save it to disk, and if i click open, it opens in notepad and not in the browser like google's.
Is there any difference in doing things like google does (obviously there's a difference in the way the file is served, so what are the pro's and con's of either method)? And how do hey manage to do it? I assume AddType/AddHandler have something to do with it but i can't figure out how to do it.
Here's what fiddler gives me for my site's robots.txt file:
HTTP/1.1 200 OK Date: Thu, 02 Apr 2015 17:16:06 GMT Server: Apache/2.4.9 (Win64) PHP/5.5.12 X-Powered-By: PHP/5.5.12 Content-Disposition: attachment; filename="robots.txt" Content-Length: 33 Keep-Alive: timeout=5, max=100 Connection: Keep-Alive Content-Type: text/plain User-agent: * Disallow: /images/