0
votes
4answers
458 views

Protect Files from unauthorized access

I have this very big problem I've been trying to solve for last few days with no success. I have some files which are class schedules, these are imported to the server from an external source (html ...
0
votes
1answer
308 views

How I can verify a googlebot

I'm going to block all bots except the big search engines. One of my blocking methods will be to check for "language": Accept-Language If it has no Accept-Language the bot's IP adress will be ...