I am running a little apache2 webserver for a department at my university, and I noticed the access logs are filled with messages like the following:
"GET /path/on/my/site/7z|aac|arc|arj|asf|asx|avi|bin|csv|doc|exe|flv|gif|gz|gzip|hqx|jar|jpe?g|js|mp(2|3|4|e?g)|mov(ie)?|msi|msp|pdf|phps|png|ppt|qtm?|ra(m|r)?|sea|sit|tar|tgz|torrent|txt|wav|wma|wmv|wpd|xls|xml|z|zip HTTP/1.0" 200 22932
This seems to be occurring literally every few seconds all day every day, each time with a different path on our website, and it all comes from one IP address within my university. Sometimes it only has the path and no "7z|aac|arc|arj..." appended to the end. I am new to running a webserver, so this may be obvious to professionals — am I simply being crawled or is this something sinister that I should block?