[clug] googlebot doing funny things in logs

Alex Satrapa grail at goldweb.com.au
Tue Jun 14 20:44:38 MDT 2011

On 15/06/2011, at 11:55 , Hal Ashburner wrote:

> I changed my server on the weekend and after restoring the mythtv database forgot to put the usual

What web server are you using? Is there any indication from the server string that it's a MythTV installation?

Telnet to your web service and issue the following:

> GET /robots.txt HTTP/1.1

(make sure you have two end-of-lines there)

What does it return? It should look something like

> HTTP/1.1 400 Bad Request
> Date: «blah»
> Server: Apache/2.2.17 (Unix)


More information about the linux mailing list