[clug] googlebot doing funny things in logs

[Alex Satrapa]

On 15/06/2011, at 11:55 , Hal Ashburner wrote:

> I changed my server on the weekend and after restoring the mythtv database forgot to put the usual

What web server are you using? Is there any indication from the server string that it's a MythTV installation?

Telnet to your web service and issue the following:

> GET /robots.txt HTTP/1.1
> 

(make sure you have two end-of-lines there)

What does it return? It should look something like

> HTTP/1.1 400 Bad Request
> Date: «blah»
> Server: Apache/2.2.17 (Unix)

Alex