[clug] googlebot doing funny things in logs

Paul Wayper paulway at mabula.net
Fri Jun 17 06:29:34 MDT 2011


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 06/15/2011 11:55 AM, Hal Ashburner wrote:
> I changed my server on the weekend and after restoring the mythtv database
> forgot to put the usual
> User-agent: *
> Disallow: /
> in a robots.txt file.
> I was just glancing through some logs and in amongst one or two seemingly
> fairly unsophisticated attempts at entry, google bot made an appearance.

Are you sure it was from Google?  Check the IP addresses it's reading from.
One of the script kiddie pranks is to disguise their bots as Google and other
search engines so that people let them through.  It might be a probe for a
vulnerability in Mythweb.

HTH,

Paul
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (GNU/Linux)
Comment: Using GnuPG with Fedora - http://enigmail.mozdev.org/

iEUEARECAAYFAk37SK0ACgkQu7W0U8VsXYIvjgCY/6DFmyNrbCZsIQpZ1cS5dfPB
xgCfXiRdN0C8QTHgjs8PGgEvA0imL/Y=
=+RJL
-----END PGP SIGNATURE-----


More information about the linux mailing list