PSBot & Picsearch

I don’t want most of my sites indexed by Picsearch. All they are indexing is affiliate and advertising images that can be found anywhere. No need for them to clutter up my server logs or add to my bandwidth. Obeying Picsearch’s instructions for telling PSBot to go away I added the following to my robots.txt file: User-agent: psbot Disallow: / But I keep having to write to Picsearch because PSBot is ignoring the exclusion. It’ll stop for a few days. Then come back. Nuisance.

Related posts:

  1. Robots.Txt Explained How to write your site's robots text file. ...
  2. How To Control Search Engine Robots ...
  3. Cut Search Robots Drain on Your Bandwidth ...
  4. How to stop link theft ...
  5. Robots.txt : A Webmaster’s Guide ...

Related posts brought to you by Yet Another Related Posts Plugin.

0 comments ↓

There are no comments yet...Kick things off by filling out the form below.

Leave a Comment