Robots

Spider Spotting

Search engine watch
http://searchenginewatch.com/webmasters/spiders.html

Robotstxt.org

List of robots and protocols for setting up a robots.txt file
http://www.robotstxt.org/

Spider Food

Tutorials, forums and articles about search engine spiders and search engine marketing
http://spider-food.net/