Publisher review:robots.wizard provides three tools to help manage robots.txt files. robots.wizard provides three tools to help manage robots.txt files.
- robots.wizard allows you to create and edit a robots.txt file using a nice file system navigation inteface.
- robots.checker checks a robots.txt file for syntax
- robots.spider spiders a site and checks the robots.txt file for references.
These tools are distributed under GPL and the source code is well documented.
robots.wizard is a PHP script for Search Engines scripts design by Betsy Gamrat.
It runs on following operating system: Windows / Linux / Mac OS / BSD / Solaris.
Operating system:Windows / Linux / Mac OS / BSD / Solaris