robots.checker(tm)

This is a free, open-source, PHP script that will check for a robots.txt file. If it finds one, it reads it and flags any errors. The valid lines are delivered as links so you can click on them to see what the server delivers for those URLs. You can run it free, or download the code and run it on your own server. It is an easy way to check if the robots.txt file is valid and current.

 
Visit Site:
robots.checker(tm)
Version:
1.0 
Filed in:
Remotely Hosted / Miscellaneous
Platforms:
Linux 
Databases:
No Database 
Date Added:
Feb 8, 2006 
Last Updated:
Nov 3, 2008 

License and Pricing Information

GPL

Price: $0.00 USD

Publisher site visits: 1,636
Average rating: 0.00
Total ratings: 0

Be the first to review this listing!

Share this Listing