This is a free, open-source, PHP script that will check for a robots.txt file. If it finds one, it reads it and flags any errors. The valid lines are delivered as links so you can click on them to see what the server delivers for those URLs. You can run it free, or download the code and run it on your own server. It is an easy way to check if the robots.txt file is valid and current.
Resource Specification
Platform(s):
linux
Date Added:
Feb 8, 2006
Last Updated:
Mar 6, 2008
Author:
Betsy A. Gamrat
Share
License Information
License # 1:
License Type:
GPL
Price:
Free
Average Visitor Rating: 5.00 (out of 5)
Number of Ratings: 1 Votes
Visitor ratings breakdown by period
Last 7 Days
0
0
0
0
0
0.00
Last Month
0
0
0
0
0
0.00
Last Year
0
0
0
0
0
0.00
Overall
0
0
0
0
1
5.00
1
2
3
4
5
AVG
Visitor Rating Totals
1
2
3
4
5
Average Member Rating:
Not yet reviewed by any member....
Notes
5.00 (out of 5)
