This simple robots.txt file will help deter some of the unwanted bots that spider your site for email addresses and things of that nature that result in spam.
This works for all websites and it is not just limited to phpBB. This has also been configured to allow Google AdSense bots to spider your site if you use the program.
Resource Specification
Date Added:
Jun 15, 2004
Last Updated:
Feb 19, 2005
Author:
FuNEnD3R
Share
License Information
License # 1:
License Type:
Not Specified
Price:
Free
License # 2:
License Type:
Freeware
Price:
Free
Average Visitor Rating: 4.90 (out of 5)
Number of Ratings: 10 Votes
Visitor ratings breakdown by period
Last 7 Days
0
0
0
0
0
0.00
Last Month
0
0
0
0
0
0.00
Last Year
0
0
0
1
1
4.50
Overall
0
0
0
1
9
4.90
1
2
3
4
5
AVG
Visitor Rating Totals
1
2
3
4
5
Average Member Rating:
Not yet reviewed by any member....
You can be the FIRST one to write a review for
Block Bad Bots.
Notes
4.90 (out of 5)
