PS Internal Web Spidering Utility
Blackwidow spider engine will index your entire web server and create an ASCII output file of urls. Explores subdirectory structures. URL database is 100% compatible with exploit submission wizard and WAHOO! The script runs and creates a flatfile database of every single url on your server.