[haz9119]

Hi,
I need a script that automatically visits or opens the browser with a set list of links I give it
For example I'de like to save a bunch of URLS in a list I don't really mind what type whether its excel file, html you name it. Once I save the list the script goes in and reads the urls and opens them in the browser one after the other until the list is done and I can come and close all the opened browsers.
I need this because my xml sitemap generator does not make a sitemap automatically I have to visit the URL where it is located on all my sites for them to be created and thats a hassle.

Thanks!

[Boraan]

It's also illegal depending on where you are. URL Aggregators are banned in most parts of the US and a few in Canada because of affiliate links being abused as well as PPC and PPV programs. Use is considered fraud. Also they have been used to harvest email addresses.

The sitemap for my website is database driven. I created a simple script where I just enter the urls and the description/title and the results are printed to the page. Also, because of the versatility, I created a "verify link" button in each entry where I just click and it opens in a new window.

For someone with multiple sites, I would create one database for all of my site links and just access the same script with different parameters for each site.

For example, say that you have five different sites, you can host the sitemap on just one site and access it from any of your sites like so.

http://url.com/cgi-bin/sitemap.cgi?siteid=sitename

If you want you can also embed that in a frame to keep the look like it's on the same site.

Also, it would be best if all the sites were on the same server. That way they would all have direct access to the database, otherwise your left to either create a database for each site, or worse yet, try some crude tunneling technique.

[haz9119]

thank you. i didnt know it was illegal. like i said i bought a xml sitemap generator which you place on a folder on each of your sites but its not automated unless you use "cron job" which my sites don't all have cause they are on different servers so i was going to visit each generator's generation page for example
http://wwww.site.com/generator/runcrawl.php for each site. but i like your idea

thank you

[Boraan]

cron is nothing but another UNIX shell command. If you know a little about perl you can compile a program that will execute cron for you for all of your sites. You would have to have admin access to the server. Because it's a shell command you wouldn't be able to safely use database access.

If you want to know why, any of you who studied networking will know that you can't execute admin shell commands using public rights, and you can't execute server commands using a private shell one the same machine, (once a port is occupied, it's occupied and locked).

Anyway, a simple script, cgi, php, or whatever you prefer will do nicely for the interface. You definitely do NOT want that on your scripts or cgi-bin directory for some happy-go-lucky hacker to have at your system. I would recommend a local server like IIS or something to host it on and just send the commands to the server using your admin qualifications.

[haz9119]

thank you! that was quite a lesson. I will run this by the master webdesigner who is more familiar with the scripts you mentioned than I am.

Thank you!