[delatroy]

Assume we have a general, popular search phrase such as 'pet food'.

Is there any way that I can run a search which will show me the amount of results/keyword occurrences by domain name? I want to find the most popular websites in terms of the amount of times anywhere on their site they mention 'pet food'!

I don't care about relevancy or rank here - just simply want to know which domains are the largest (most keyword occurrences / hits / documents referencing 'pet food').

I can search by domain on Google / Bing / Yahoo with the "site:" prefix, but this only works for one url at a time - not for multiple domains at the same time. Any scripts or sites please?



Thank you!

[wirehopper]

If you assume that the search engines do a good job of ranking sites based on content (and by extension, keywords), then you could use some tools, either existing or custom, to run the searches through search engine APIs to identify sites, then run the sites through the site: search you mentioned - using an automated tool - like cURL.

Interesting question.

[delatroy]

Surely this has been done before? Its quite hard to believe that someone hasn't scripted this before.. Any ideas?

[wirehopper]

I don't care about relevancy or rank here

I think this is the key. Most people are only concerned about rankings, not the occurances of the word.

You're probably right, it's probably been done.