I want to search & capture RSS feeds automatically and dynamically based on a certain criteria and feed it periodically into my database. What is the best programming language used for this process. I do not want to purchase an RSS aggragator, but I want to try to code myself with the help of some source code.
I have read the reply to one of the related posts in this forum, which provided the following information:
-------------------------------------
So long as you want to code your own the tools are there: CPAN has the rss modules:
http://search.cpan.org/search?query=rss&mode=all
http://search.cpan.org/~autrijus/XM...SS/Aggregate.pm
Build a spider to fetch your rss feeds and use the concepts described here to index:
http://www.perl.com/pub/a/2003/09/25/searching.html
http://www.perl.com/pub/a/2003/02/19/engine.html
Then all you need to do is build a front end to it all. All in all, not a trivial task but definitely doable.
-----------------------------------
Concerning this reply, I have a few questions.
- For a novice programmer of RSS feed search, how do I integrate all links mentions in the reply above. What are the important steps to focus on when coding a RSS aggregator from scratch.
- I need some more information on how to buld a spider and what it means.
- Is there any open-source code which performs search based on RSS feeds.
- Since the database is programmed using MySql, how do I intergrate another programming language.
- How to search for RSS feed automatically, instead of subscribing to each website individually or entering url manually.
- How do i run the chunks of code i get in a composed manner ?
All suggestions and guidance would be very helpful and deeply appreciated.
Thank you,
Ranjani.