Discussion on NewsGrabber Perl module

(\/)(\/) has asked for the wisdom of the Perl Monks concerning the following question:

I have developed a Perl module "NewsGrabber" that can be found at http://backendnews.sourceforge.net

Now, I plan to add it to CPAN archive and they need a discussion on this module. So can some of you guys take a look at the modules and let me know how it fares in :

(1)Usefullness
(2)Code efficency
(3)Stability

It would be great if you guys could also suggest a namespace for the module. The CPAN guys sugegsted NewsGrabber under "WWW". What do you guys think ??

(\/)(\/)

Comment on Discussion on NewsGrabber Perl module

Replies are listed 'Best First'.
Re: Discussion on NewsGrabber Perl module by Anonymous Monk on Nov 16, 2000 at 12:45 UTC
Have you had a look at SiteScooper? How does this module differ? SiteScooper can by default grap 150 sites and produce output in many diffrent formats. Quite cool, have a look.	[reply]
Re: Re: Discussion on NewsGrabber Perl module by (\/)(\/) (Novice) on Nov 17, 2000 at 09:01 UTC
SiteScooper looks cool and with over 150 sites, it is great. But there is some fundamental difference between SiteScooper and what I plan to do in NewsGrabber. Concentrate on News - SiteScooper scoops news, cartoons etc. I want to concentrate on news. Use only legal news backends - Did who ever is the maintainer of SiteScooper ask the USerfriendly guys whethere it is legal to grab their cartoons and display as they have done in their product ??? I did and they said that it might create trouble. If that is the case, how ethical is it to distribute such a product, because anyone using SiteScooper is also in line for legal trouble. If that is the case, how can SiteScooper be put in CPAN ?? Make the implementation, change_free - SiteScooper grabs the relevant portion of any HTML page by identifying unique HTML tags or comments infront and after the relevant portion. This can become very unstable if the actual site owners change teh layout or start dynamic change of comments just to fool such grabbings. When I intially worked in Userfriendly cartoon grabbing, I too used this method. It can become unstable in no time if the other people are bent upon doing do . (\/)(\/)	[reply]