Re: Web Scraping

Replies are listed 'Best First'.
Re^2: Web Scraping by betmatt (Scribe) on Jul 12, 2019 at 15:04 UTC
You have given the reason in your answer. Python might be good for one thing. Perl could be good for another because of the reasons that you say. It is the sort of challenge and arms race that I am sure that you would love to be involved with.	[reply]
Re^3: Web Scraping by marto (Cardinal) on Jul 12, 2019 at 15:19 UTC
I do have experience using perl to scrape lots of things, having done so for years. I don't believe there's anything Python brings to the party that perl can't already do.	[reply]
Re^4: Web Scraping by betmatt (Scribe) on Jul 12, 2019 at 15:33 UTC
Python is better at doing analysis or perhaps I should say 'machine learning' 'on the fly'. For example it may be better at following nodes (or leads) through a twitter feed. Python might be able to learn how to find the best pages. Otherwise your probably right, Perl would be faster than Python for most text processing. The regular expression capabilities of Perl, as build in, are better I am sure.	[reply]
Re^5: Web Scraping by haukex (Archbishop) on Jul 12, 2019 at 15:55 UTC
Re^5: Web Scraping by hippo (Archbishop) on Jul 12, 2019 at 17:22 UTC
Re^5: Web Scraping by bliako (Abbot) on Jul 13, 2019 at 08:02 UTC
Re^3: Web Scraping by AnomalousMonk (Archbishop) on Jul 12, 2019 at 15:40 UTC
I think marto's use of the phrase "arms race" referred to the commercial sites you seem to want to interact with and their terms of service, and believe me, that's a tar-baby you don't want to start a fight with! Give a man a fish: `<%-{-{-{-<`	[reply] [d/l]