in reply to Re^2: Web scraping
in thread Web scrapping
Is this "AI" generated code? It looks like something it would come up with since it doesn't understand what the problem is, or have any domain knowledge. The content of the page is constructed after it's loaded. The table you're trying to parse simply doesn't exist at the point your code runs. The data 'is' in the page, see cjs.initialFeeds['results'], however this is very fragile and subject to change, even automatically. As usual 1nickt has given a sensible response, you could also use a headless browser such as WWW::Mechanize::Chrome to automate an actual browser to visit the page, waiting for everything to actually happen and acquiring the data via the query mechanisms it provides, or passing the complete HTML to your Mojo::DOM code. The sensible option is the free APIs already provided, rather than playing whack a mole with this other site.
|
---|
Replies are listed 'Best First'. | |
---|---|
Re^4: Web scraping
by joyfedl (Acolyte) on Jul 11, 2025 at 19:41 UTC | |
by marto (Cardinal) on Jul 11, 2025 at 19:57 UTC |