in reply to Scrap shadow DOM website with Perl

Instead of scraping the page, I would look at decoding the Websocket communication that this site has with the backend.

Replies are listed 'Best First'.
Re^2: Scrap shadow DOM website with Perl
by vpperl (Novice) on Jan 20, 2021 at 13:50 UTC
    That sound interesting, also having in mind that I would like to do this for more than one team. Any starting point with this idea?

      Personally, I like to look at the data first using the developer tools of Firefox or Chrome, and then implement the Websocket client using Mojo::UserAgent.

        Thanks, will take a look!