I'm trying to scrape the hashtags from TikTok's trending videos. I've already got this working with Selenium::UserAgent, but it shows only 24 first videos. Besides, I've got it working on my other machine with Centos 7, but I've been installing all the software a couple of years ago, and don't remember how I did it before (installing the same old versions on the new machine doesn't work, there's something in the settings I think).

So I think there is no much sense of stopping me from doing what I need to. Also, I can solve it in a more hardcore way - run a real browser, start a plugin which will allow to run JS in it, and parse everything with JS. And this way there is no protection which can hold it at all. Here is some wisdom from me for all who needs it lol:) But I hate JS and would like to learn Perl deeper. Isn't this is the place where I can get some help with Perl?

In reply to Re^2: How to set up a correct custom User-Agent when using Perl's Selenium::Remote::Driver and Firefox by Jaharmy
in thread How to set up a correct custom User-Agent when using Perl's Selenium::Remote::Driver and Firefox by Jaharmy

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.