Re: How to set up a correct custom User-Agent when using Perl's Selenium::Remote::Driver and Firefox

I'm afraid it sounds as though you are trying to break the T's & C's of a web site to do something they don't want you to. As many monks manage such sites or have friends who do, you are unlikely to get much help until you convince us that everything is above board.

Regards,

John Davies

Comment on Re: How to set up a correct custom User-Agent when using Perl's Selenium::Remote::Driver and Firefox

Replies are listed 'Best First'.
Re^2: How to set up a correct custom User-Agent when using Perl's Selenium::Remote::Driver and Firefox by Jaharmy (Initiate) on Dec 17, 2022 at 21:33 UTC
I'm trying to scrape the hashtags from TikTok's trending videos. I've already got this working with Selenium::UserAgent, but it shows only 24 first videos. Besides, I've got it working on my other machine with Centos 7, but I've been installing all the software a couple of years ago, and don't remember how I did it before (installing the same old versions on the new machine doesn't work, there's something in the settings I think). So I think there is no much sense of stopping me from doing what I need to. Also, I can solve it in a more hardcore way - run a real browser, start a plugin which will allow to run JS in it, and parse everything with JS. And this way there is no protection which can hold it at all. Here is some wisdom from me for all who needs it lol:) But I hate JS and would like to learn Perl deeper. Isn't this is the place where I can get some help with Perl?	[reply]
A reply falls below the community's threshold of quality. You may see it by logging in.