in reply to Re^2: collect data from web pages and insert into mysql
in thread collect data from web pages and insert into mysql

Hmm, actually managed (with the help from AWP) to create a valid URL (inserting pid and page number) for a sortie list page and have the source printed to screen.

Looking at the resulting code it should be simple (I think) to create a list of sids (sortie pages) to process as they are all listed in the source as sid=XXXXXX (inside a string).

Must say my head is spinning a bit though, this is a lot to take in (I mainly copied something I found and adapted it, not like I could write it from scratch myself).

I guess next step would be to store the page as a temp file and figure out how to grab and save those sids.

Thanks for encouragement and help!

  • Comment on Re^3: collect data from web pages and insert into mysql