in reply to Re^2: collect data from web pages and insert into mysql
in thread collect data from web pages and insert into mysql
Hmm, actually managed (with the help from AWP) to create a valid URL (inserting pid and page number) for a sortie list page and have the source printed to screen.
Looking at the resulting code it should be simple (I think) to create a list of sids (sortie pages) to process as they are all listed in the source as sid=XXXXXX (inside a string).
Must say my head is spinning a bit though, this is a lot to take in (I mainly copied something I found and adapted it, not like I could write it from scratch myself).
I guess next step would be to store the page as a temp file and figure out how to grab and save those sids.
Thanks for encouragement and help!
|
|---|