What I'm doing is parsing Wikipedia Categories. Using Physics as the example Input, the script would request
this page.
- The page elements with an ns attribute of zero are actual articles, and will need to be saved for processing later.
- The page elements with an ns attribute of 14 are sub-categories which need traversed as well
EG: the first one on the page is
Category:Applied and interdisciplinary physics, so the script will then request
this page.
Then as above, all the page elements with ns attribute of zero are pages and saved for later, and the elements with ns attribute of 14 are added to the list of sub-categories to walk.
Once all the the subcategories are traversed, then operations are performed on the list of unique articles.
Basically what is happening is given the input, the script should walk all the branches of the tree 'below' it.