Well, you can always pre-read the header with an HTML parser -- too many ways to even discuss -- and then pick, either manually, ad hoc... or by setting up a table of headers that *MIGHT* occur that you think you'll want... and then entering your scraping routine.

Yes, I realize choice 1 doesn't automate... and 2 if fraught with possibilities for missing stuff you want.