in reply to Re^2: HTML-Parser: a newbie question: need to extract exactly line 999 out of 5000 files..
in thread HTML-Parser: a newbie question: need to extract exactly line 999 out of 5000 files..

So do I.

...But, while my hypothesized automaton can produce a uniform tag framework, my guess is that at least 1 in 5000 ( times n fields) of variable data will vary the linecount. "Otherwise the question would not make much sense" because if all 5000 files are identical, there's not much point in reading more than one of them.

'Oh, no,' you say. 'The (normalized) data coming out of a DB should be quite consistent.'

Well, I think OP is putting data (from an unknown origin, received via html pages) INTO a DB. And look at the data: a multi-line fragment of an html table, where some <td> items include multiple adjacent spaces (as a general rule html will render ONLY one of those, ignoring the rest) and such things as line 6 (a long form address -- in a style that could be as few as a dozen characters or so... or could be many tens of characters).

And if the page is indeed script-generated, someone should fire the programmer, the proofreader, and/or their supervisors: Some of the boiler plate -- ie, renderable text that one might expect to be invariant in its spelling -- is not; viz: "aresss:" in line 6 and "adresse_two:" in line 7.

Of course, such an error may not change the line count a bit, but human data entry tends to be falible, and raw data tends not be be normalized.

  • Comment on Re^3: HTML-Parser: a newbie question: need to extract exactly line 999 out of 5000 files..

Replies are listed 'Best First'.
Re^4: HTML-Parser: a newbie question: need to extract exactly line 999 out of 5000 files..
by Perlbeginner1 (Scribe) on Oct 16, 2010 at 11:46 UTC
    Hey WW - thanks for posting.


    your thougths were very good and interesting! Therer are more than 5000 files - see one of the results:

    See one of the example sites: http://www.kultusportal-bw.de/servlet/PB/menu/1188427/index.html?COMPLETEHREF=http://www.kultus-bw.de/did_abfrage/detail.php?id=04313488

    in the grey shadowed block you see the wanted information:

    17 lines that are wanted. Note - i have 5000 different HTML-files - that all are structured in the very same way!

    That means i would be happy to have a template that can be runned with HTML::TokeParser::Simple and DBI.

    i would be more than happy to hear from you. You have great ideas

    pb1