I've been wasting most of today futzing with HTML::TableExtract in an effort to get some stats from my fantasy football site.

At first I thought it was something I had coded wrong, because everytime I ran Table Extract, it only returned the headers. But something funky is going on with the actual website.

I use google chrome, and when I click "inspect element" and the web dev tools pop up at the bottom, I can see all the statistical information, and the table with all the players and their stats is neatly filled out. Run the data scraper, and it doesn't get anything but the headers. So then, open up the page in 'view source' and they have the format for the data rows in the table, and absolutely no records!

Here's the web page, though I doubt you'll be able to see anything b/c you probably have to login: http://www.draftstreet.com/nfl/salary-cap.aspx?game_id=1793187&game_reg_id=5629100

Why on earth would the data just disappear when I run view source, and not show up at all when I run my data scraper. More importantly, how am I supposed to get the freakin stats if they're invisible to my scraping program?!

I love it when a program comes together - jdhannibal

In reply to Mystery of the disappearing table data?! by jdlev

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.