Dear brethren,
I have access to a huge fileshare (Win NT) and want to get an overview of what's happened the last n days.

So I wrote a script to
<<walk through the file tree>>
<<search for files 'newer' than n days>>
<<print results to an HTML-file>>.

The main thing is done using File::Find and the function

find(\&wanted, $dir); sub wanted { if ((-f "$_") && (-M "$_" < $age )) { # get stats and push $_ in array } }
So far, so good. But the script takes some five hours to finish (due to the size of the fileshare and network traffic). Now I'm asking for your input how to do better and faster.

I'd like to run the script regular to keep the info up to date. A possible solutiong might be creating a database and keep looping through the fileshare while updating the db if new files exist or if a file has changed after the last visit.

Thanx for any other suggestions!
BTW: Yes, I've read maintain control over very many files.

weini


In reply to Find new files in tree by weini

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.