Hello, just wondering, if you read a directory with, lets say 500,000+ files.....what happens? Will it take forever

How long it takes depends somewhat on the filesystem. If it's smbfs, for instance, it'll take longer than you like. One thing you could do to make it more efficient is to put each user's files in their own directory, so that you'd have bobby/2006-05-08.txt instead of bobby2006-05-08.txt. However, if looking for the latest file for a certain user is a frequent operation, then you should do as davido suggests and keep track of that explicitely. (You may not need a database for that, though; for instance, you could just have the uploader make susan-latest.txt a symlink to susan's last uploaded file. If the filesystem you are using does not support symbolic links, then you could just store the filename of george's latest file in george-latest-upload-filename.txt or somesuch.)


Sanity? Oh, yeah, I've got all kinds of sanity. In fact, I've developed whole new kinds of sanity. Why, I've got so much sanity it's driving me crazy.

In reply to Re: efficient way to find most recently modified files? by jonadab
in thread efficient way to find most recently modified files? by Anonymous Monk

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.