in reply to Re^7: Working with large amount of data
in thread Working with large amount of data

1) I just meant small machine, actually smaller than my many years old desktop! 1GB user memory is considered "small". A user who has a 1TB log file would normally be a commercial user. A commercial system will have more than 1 GB for user in this type of case.
2) No offense intended re: where did file come from? That meant from what application, etc. Not any personal info needed. Maybe this thing is from an input to a commercial DB? I dunno know. Maybe a report from this DB is more appropriate.
3) I don't know what #3 means.

In any event, no offense was intended!

  • Comment on Re^8: Working with large amount of data

Replies are listed 'Best First'.
Re^9: Working with large amount of data
by BrowserUk (Patriarch) on Sep 21, 2009 at 02:29 UTC
    3) I don't know what #3 means.

    Simply that before one can produce a DB report, the data has to exist in a DB. And getting the data into a DB is going to take more diskspace and time than producing the required counts directly from the flat file.

    Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
    "Science is about questioning the status quo. Questioning authority".
    In the absence of evidence, opinion is indistinguishable from prejudice.
[reply]

In Section Seekers of Perl Wisdom