in reply to Re: extract a log file to filter previous dates
in thread extract a log file to filter previous dates

Hi GrandFather,

Tnx so much indeed for the hand. My script is now working.

Now my problem is the extarction of the file is taking slow. How can I optimized the extraction of 1.2GB .txt file with 8M rows and 38 columns. Actually I create this script to filter only the informations that I need from this huge data. Any modules that can help to speed up the extraction? Tnx in advance.

Cheers! :)

Br, Pete
  • Comment on Re^2: extract a log file to filter previous dates

Replies are listed 'Best First'.
Re^3: extract a log file to filter previous dates
by GrandFather (Saint) on Aug 05, 2007 at 03:22 UTC

    You might get better advice if you show us what your data looks like and tell us what you want to extract from it. If you are dealing with a CSV file you may find Text::CSV or DBD::AnyData useful. AnyData will also handle fix width field data and a variety of other common file formats.


    DWIM is Perl's answer to Gödel