in reply to Parsing Large Text Files For Performance

I made some more changes and found that I could increase speed by doing a fixed string grep first (thanks jethro). What I did was grep for one of the IPs and used the context option to display 50 lines below the packet header. Then I processed this output using the script I posted above.

The initial improvements in speed are 60x faster over what I was doing before. This is great!

  • Comment on Re: Parsing Large Text Files For Performance