in reply to Slurping a large (>65 gb) into buffer

For efficient processing of files too big to fit in memory, use the sliding window technique.
  • Comment on Re: Slurping a large (>65 gb) into buffer