Re: breaking up very large text files

Just one other suggestion that nobody's come up with -- is it possible to use some kind of Tie module and treat the lines of the file as an array?

($_='kkvvttuubbooppuuiiffssqqffssmmiibbddllffss')
 =~y~b-v~a-z~s;                             print
[download]

Comment on Re: breaking up very large text files - windows Download Code

Replies are listed 'Best First'.
Re: Re: breaking up very large text files - windows by CountZero (Bishop) on Jul 29, 2003 at 06:33 UTC
Good idea, but if the big file is really BIG, perhaps one runs into memory problems (I guess it will depend on how the `tie` is done) and somehow one still has to run through the file to see where the individual lines start, so you can `tie` your array to them. In the same vien I was thinking of some DBI::DBD solution (there are DBD-drivers for flat-file database-files) but it also needs to work through the file to find the individual records, unless you have fixed length records and then the matter is trivial to solve in any case. CountZero "If you have four groups working on a compiler, you'll get a 4-pass compiler." - Conway's Law	[reply] [d/l] [select]

Replies are listed 'Best First'.

Re: Re: breaking up very large text files - windows
by CountZero (Bishop) on Jul 29, 2003 at 06:33 UTC

Good idea, but if the big file is really BIG, perhaps one runs into memory problems (I guess it will depend on how the tie is done) and somehow one still has to run through the file to see where the individual lines start, so you can tie your array to them.

In the same vien I was thinking of some DBI::DBD solution (there are DBD-drivers for flat-file database-files) but it also needs to work through the file to find the individual records, unless you have fixed length records and then the matter is trivial to solve in any case.

CountZero

"If you have four groups working on a compiler, you'll get a 4-pass compiler." - Conway's Law

[reply]
[d/l]
[select]