reading from a large file and writing to a file

vikashiiitdm has asked for the wisdom of the Perl Monks concerning the following question:

hello dear monks, i have had been working on a program which requires me to read data from a small file, having certain keys separated by a delimiter on each line , much of like a passwd file in unix, then each key seperated from the delimiters has a specific file to read from...... my task is to seperate the keys at each line and they look into the appropriate file for data and print all the data for each key on the same line together. the actual datbase file is very veyr large and not in sql. please help me out. thanks a lot :vikash kumar

Comment on reading from a large file and writing to a file

Replies are listed 'Best First'.
Re: reading from a large file and writing to a file by halfcountplus (Hermit) on Jul 09, 2011 at 13:10 UTC
It doesn't sound too hard. You want a function, call it getKeys(), to read from the small source files that reads a line at a time, splits() it on your delimiter into token keys, then calls another function, call it slurpData(), that reads in the appropriate data from the key file, and prints a line to the database, which can probably be left open. So the main process just calls getKeys() as many times as necessary to cover all your sources.	[reply]

Replies are listed 'Best First'.

Re: reading from a large file and writing to a file
by halfcountplus (Hermit) on Jul 09, 2011 at 13:10 UTC

It doesn't sound too hard. You want a function, call it getKeys(), to read from the small source files that reads a line at a time, splits() it on your delimiter into token keys, then calls another function, call it slurpData(), that reads in the appropriate data from the key file, and prints a line to the database, which can probably be left open.

So the main process just calls getKeys() as many times as necessary to cover all your sources.

[reply]