Re: How to merge Huge log files (each 10 MB) into a single file

to merge 4 text files, it is taking more +than 8 minutes.

There's something you're not telling us? Or your disk is badly screwed. This is merging 4 10MB files on my system:

[15:23:09.44] c:\test>dir 10* mer*
03/09/2009  15:06        10,516,481 10MB.1
03/09/2009  15:06        10,516,481 10MB.2
03/09/2009  15:06        10,516,481 10MB.3
03/09/2009  15:07        10,516,481 10MB.4
               4 File(s)     42,065,924 bytes

[15:23:16.89] c:\test>perl -pE1 10MB.1 10MB.2 10MB.3 10MB.4 > mergedOu
+tput.txt

[15:23:19.21] c:\test>dir mergedOutput.txt
03/09/2009  15:23        42,065,924 mergedOutput.txt
[download]

Even with a cold cache, it never seems to take more than 3 seconds.

Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.

"Science is about questioning the status quo. Questioning authority".

In the absence of evidence, opinion is indistinguishable from prejudice.

RIP PCW It is as I've been saying!(Audio until 20090817)

Comment on Re: How to merge Huge log files (each 10 MB) into a single file Download Code

Replies are listed 'Best First'.
Re^2: How to merge Huge log files (each 10 MB) into a single file by lnin (Initiate) on Sep 04, 2009 at 05:29 UTC
Copy command usage and perl -pE1 usage really solved the problem. Thanks a lot	[reply]