Re: buffering from a large file

is it possible to create something like threads or do multiple checks at the same time?

The sharing mechanism used by threads would make a copy of the string when you access it. We're talking about repeatedly copying 4GB into each thread.

Comment on Re: buffering from a large file

Replies are listed 'Best First'.
Re^2: buffering from a large file by cedance (Novice) on Mar 17, 2011 at 23:16 UTC
I was thinking about buffering 20 or 100 or 1000 lines every time, should I use threads, and run the code with a certain amount of threads and repeating the process. That should be feasible I suppose. I ran the code reading the file line by line and the code seems pretty fast already. I just would like to code utilizing some other novel concept, threads/forks etc... to get some experience and see the performance.	[reply]

Replies are listed 'Best First'.

Re^2: buffering from a large file
by cedance (Novice) on Mar 17, 2011 at 23:16 UTC

I was thinking about buffering 20 or 100 or 1000 lines every time, should I use threads, and run the code with a certain amount of threads and repeating the process. That should be feasible I suppose. I ran the code reading the file line by line and the code seems pretty fast already. I just would like to code utilizing some other novel concept, threads/forks etc... to get some experience and see the performance.

[reply]