in reply to Re: Perl with a Samba mount
in thread Perl with a Samba mount

I am slurping the files in, rearranging some stuff and then writing them back out. Sorry I can't really give more details than that. Through some experimentation I have found that writing thing back out is where the big slow down is. I have found that if I "buffer" my write outs by writing out a bunch of files at a time it speeds things up ~5 percent. I know that it is the network that is slowing things down. I am wondering if there are any work arounds to make it faster over the network or make my read and writes over the network in bigger blocks so I don't have make as many network calls.

Replies are listed 'Best First'.
Re: Re: Re: Perl with a Samba mount
by waswas-fng (Curate) on Jan 04, 2003 at 00:29 UTC
    in short:

    read and write in 32k or 64k blocks (to try to get SMB to go into burst mode).
    stat all needed stat vars in one call.

    Even with this your bottleneck is the network -- CIFS is not the fastest network protocol under the sun...

    -Waswas