Take a look at perlrun and this example, always that your csv files are simple:

perl -F"\t" -nae 'next if ($_ == EOF and $. != 1); pop @F; print join 
+"\t",@F,"\n";' file1 file2 file3 > file4
[download]

But, I see now, your bin flag, maybe this is not usable .. I didn't know of csv binary files !

Update 3: Next time I will read the full question, I missed too about sharing first column value from three files (good exercise to hack that perl one line script)