I also can't imagine what you are doing to make it run that slow. The term csv file covers a multitude of delimiters, but this should still be practically a one-line program that should perform well; for the comma delimiter case, perhaps:
cat *.csv | perl -lane '/^(\S+\,\s*\S+)/; $_{ $1 }++; END{ for $v ( so
+rt keys %_ ) { print "$v $_{$v}\n"}};' > result_csv.txt