I am not sure where its adding " to the file may be DBI connect is taking csv_quote_char as " by default?

Yes, it is as described in the documentation. Change the csv_quote_char and the problem should be resolved.