Use ++Rogers advice, that is a hash to eliminate duplicates. If your data really looks like the given example, I found DBD::CSV to be very useful; this module basically allows you to access your csv-file data with DBD and SQL, making migration to a real database, if somewhere in time necessary, a very easy thing.