What you want is explained in the perlfaq4, How do I compute the intersection of two arrays.

Also, I recently wrote a program that might be applicable to your problem directly, join - join two files according to a common key.

The easy solution to both problems is to basically load one of the two files (likely, the smaller one) into memory and check every entry of the second file against the first.