Essentially the same question was asked today in removing a sublist. You might like to check the answers given there and perlfaq4 (arrays section) and Perl Cookbook, recipe 4.8 "Finding elements in one array but not another".

Re performance, the way to find out is to use the Benchmark module to compare the running times of various solutions.