untested, but this should work:

my %hash;
@hash{ map { $_->[0] } @listA } = ( 1 ) x @listA;

grep{ 1 unless defined $hash{$_->[0]} } @listB;
[download]

looking up 'intersection' in the search box comes up with some useful results