Try Test::Differences, to isolate how the elements differ.

I haven't used eq_set---when I need to compare deep data structures I tend to go with is_deeply().