Thanks for posting actual code and data.

I've never used ->find_all_links in conjunction with ->follow_link. As ->find_all_links needs to return absolute links, and as there is no easy way for ->follow_link to determine URL equivalence for arbitrary href attributes, the problem is basically unsolvable that way.

As a workaround, I would look at ->find_link_dom , which returns DOM objects instead of converting things to strings.