I think that

/^($pattern)/ and push @{$dfs{$1}}, $_;
[download]

is readable enough. Maybe even more readable (in a perl way) than my previous solution.