Personally, I think you're trying to do too much at once. The line doesn't have an easy flow to it. I'd break it up into two parts.

my @temp = map { $_ => $h{$_} } sort { $a <=> $b } keys %h;
%h = @temp[0,1];
[download]

This tells me I'm doing something with %h, then I'm reassigning that result back to %h; Of course, I could use a do statement, as so:

%h = do {
    my @temp = map { $_ => $h{$_} } sort { $a <=> $b } keys %h;
    @temp[0,1];
};
[download]

That's nicer, but I don't like having my chained operators so far from the left margin. While I limit myself to 80 columns, I like to keep it, if at all possible, in under 40.

%h = do {
    my @temp =
        map {
            $_ => $h{$_}
        } sort {
            $a <=> $b
        } keys %h;
    @temp[0,1]
};
[download]

That's how I write my LisPerl, with the chains listed vertically instead of horizontally.