According to "Regional and Language Options" I'm using "English(Australia)". Some might argue that's contradictory.
If you have PDL installed, I'd be interested if you could verify that the arrow keys are also not working for you in the perldl shell. (It's not going to help much - beyond indicating whether we're dealing with something exclusive to the cpan shell.)