You won't see Perl on a Palm Pilot soon.

But you can get Perl binaries for WinCE machines. Or how about the Psion.

There are also procedures for loading Linux on WinCE-type devices (especially the Compaq iPAQ). Once you have Linux, Perl cannot be far behind. You might want to check here for some general information.

Also this link which usually works but is down just at the moment tells about some folks who are putting together a palm-sized device called myLinux with impressive specs. They're doing it as a sort of hacker-community group project and expect to go into production later this year. They were soldering up the first board over the week-end. Update: here's a link to an animation showing this unit. They almost have the first two demo units soldered up. (And the links work now.) You can sign up for an email list to get announcements about this project here.