It is likely that your device driver will need to operate in a hard limit of a few hundred K or so of memory. In which case Perl would be simply undoable.

OTOH it might be possible to call out to user space. In that case amusing things are possible. But don't count on it.