This is really my bad - the payload can be retrieved by

$f->ref->{UDP}->payload;
[download]

I initially had this, but the script barfed which led me to get confused. This morning though after careful examination I realized the earlier error was due to the some packets having no UDP payload! Doh!