But, I will build on an M1 machine and see what happens!

If there's already a perl build on this M1 machine, then running perl -V:config_args might help with the Configure options that you need to provide.

Cheers,
Rob