There's a program called TinyPerl 5.8 which is exactly what you're looking for. It comes with its own library files, but it can run without any .pm files too. It's all just two files: TINYPERL.EXE and PERL58.DLL. These two files are about 500KB. No need for installation. You can download them from here :
I have used this on 32-bit Windows XP and 64-bit Windows 10 and Windows 11. Runs great on all these systems.