So are the .xs and .c files source code to be compiled?

That's correct. If you're not compiling them on the target machine, they need to be complied on a machine with at least the same architecture and the same Perl version as the target machine - optimally as similar to the target machine as possible, since there's a lot of moving parts involved - and only then could you copy the built files over to the target and it should work.