Have you had the look at the vendors installation instructions? Here are the ActivePerl installation instructions for 5.22. I assume that they don't really differ from the installation instructions for 5.24.

For uninstallaing software on Windows, I assume that you click on "Uninstall" in the software part of the system settings.