I just had a look at the implementation, in the modules ActivePerl::Config and ActiveState::Path. Apparently ActivePerl looks for the executable "gcc.exe" in PATH. So there's no need to reinstall ActivePerl at all. Just installing MinGW and allowing it to add itself into PATH is enough.

But you will have to start a new CMD shell to run ActivePerl in, to have it recognize it... :)