Not the most elegant method, but I just delete where it was installed. Of course, this doesn't help if you want to recursively delete anything that may have been installed as a pre-req.