If you are talking about Windows machines then talk to Adam Kennedy and tell him you want Portable Chocolate Perl now!

That should already include Wx out of the box so it will be easy to add you application. Then you zip it up again and distribute that to your clients.