How did you end up with a "bad" tarball in the first place? Are you rolling your own? I suggest you get on the ExtUtils::MakeMaker train. Then you can:

  make disttest
  make dist
[download]

and never have to worry again!

-sam