Test::Unit::Setup is a decorator for suites, not test cases, so you'll need to do something like this:

package My::TestCase;
use base qw(Test::Unit::TestCase);
use Test::Unit::TestSuite;
[download]

Thanks adrianh! This is just the bit I needed to make it come together in my head.