I just started using Test::Unit to write some tests for refactored code

If you've only just started using Test::Unit may I suggest (with only a little bit of authorial bias ;-) that you stop - and use Test::Class instead, which supports skipped tests.

AFAIK Test::Unit doesn't support skipped tests and is no longer being actively developed.