Have you tried Devel::ebug?

Or do you just accept that Unit Tests need to be debugged the old fashioned way, with print statements?

That is like the most advanced way :) otherwise you're debugging all manner of debuggers