I cannot just run the test script by "perl t/XXX.t", because the .so files under blib/arch/auto cannot be found by perl

The usual way is to run the test script as "perl -Mblib t/XXX.t".

Cheers,
Rob