lib is core.
vendor_lib is vendor-installed.
site_lib is user-installed.

The arch subdirs are for binary libraries (.dll/.so), since they're not (necessarily) compatible with other versions of Perl. You don't need to specify these if you specify the parent using use lib or -I.