Another couple of things to try:
Can you use ODBC instead of ADO, I know I've been able
to create access connections with DBD::ODBC without
waiting too long, maybe just try it for comparison.
You can also try connecting to the database file on disk,
without actually even needing access installed,
which you can read about in the docs for DBD::ODBC.