Found the issue. There was a bug that the latest version of ExtUtils::MakeMaker fixed. Solution was to install the latest version of ExtUtils::MakeMaker rather than the default that came with Ventura.
Bug is documented here: https://github.com/perl5-dbi/DBD-mysql/issues/337