In case others find there way here and we don't get to the bottom of this:

Apparently Nvidia changed MXOptimizeForBackend with the switch to cuda 12
and that's what's broken AI::MXNetCAPI

There is a beta of mxnet 2.0 available at https://archive.apache.org/dist/incubator/mxnet/2.0.0.beta1/
But it has its own compile issues... and it's a beta, so...

HTH someone