But you haven't passed any of the other arguments now.

The whole point of the magic goto &$sub is that you don't pass any arguments at all, the subroutine gets the current @_. It makes it look like the AUTOLOAD never happened, even if the method uses the caller() function to look at who called it, it won't see the AUTOLOAD routine, it will see the code that called the AUTOLOADer.