Ha-ha! This is what I was looking for. So I can just start the Makefile.PL with a check for an environment variable that disables all the XS, and document the module as supporting this feature. And if I go searching this keyword maybe I'll find existing tooling for it.