A little update, so far so good on switching to SDL::Music.
Hit one snag, Perl_SDL doesn't expose any way to pan the mixer. On the plus side, a little googling, some minor additions the XS and panning works. (Hopefully, it gets patched in to the distribution )