A quick web search showed that the answer is yes, any usage of the bad variables slows down regex matching for everybody.

A module, Devel::SawAmpersand, was mentioned that tells if the sawampersand flags was set. And Devel::FindAmpersand tells where it was set.