You must be reading your timings wrong, as a call to pos($scalar) returns merely a value stored with $scalar, and thus is always quite fast. Most likely you are using a suboptimal regular expression to set pos, or your data is large and what you want to do just takes time.

In all cases, without code, we can't help you.