Other than the other optimisations already suggested you might also find speedups using Parallel::ForkManager or MCE::Loop. Any one individual chunk/group of lines taking "a bit longer" could be mitigated by being able to (more easily than from the shell) run against n of them in parallel across the entire file.