I would recomend using a profiler like the Devel::DProf module to profile your code and try and isolate the bottlenecks.