I heard perl is a powerfull tool which can handle this type of scenarios.So i am approaching this way of copying urls into file and comparing urls and updating database using perl.

But i am unable to move a step forward as i am getting OUT OF MEMORY! error

Thanks for your previous responses