Re^2: Out of memory!

Hii all..!!<\p>

Thanks for your replies <\p>

Firstly i did this task in SQL only.But it took 40 to 45 minutes to compare just 1000 URLs.So we can expect how much time it would take for lakhs of urls.that is why i am trying to do this task using perl.More over i have to do this task weekly. So i have to find out a permanent solution for this.So can any one help in this.<\p>

Comment on Re^2: Out of memory!

Replies are listed 'Best First'.
Re^3: Out of memory! by roboticus (Chancellor) on Aug 12, 2010 at 11:12 UTC
santhosh.yamsani: Have you tried to optimize your SQL? 40-45 minutes is quite a long time to compare 1000 URLs in any language, unless you're doing some amazingly complex comparisons. Do you know which statements are taking up your time? If you give me a few details about you table structure, indexes and SQL that's performing poorly, I can offer you some suggestions on how to make it faster. ...roboticus	[reply]

Replies are listed 'Best First'.

Re^3: Out of memory!
by roboticus (Chancellor) on Aug 12, 2010 at 11:12 UTC

santhosh.yamsani:

Have you tried to optimize your SQL? 40-45 minutes is quite a long time to compare 1000 URLs in *any* language, unless you're doing some amazingly complex comparisons. Do you know which statements are taking up your time?

If you give me a few details about you table structure, indexes and SQL that's performing poorly, I can offer you some suggestions on how to make it faster.

...roboticus

[reply]