Performance : process lakhs of database records

selva has asked for the wisdom of the Perl Monks concerning the following question:

Replies are listed 'Best First'.
Re: Performance : process lakhs of database records by marto (Cardinal) on Jun 03, 2010 at 07:32 UTC
What is a 'lakhs of recorda'? Lakh? How do you access the remote machine? What processing do you need to do? See How do I post a question effectively?. Update: added fourth question. Update 2: perhaps you mean you have a remote database system containing many records. See DBI and Database Programming from the tutorials section.	[reply]
Re^2: Performance : process lakhs of database records by Xilman (Hermit) on Jun 03, 2010 at 09:11 UTC
"Lakh" is a unit much used in India and thereabouts, and is equal to 100,000. Paul	[reply]
Re^3: Performance : process lakhs of database records by marto (Cardinal) on Jun 03, 2010 at 09:18 UTC
Yeah, I linked to the wiki entry in my post under the suspicion that was what OP meant.	[reply]
Re^3: Performance : process lakhs of database records by Anonymous Monk on Jun 03, 2010 at 09:13 UTC
Also known as 100 grand pianos, right? :)	[reply]
Re: Performance : process lakhs of database records by JavaFan (Canon) on Jun 03, 2010 at 09:40 UTC
I fail to pinpoint a particular problem in your question. Is it the "how do I connect to the database" issue you have a problem with? Is it "how do I process records"? Is it "how do I write a Perl program"? Is it "please write a program for me?". Please elaborate. And tell us what you've done so far.	[reply]
Re^2: Performance : process lakhs of database records by selva (Scribe) on Jun 03, 2010 at 13:55 UTC
Currently i take nearly hundred thousands of record and load it in hash. After that compare the record values to another table. It leads to performance issue. Is there any efficient way to improve this.	[reply]
Re^3: Performance : process lakhs of database records by marto (Cardinal) on Jun 03, 2010 at 13:58 UTC
Why not simply do a database query via DBI and compare the values between the two tables?	[reply]