Have you checked how long it takes to fetch the data without doing anything else?

You can't get faster than the time it takes you to fetch the data.

Maybe you can be smarter and find out that you don't need to read all the data.

• For example, if you can guess in what file what data is most likely and start with that file.
• Or, if you need to search the same files for multiple times, it may prove fruitful to create an index into the files that tells you where what data lives.
• Or it might be fruitful to sort your large files so that you can very quickly check whether data is available.

Only you with your knowledge about the files and the data can decide whether you need to read through all files to find the entries or not.

---

---

Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!

Titles consisting of a single word are discouraged, and in most cases are disallowed outright.

Read Where should I post X? if you're not absolutely sure you're posting in the right place.

Please read these before you post! —

• How do I compose an effective node title?
• How do I post a question effectively?
• Markup in the Monastery

Posts may use any of the Perl Monks Approved HTML tags:

a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr

You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)

	For:		Use:
	&		&
	<		&lt;
	>		&gt;
	[		&#91;
	]		&#93;

Link using PerlMonks shortcuts! What shortcuts can I use for linking?

See Writeup Formatting Tips and other pages linked from there for more info.