Hi,
I am working on a MeatSearch tool.
A metasearch tool is a software application that:
• uses multiple protocols
• to perform simultaneous searches
• across multiple heterogeneous electronic information resources
• from a single point of entry.

How do metasearch tools work?

Metasearch software makes use of the search functionality built into each target resource it is searching. In general terms, a metasearch application goes through a series of steps to search multiple resources simultaneously and return results to the user.
Metasearch software:

(1) converts the user’s search into a query that can be understood by the built-in search of each of the target resources chosen to be searched.I called it Connectors

(2) broadcasts the translated query to the selected target resources.

(3) simultaneously retrieves sets of results from all reachable target resources.

(4) formats results into a canonical internal format to allow for further manipulation by the metasearch software.

(5a) displays the results from each resource in its own ranked or sorted list.

OR

(5b) displays the results in one merged list, ranked or sorted in some fashion.

• What type of application is it?
  It is a Web Application.
• What are you searching?
  Multiple heterogeneous electronic information resources i.e. DOAJ, Publisher's Databases. Yes, I can say it searches Web pages
• You mention 50 searches and the possibility of 10 concurrent instances.
  Yes, each instance may search for 50 resources.

I broadcast the well formated search query to different sources and fetch the from each target sourcesconnector using WWW::Mechanize. To Broadcast the search I am using SOAP::Lite and Parallel::ForkManager.
For each target source we have written a code(Connector),
Which Does the following

• creates the WWW::Mechanize object
• creates search url, and get the search results.(HTML content using WWW::Mechanize->content)
• Filter the HTML and Other un-wanted information, create a Record Object for each record.
• Return the reference to the recordSet Object.

Now, I need help on the following:
1. Should I use Process or Thread?
2. How to display the results as they are available from any source? application must not wait for all.
3. How to merge all results, when I am asking for Incremental display.
4. First I want to prepare a flow diagram. Can I get the help?
Looking forward for your response. Thanks

---

---

Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!

Titles consisting of a single word are discouraged, and in most cases are disallowed outright.

Read Where should I post X? if you're not absolutely sure you're posting in the right place.

Please read these before you post! —

• How do I compose an effective node title?
• How do I post a question effectively?
• Markup in the Monastery

Posts may use any of the Perl Monks Approved HTML tags:

a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr

You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)

	For:		Use:
	&		&
	<		&lt;
	>		&gt;
	[		&#91;
	]		&#93;

Link using PerlMonks shortcuts! What shortcuts can I use for linking?

See Writeup Formatting Tips and other pages linked from there for more info.