Beefy Boxes and Bandwidth Generously Provided by pair Networks
Welcome to the Monastery
 
PerlMonks  

Re: Distributed query system

by strider corinth (Friar)
on Nov 06, 2002 at 17:35 UTC ( [id://210817]=note: print w/replies, xml ) Need Help??


in reply to Distributed query system

The main concern I see is that you'll have 5,000 connections open from your central server at a time. My suggestion would be a combination between your idea and the concept behind mailslots:

- Open a connection from the console to each of the hosts, one at a time.
- Tell them each what to do, get a confirmation that they received the request, and close the connection.
- Wait for them to open a connection back to the console to report.

That way, you don't have 5,000 connections open for a long time. If your hosts need to do something before they do their work and report back, that's no problem. If one of them takes too long, the console can check back to see what's up. And the actual reporting will probably not take too long, so the load on your server will be minimized.

If you wanted to, you could even have the hosts report back by inserting the report data directly into a SQL database, making the data searchable. With a timestamp and a unique id for each mass request the console sends out, your reporting system could become very versatile.

One final thing I need to mention is security. If these slave systems will be doing things like creating fileshares, the connection required to do that ought to always be encrypted, and need some sort of password authentication. Confirming the host that the request is coming from wouldn't hurt either. You don't want anybody to be able to do the kind of things you're thinking of automating.
--
Love justice; desire mercy.

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://210817]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others sharing their wisdom with the Monastery: (9)
As of 2024-03-28 12:25 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found