exilepanda has asked for the wisdom of the Perl Monks concerning the following question:
My expectation is to create a complex stuct ( perhaps include sub{} ) that shareable among threads, however threads::shared seems only serve for simple array, scalar or hash. Is that anything I missed in this module, or is there any module that suits this case ? Thanks in advance.
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re: How to share complex data structure in threads ?
by BrowserUk (Patriarch) on Dec 30, 2012 at 05:40 UTC | |
threads::shared seems only serve for simple array, scalar or hash. Look again at threads::shared::shared_close(). Eg:
It won't clone subroutines, because that's not possible or logical. However, whilst this allows you to share complex data structures, you'll generally find that it doesn't achieve what you think you want to achieve, and you'll probably come back asking why not. If you would describe your application, there is usually a better way of achieving it. With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
| [reply] [d/l] [select] |
by exilepanda (Friar) on Dec 30, 2012 at 07:11 UTC | |
This kind of assessment ( shareable R/W stuct ) would be more prior for my needs. And for my ultimate purpose, I wish to share a struct which carrying different on-the-fly created objects, and they can cross access each other. Of cause I can change the style to share an array to indicate a "queue" and then every objects go inside the queue to look for action. However, this leads me to think, is if there's any transparent way for a complex stuct become shareable | [reply] [d/l] [select] |
by BrowserUk (Patriarch) on Dec 30, 2012 at 07:51 UTC | |
For the sub{} share stuff, I am still not sure it's necessity. Necessity or not -- though it never is -- it is impossible. If I give anything try to alter the cloned structure, it give the Thread 2 terminated abnormally: Invalid value for shared scalar error. You are trying to add a non-shared hash into a shared array: push @s, { $cmd => time };; and that it illegal. You need to share() or share_clone that data you are adding:
This kind of assessment ( shareable R/W stuct ) would be more prior for my needs. Sorry, but I'm having trouble understanding the meaning of that sentence? And for my ultimate purpose, I wish to share a struct which carrying different on-the-fly created objects, and they can cross access each other.... However, this leads me to think, is if there's any transparent way for a complex stuct become shareable Covering the last sentence first: As demonstrated; it is perfectly possible to shared complex data structures; and to modify them on the fly. But you do have to learn and follow the rules:
Of cause I can change the style to share an array to indicate a "queue" and then every objects go inside the queue to look for action. Shared data structures often seem like a good solution. The problem with them is how does one thread know when one of the other threads has modified something that it needs to look at? The typical naive (Java-esque) approach to this problem is some elaborate setup using condition variables and locking and signaling and waiting; ie. synchronisation. The problem with that is that it difficult to get right; prone to deadlocks, livelocks and priority inversions; and even when it is programmed correctly, it is usually ponderous because each communication of state -- condition signaling -- requires at least 3 context switches to occur. And with sod's law and competing threads and processes vying for processor time, often many more. NB: these problem with synchronisation are not particular to Perl's shared state implementation; but also every other shared state mechanism; Indeed, they are far less prevalent with Perl due to its pretty unique explicitly-shared-only mechanisms; but still prevalent enough to avoid unless there is no alternative. (I've yet to see an application where there wasn't a better (usually queued) solution!) Conversely, communications via queues is easy to reason about and get right first time; is not subject to any of the shared-state nasties above; and is efficient and effective because the right thread gets woken automatically when there is something for it to do; and lies dormant consuming no processor time when then isn't. Finally, the problem with your application description is that you've decided that you should used shared structures and have defined it in those terms. If you would describe what you actually need to do; rather than how you think you should do it; it would be possible to suggest more effective alternatives; perhaps even point to existing similar examples or generate a small demonstration. With the rise and rise of 'Social' network sites: 'Computers are making people easier to use everyday'
Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
| [reply] [d/l] [select] |
by exilepanda (Friar) on Dec 30, 2012 at 10:16 UTC | |
by BrowserUk (Patriarch) on Dec 30, 2012 at 17:53 UTC | |
| |
|
Re: How to share complex data structure in threads ?
by Anonymous Monk on Dec 30, 2012 at 14:26 UTC | |
| [reply] |
by exilepanda (Friar) on Dec 30, 2012 at 15:20 UTC | |
All I know is I have to listen to certain range of ports, and signals come in, and the data struct will be altered, after `some external calls` returns values list. The ends up result maybe some like aaatttggg(they said it's protein or sort of) which is totally meaningless for me.. and I don't know how to express any further.. haha! So up to this stage, all I am looking for is how to share a complex struct which read/write possible, and start to listen on advise for which approach ( queue / struct ) would be more suitable in such data structure scenario. Do you have any "See Also" suggestion like POE ? Thanks again! =) | [reply] [d/l] [select] |