Hey jcb!

Bit more details about my structure, and where the problem is:

- Perl/Tk with Tk::HList showing SQLite database view
- IPC::Shareable object "transport" for communication with "worker" child
- fork "worker" (forked before Tk objects become created) communicating with "transport" to Tk.
- "worker" creates its own IPC::Shareable "ac_trans" for its agents
-> On Tk's request (Button) the "worker" forks its agents which start doing the actual work.
- Agents download small bits of data (usually far away from 2^16 characters) and transfer it back to "worker" via "ac_trans".
- "worker" empties array within "ac_trans" and saves data to a regular array
- "worker" does this until all agents are exited
- "worker" fills database with all received data at once (faster than every agent accessing database for one small bit of data)
- "worker" informs Tk through "transfer" that work is finished.


Though: one source can't be predicted how many data will be downloaded and here it exceeds the 2^16 characters, IPC::Shareable can't handle, as well as Storeable can't (the way I tested it.).
So far I already have a database in use, I just create a table and use this for this only case. I think the more wait is worth it on this part. (SQLite supports cells with more than 2 billion characters.) Furthermore the changes are acceptable effort here.

In reply to Re^4: Looking for alternative for IPC::Shareable (or increase size) by DomX
in thread Looking for alternative for IPC::Shareable (or increase size) by DomX

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.