I still think you could simply fetch the data in chunks from MySQL and store the result there, avoiding the need to pass it around in your control protocol.
You will have to use POST to pass any significant amount of data. That shouldn't be a problem. The HTTP modules handle POST just fine. | [reply] |
I would really like to use MySQL directly, but most of the data can be condensed to a tree before sending. And at 1mb of data it seems to be a good idea to compress it that way.
Example:
The table:
testid1, yada1, foo1
testid1, yada1, foo2
testid1, yada2, foo3
testid1, yada1, foo4
testid1, yada2, foo4
The structure:
$data{'testid1'}{'yada1'}{'foo1'}
| [reply]
[d/l] |