This is a "feature" of pipes. The 4k sounds like a *nix (possibly Linux) limit. Pipes were not designed to be large temporary files, they were designed for interprocess communication.

If what you want is temporary storage, a temporary file is probably best. If your data is small (for some definition of small) why not just save it in memory?

It really depends on what you are actually trying to do.

--traveler