If you are scrapping a site that supports gzip encoding, you could set your agent to something like that of a Firefox Mozilla value. I have done this before and I do get gzip encoded responses that would cut down on your memory footprint.