When processing ginormous data sets, try to use while instead of for.

for wants to load the entire dataset into memory but while wants to load each datum as you request it.