i think the sort-merge join you explained earlier should solve my problem immediately (i didn't have an idea on how to do it). now i'm more debating on whether i need to incorporate this into a database because my programming is really beginner's level.
. the estimated size of all hash tables is probably a few hundred GB.
let me try your suggestion first. thank you very much for your help. really appreciate it.