in reply to Memory Question
Another approach is to keep the files sorted and then use the comm command to find the differences. E.g.
comm -23 old new >oldonly comm -13 old new >newonly [download]