Where are you getting data from? A database?

If so then you might want to look at whether you can generate an incremental data set directly. Otherwise you can use diff as others have suggested.