If the program scans the disk, then maybe the memory is used by the disk cache. Linux always tend to fill memory with the disk cache as much as possible.