Unfortunately you'd have to first sort the files ignoring the white space in the special way you want to ignore the white space, and standard Unix sort only has the option to ignore leading blanks.

Another Unix utility suitable for this type of task is comm, although it also requires input that already has been sorted.