I'm not sure if .xls files are compressed as well, but I like to keep the memory-footprint of my applications small.
If the same amount of data requires (much) less memory when loaded from other types of file (fixed length files, csv files, mysql database), then I'm going to complain when .xls needs more :)