It's when you're working with floating point that you'd have to deal with the headache you're anticipating. Int formats are considerably more agreeable to deal with across different endian machines.