Would someone please be so kind as to point me in the direction of where I can find out what is causing this strange behavior (well it is strange from my POV).

perldata states:

Hashes are unordered collections of scalar values indexed by their associated string key.

What I am wanting to do is for it to print out the contents of the Hash of Hashes in the order they have been set up in.

At your command prompt, you can type:

perldoc -q hash
[download]

Which will eventually point you to Tie::IxHash:

This Perl module implements Perl hashes that preserve the order in which the hash elements were added.