I go for references too. Couple of justifications:

Since I almost always want to pass by reference to avoid copying, and often want to pass in multiple arrays or hashes, having a reference is a good default.
Not having non-reffed arrays and hashes floating around means more consistency in the use of $ and -> almost everywhere.