push, pop, shift and unshift were all present in Perl 1, released in 1987. It's surprising how many features it had.

Be careful not to confuse lists and arrays, though, as you can't use any of these operators to modify a list.