• File is static and too large to fit in memory
• Records are constant width (as example given in OP implies)

Then...

File can be read in block mode (assign  $/ a reference to block size; see perlvar) and "going back" is just a matter of doing a  seek() by the appropriate negative offset (number of blocks * block size).