If split isn't doing it for you, there seems to be no faster way in pure Perl.

You could write a filter in C. Using a memory-mapped file (or large buffer) it should be I/O bound and take no appreciable time to locate the delimiters. Copy them to standard output.

Then, call that as a pipe-in from the Perl open-file command.

—John