in reply to Re^2: DBD::CSV file size limitation?
in thread DBD::CSV file size limitation?

> This particular file does have 3 distinct record types
> in it, each with varying fields and lengths

That may be a problem. What record types are they? It's possible that the module assumes a given record type and then treats the other record-types as of the same kind, thereby getting confused about record boundaries and trying to create a single huge record.

Replies are listed 'Best First'.
Re^4: DBD::CSV file size limitation?
by beachbum (Beadle) on Dec 07, 2005 at 22:10 UTC

    The record types are different in that type '0' has 50 fields, type '1' has 22 fields, type '2' has 11 fields. The first 5 fields of each record are common, with field 5 being the record type (0|1|2). There is no binary data in the records.

    I am only interested in one type at a time, and have been sucessfully getting that until now with WHERE type = 1.