Re^2: Perl Script performance issue

The problem description was kind of sounding like a database type structure. I haven't used this myself, but I believe that someone could use DBD::CSV to run SQL queries against the original files without needing to import into a database first.

Comment on Re^2: Perl Script performance issue

Replies are listed 'Best First'.
Re^3: Perl Script performance issue by Laurent_R (Canon) on Dec 16, 2015 at 07:34 UTC
This makes things fairly easy to code, at least for relatively simple cases, but I very much doubt it would solve the performance problem. For me, the real solution is using either a hash structure in memory (super fast if feasible) or an actual database such as MySql or MariaDB (or possibly even SQLlite, but that might be a bit more complicated with several files) with full support to indexed data access enabling fast processing.	[reply]

Replies are listed 'Best First'.

Re^3: Perl Script performance issue
by Laurent_R (Canon) on Dec 16, 2015 at 07:34 UTC

For me, the real solution is using either a hash structure in memory (super fast if feasible) or an actual database such as MySql or MariaDB (or possibly even SQLlite, but that might be a bit more complicated with several files) with full support to indexed data access enabling fast processing.

[reply]