Re^3: Delay when write to large number of file

It seems to me that the point of the program of the OP is to create reports for different customers. I'm not sure how creating one database file with all the customer data will help them.

Comment on Re^3: Delay when write to large number of file

Replies are listed 'Best First'.
Re^4: Delay when write to large number of file by thargas (Deacon) on Jun 24, 2014 at 17:20 UTC
It won't work if he insists on processing all the files each time the report is requested, but I doubt that anything will. I assumed, perhaps incorrectly, that collecting the data by customer was a background process. I figured that with all the data in the database, making the reports would be easy and fast, assuming that you indexed the table properly. It's possible this doesn't scale either, but the test program can easily be tweaked to tell whether it will.	[reply]

Replies are listed 'Best First'.

Re^4: Delay when write to large number of file
by thargas (Deacon) on Jun 24, 2014 at 17:20 UTC

It won't work if he insists on processing all the files each time the report is requested, but I doubt that anything will. I assumed, perhaps incorrectly, that collecting the data by customer was a background process.

I figured that with all the data in the database, making the reports would be easy and fast, assuming that you indexed the table properly. It's possible this doesn't scale either, but the test program can easily be tweaked to tell whether it will.

[reply]