in reply to Sharing a 300MB variable.
Here is a short list of potential bottlenecks when using DB’s to import web logs, just as a FYI.
Import speed
Import munging (filtering out invalid web log entries etc.)
DB table size growth
Managing DB access from a Data Warehouse (DW) if you keep your logs for an extended period
The up sides to a DB centric solution for web log processing are:
Scalability
Accessibility (Many different methods to read the data)
Flexibility (Integrate web log DB with other DB’s like sales, surveys, email campaigns)
Analysis and Data Mining (Lots of COTS {Commercial off the Shelf} software available)
Richard
There are three types of people in this world, those that can count and those that cannot. Anon
|
|---|