But since you will be dealing with loads of data, I'll leave here pointers to some specifics on architecture solutions implemented by others.
presentation.
And I know there is a very interesting presentation by Tim Bunce, but I can't seem to find the link.