merlyn suggested the use of autouse in a different node. It looks like a better fit here. From the documentation, it appears to do exactly what you want - defers the cost of useing modules until you need them.
(I have never used autouse, so I can't say how reliable it is.)