If you don't know where to start, try a book or a case study. Building Scalable Websites is kind of all over the place, but contains a couple of useful chapters. The Practical mod_perl book is good if you use mod_perl, and some of it is good even if you don't. I wrote an article about my experiences at one large site.