As far as making the pages smaller, not loading images as zentara says is probably the most significant thing you can do.

You might want to test to see if Perlmonks itself will serve your request significantly faster if you remove some of your dynamic nodelets (or, heck, even the static ones).

Also, I'll bite, what's a 牦牛?