On my side, I rarely experience large page load delays. I browser permonks both at work (actually the company -- TELUS --I work for sells ADSL to local population) and from home, where I'm hooked up to a 1.5 Mbps ADSL line (provided by my company).

Certainly, buying new hardware would never hurt. I'm wondering wherethere there's a mentioning on this site which server it runs on? In any event, more $$ will always equate to better hardware and greater performance... (I'm considering to put some of my paycheque on the offering plate to aide the process).