If the same content from a different URL (eg. a localhost copy) takes much less time, then the network is clearly the bottleneck and unless you want to start getting into caching or have some control over the network then you are very much stuck with it.