Just about everything. The installation, the API, the docs, the way the output from GD::Graph looks, the speed, the font support hassles. About the only good think I can say is that it does work.
On the other hand, Google Charts has great docs, works fast, looks great, has great anti-aliased fonts and has a decent API (could be better).