PhantomJS is a headless browser, I have trouble imagining what you mean with "clicking on the graph" in combination with Perl and no browser window.

Sounds like you want a real browser with a "download on click" add-on probably combined with an automation add-on like Selenium IDE or iMacros to navigate the pages. (which is almost totally off topic here)