Reasonably modern ssh versions support a "master mode" (-M), which allows you to set up a master connection that you can then reuse with subsequent regular repeated scp calls. (When done, you'd close the master connection with "ssh -O exit user@host")   Maybe that would be an option?