rsync has a "--delete-after" option to delete the file after the copy.

Depending on the nature of your file (does every single byte change every time you need to copy it?) rsync can also improve efficiency. It can also use ssh compression similar to the scp already mentioned if that helps your transfer.

(Or it could be much less efficient...in which case don't use it.)