Well, not always. POSIX compliant systems will have cp
and tar, and many non POSIX compliant systems will
too. (Anything remotely smelling like Unix, including Cygwin).
rsync on the other hand isn't a standard tool.
But yes, rsync will work, just like scp.
Or you could make a business copy and split off a mirror. But that's
not standard either.