For example, when I think of the term "Backup" I don't tend to think "rsync" since backups tend to keep multiple versions of a file,

There's actually quite a nice technique using rsync for disk based backups that takes advantage of Unix hard links to do fairly efficient multiple revisions.