I've never seen it before either, it is surprising that this documentation doesn't appear to define it.

The backtick ` appears to be a sigil the author is using for a recursively-defined type, while the a appears to be simply a variable name: "let `a be any recursively defined type, then Ref[`a] declares a reference to that same type".