|| is very old, or is newer. The latter is preferred, the reason why you still see || so often is indeed because or is a more recent addition.

And the difference is indeed just their precedence, or behaves more appropriately for this kind of functionality.