When it is true that you can almost use anything as delimiter, you have to be aware that "'" behaves differently, as it will prevent $1 being interpreted.

s'(^\d+[.]\s.+)'<h1>$1</h1>'g;
[download]

does NOT work as you exepcted, unless you use /e modifier.