Why not store the delimiter in a variable and then use that variable?

my $delimiter = '$#$';

my @columns = split /\Q$delimiter\E/, $data;
[download]

So, again, I'm not sure why you see this as a problem, as Perl provides many convenient escaping mechanisms, like single quotes and quotemeta.