See perldoc perlop. || has a rather high precedence. or is lower. When using the former, it's as if you'd written unlink(@files || die $!) which will never die as long as @files is true.

hdp.