I found the way. Using perlcc command we can crack the above scenario.
Example,
Consider, the perl script available in hello.pl.
Command:
perlcc -B -o hello hello.pl
The option -B use the Perl bytecode code generator.
The option -o used to make a executable file.
IIRC perlcc was quite buggy, and is now no longer supported. See What happened to perlcc? and Alternative for perlcc, note what others have pointed out already about 'hiding the source'.