What's wrong?

Nothing, perl grows, modules grow, file sizes increase ... compile time options play a part sometimes ... maybe you didn't use upx to compress executable?

http://staticperl.schmorp.de/smallperl.html
binary size
581336 Mar 1 09:55 smallperl.bin 1.7M
original size before before compression
1729072 Mar 1 09:55 smallperl.bin 568K