I found what the problem was.

I had a module named "Subs.pm" and somehow that crashed with CGI::Session. After I renamed it, the code above works.