I used CPAN. But as I mentioned I had to force the installation of the newest Perl::Critic version with:

force install E/EL/ELLIOTJS/Perl-Critic-1.105.tar.gz
[download]

It probably wasn't a good idea to do it this way and I should have tried to resolve the problems I have with CPAN first.

Edit: OK, thanks again for you help. I reinstalled PPI and now Perl::Critic works correctly.