D'oh! The problem was that I was trying to run the test in the wrong directory. Changing the .gitlab-ci.yml to:

stages:
  - test

job 1:
  stage: test
  script:
    - cd Foo-Bar
    - prove -l t
  tags:
    - perl
[download]

did the trick.

loris