Re^2: Spec test location (was: Re^2: Getting Involved with Perl 6

The most difficult problem while moving the tests is deciding if they still conform to the current spec.

Some tests use (or test) rather obscure features of which I don't know if they are specced, and if yes, where. The specs are a massive lump of text (more than 31k lines) and rather dense, so that's not always easy to decide. Try to search for the operator but in English text isn't entirely easy, for example.

OTOH fudging isn't really necessary for moving tests into spec/: all implementations that we care about don't expect all test files to pass, only a selection of them. (Pugs does, but since pugs isn't maintained anyway, I don't care for now).

Comment on Re^2: Spec test location (was: Re^2: Getting Involved with Perl 6 - 2009) Select or Download Code

Replies are listed 'Best First'.
Re^3: Spec test location (was: Re^2: Getting Involved with Perl 6 - 2009) by kyle (Abbot) on Jun 21, 2009 at 19:51 UTC
That's harder than I thought. I'd be inclined to assume that passing tests are still correct, but even those might be testing an old spec which has since changed, but the implementations haven't caught up. So one really has to consider every single test individually. Thanks, that clears that up. I'll put a note about this in the documentation where I would have wanted to find it.	[reply]