I would think that scripted code checkout from CVS followed by compile and running the test suite was pretty usual

Oh how I wish that were true.... for a start you're assuming that everybody actually has some kind of source control (gosh - I love consulting :-)