Does it stop automatically when a new version is uploaded?

Yes. The smokers should only be testing the latest available version.