If you've got an open source application, and a user base using it, you have another option -- let the users help. Perhaps you can cultivate an alpha test list, people who get the new releases prior to anyone else. They'll test with real data, knowing the risks.