Experts-Exchange has a similar system which does not work very well. Or at least they had until I left the site because its' commercial aspect got way out of hand.
Well... obviously it would need to prod the user until they had marked it off... kind of like messages in the chatterbox. But, as I say below... maybe just a way to bump questions back up that need answering would suffice.