Unfortunately getting the extra 20% is an exercise in diminishing returns.

This is a very complex problem and you'll need to decide how much time (and/or money) you're prepared to spend getting as close to a complete solution as you deem necessary.

There are some pretty impressive (and very expensive) commercial solutions dedicated to this problem.

However you approach it, a machine will never get to 100% accuracy (at least not at this point).