The key is I need it to pick up where the last error was found.

You could obtain the file position of the last error via tell, store it somewhere, and then seek to that same position before continuing with parsing... (if I've understood the problem correctly, that is)