There is another way of thinking about down votes that considers if the post was down-voted because of its content, or lack thereof.

It might be useful to see separate up and down counts, but only as long as you see both. And NEVER for the reason you cite.