I'm 100% agree with you and, to help you to show that situation is even worse than you just said, I have some examples of answers to a complicated question with a lot of work and corrections, which gained few XP, but, after casual mass-downvoting, their XP became negative!

Sometimes thoughtful answer even loses few XP!

Courage, the Cowardly Dog.