I’ve always been on the fence about downvotes. On one hand, they can be a quick way to let someone know they did something wrong or that you don’t agree with them. However, on the other hand, they can be abused for nefarious purposes if there isn’t some form of internal moderation.

If you have a good reason to remove downvotes, I’ll support it, but otherwise it’s probably better to just keep them.