Never happened to me, I get bad rep when I deserve it

Wonder if it's someone really wanting to bad rep you..but not admitting to it so they wouldn't get bad rep back, hahaha
or is that a little too paranoid?