To be clearer (I guess.) There are no guidelines that say this that I am aware of, that I can locate, or have been cited by anyone. The guidelines only mention downvoting in the context of bitching about downvoting.