Yes; upvoting just puts the better comments nearer to the top. Downvoting the fluff comments (with the minimal "effort" of a click while you read past) actually greys them out, which both discourages people from posting fluff in the future (with a minor karma hit), and makes it obvious to other readers that they've made it to the end of the real comments.
