Comment votes are a tool for grooming the discussion. Discussion on most threads ends after a day or two. What's the value in downvoting a 3-day-old comment? Very few people are going to respond differently to the thread as a result.

If you want to participate, you should write comments, or, better yet, submissions of your own.