I am curious how you would define the ratings?

Here is what they are currently after debate and agreement here along with some of the explanation from the FAQ.

"But, you might be asking, what do the ratings, 0-5 mean? Well, I suppose that technically they mean whatever you want them to mean since it is your tool to rate comments. But by way of general guidance, I've put together the following (cobbled together from various inspirational sources):

    * 0 - (zero), this is the lowest rating a comment can be given and is only available to users who have "trusted user" status. This rating should only be used for comments that are obviously spam (by obviously spam, I mean something like providing nothing but a link to some other site, usually selling something questionable) or porn. Use caution in using this rating - it should only be deployed in cases of obvious abuse of the site.

    * 1 - (one), this is the lowest rating that can be assigned by normal users of the site. Probably it's most effective usage would be in rating obvious trolls. If a comment is just way off-topic, is comprised of nothing but ad hominem attacks, so poorly written as to be almost unintelligible, then it may qualify for a 1 rating.

    * 2 - (two), the next rating up indicates there is perhaps something of value in the comment. But perhaps the writer included a lot of extra material that really had nothing to do with the topic, or their presentation was pretty bad due to language or gross generalizations, exceedingly faulty logic. Basically, a good try, but keep working on it if you want to earn some respect.

    * 3 - (three), this is the average rating for comments on the site. The comment makes a good point or two or contains some good, worthwhile information.

    * 4 - (four), is where we start to move up in the range to comments that include good points, provide some good information, something that makes us think, to go "hmmm". Or, at least puts a smile on your face. The writer keeps the post on topic and stays away from cheap techniques like name-calling.

    * 5 - (five), the top of the range, this should be reserved for posts that are exceedingly well written. Perhaps they make a point or include information that sticks in your mind even after you leave the site. Perhaps it inspires you to do your own research. But in at least some way, you think it is something that everyone should read.

So, those are the general guidelines. As a final bit of advice though, we ask that you:

Rate comments based on how well the argument is presented, not on whether you agree or disagree with the content of the topic.

Yes, rating something high that you absolutely do not agree with is difficult to do. But if the person making the comment has written it up well, rating it high will keep it close to the top in terms of visibility, which in turn keeps all of the rebuttals close to the top."