PlanetMath (more info)
 Math for the people, by the people. Sponsor PlanetMath
Encyclopedia | Requests | Forums | Docs | Wiki | Random | RSS  
Login
create new user
name:
pass:
forget your password?
Main Menu
Entry-Rating Extravaganza
Entry-Rating Extravaganza
posted by akrowne on 2007-06-28 13:40:58

As part of our PlanetMath quality initiative we are currently conducting a web-based survey of encyclopedia entry quality which relies on your input to provide a baseline of judgments. Many people have already weighed in, but we need more ratings (about 5x the current amount), so if you have not rated yet and can spare 20-30 minutes, please visit the rating system and help out (and make your opinion heard!)

We are combining the data from this survey with a reputation system being developed for Pawel Jurczyk's Summer of Code project to see if we can make inferences about quality and reputation that are more meaningful than PlanetMath's current points system. Potential uses range from replacing the score with a more robust and descriptive number, to providing a "quality estimate" on every entry, to helping resolve conflicts when there are multiple entries on the same topic.

Discussion
Style: Expand: Order:
forum policy
Suggestion: Allow partial ratings by FunctorSalad on 2007-10-09 21:37:48
For example, if someone doesn't feel qualified to evaluate the correctness, he should still be able to rate the pedagogy. Correct me if I'm wrong, but at the moment it seems that the categories for which you don't click one of the radio buttons are set to 1, which obviously isn't good.

Also, maybe the categories should be delineated more clearly. "Clarity" can be interpreted as any of correctness, pedagogy and language :)

I suppose that these two points make users hesitant to give a rating, hence we have so few ratings.
[ reply | up ]
ATTN: MORE RATINGS NEEDED! by akrowne on 2007-06-28 13:44:53
Just so everyone sees this... we probably need about another 5x the current level of ratings already submitted in the survey system (http://wilson.library.emory.edu:9090/pm/register.faces). If you have not yet done any ratings, we'd love to have your feedback. The more respondents we have, the more realistic will be the quality baseline data.

This survey will not only be useful to provide a baseline for a reputation system algorithm, but also to provide the best controlled measurement to date of the quality of the collection.

apk
[ reply | up ]

Interact
post