Requirements

• Three rating categories per article
• User can rate one or more categories
• Overall rating based on category votes ** Calculate the average of each category ** Optionally assign a weight to each category (weight of categories TBD) ** Calculate a weighted average of the three category averages
• Shorter category description text will be needed in order to show it on a tooltip
• No range of ratings will be displayed
• Descriptions for rating values 1 and 5 only
• Rating tool will float on the side of the article
• Users can rate and add a comment at the same time
• If users comment, their ratings will be visible, otherwise the ratings will only be averaged
• New page that displays all the rating comments with ratings. Readers can flag it for admin review
• Ratings will be only in whole numbers (1 - 5), but averages will be displayed at the resolution of 1/2's
• Use stars and half stars to indicate ratings
• Admin needs to be able to delete ratings and comments that are flagged
• Ratings may be displayed on browse page
• Will have highest rated articles published in last 4 weeks tab on home page
• Rating tool will have a link to a static page with a explanation of the terms and rating categories
• User cannot delete his ratings, only change them
• On article page, display average rating in all 3 categories, overall rating, and number of users who voted
• On other pages (browse, home, etc.) display overall rating and number of users who voted

Front Matter vs. Research Articles

1. Do front matter articles need a rating(s) or should ratings only be available on research articles?

• Yes, FM needs ratings

2. Are the three rating categories for research articles appropriate for front matter?

• NO, though one is the same (Insight). The three categories for RAs are insight, reliability, and style.

3. Should front matter have a single rating category or multiple rating categories?

• Multiple rating categories, using the maximum allowed of three. Assuming the finalized definitions of these categories can be decided at a later date, i.e. when the functionality is about to be implemented.

4. Should rating categories be configurable per journal?

• All journals should have the same rating categories for front matter and research articles. Deviation will confuse the end user.

Research Article Categories

Insight

How thought provoking is the article?
1 - Bland. The article provides a insignificant incremental advance on the published literature.
5 - Profound. The article substantially deepens or alters current thinking in the topic.

Reliability

How reliable are the results and conclusions?
1 - Tenuous. The results are preliminary and will need confirmation.
5 - Unassailable. The results are high quality, the reasoning is tight, and the conclusions are very solid.

Style

How well presented is the paper?
1 - Crude. The technical accomplishment and presentation of the study are of low quality
5 - Elegant. The study satisfyingly presents the results of technically accomplished and expertly executed experiments.

Front Matter Categories

Insight

How thought-provoking a user found an article or how much it advances our scientific understanding
1 - Bland. The article provides a insignificant incremental advance on the published literature.
5 - Profound. The article substantially deepens or alters current thinking in the topic.

Utility

How useful a reader found an article.
1 - Limited usefulness. The article has no clear application in an educational or research setting.
5 - Highly useful. The article could be used in a variety of forms and in a variety of settings.

Influence

The potential to change behavior, practice or policy.
1 - Ineffectual. The article does not prompt reevaluation or alteration to customary thoughts or actions.
5 - Powerful. The article is sufficiently convincing to drive individual, corporate, and global change.

Weighting

When calculating an overall rating, we'd like to weight the different categories as follows:

• Insight : 6/15
• Reliability: 5/15
• Style: 4/15