<p>I recently conducted a user study as part of my research in computer science. Respondents were asked to rate articles from the web on a five-point Likert scale from "Very Poor" to "Very Good".</p>

<p>Only 15 percent of ratings were on the negative side. My first conclusion was that most articles must be good. But then I discovered that there was considerably less agreement between users (each article was rated by a couple users) within negatively rated articles than within positively rated ones. <strong><em>So it seems to be harder for the users to accurately rate a bad article.</em></strong></p>

<p><strong>Is there a psychological effect that could (in part) explain this?</strong> References to papers are appreciated. Note that I don't mean bias issues regarding the Likert scale; it is carefully designed.</p>

<p>I'm a layman in psychology, but I was thinking that maybe there was a subconcious fear of rating too low so user rated too high... or something like that.</p>

CC BY-SA 3.0
2015-05-16T09:20:32.073Z
@MaríaAnt Yes, that is correct. It is my conculusion I obtained by looking at the survey responses.
PhillipM
CC BY-SA 3.0
2017-05-05T20:29:26.730Z
Positive bias? As measuring two constructs (bias and article) instead of 1, variability increases?
mflo-ByeSE
<social-psychology><measurement>
Psychological effects on quality assessments
PhillipM
# Psychological effects on quality assessments

(Asked by: username_0 on 2015-05-13)

I recently conducted a user study as part of my research in computer science. Respondents were asked to rate articles from the web on a five-point Likert scale from "Very Poor" to "Very Good".

Only 15 percent of ratings were on the negative side. My first conclusion was that most articles must be good. But then I discovered that there was considerably less agreement between users (each article was rated by a couple users) within negatively rated articles than within positively rated ones. ***So it seems to be harder for the users to accurately rate a bad article.***

**Is there a psychological effect that could (in part) explain this?** References to papers are appreciated. Note that I don't mean bias issues regarding the Likert scale; it is carefully designed.

I'm a layman in psychology, but I was thinking that maybe there was a subconcious fear of rating too low so user rated too high... or something like that.

**Tags:** social-psychology, measurement

> **Comments:**
> **username_0**: @MaríaAnt Yes, that is correct. It is my conculusion I obtained by looking at the survey responses.  
> **username_1**: Positive bias? As measuring two constructs (bias and article) instead of 1, variability increases?  

---

## 0 answers

