<p>Self rated intelligence is garbage.</p>

<p>See</p>

<p>Paulhus DL, Lysy DC, Yik, MSM (1998), Self-Report Measures of Intelligence: Are They Useful as Proxy IQ Tests?. Journal of Personality, 66: 525–554. doi: 10.1111/1467-6494.00023</p>

<p>To quote the abstract:</p>

<blockquote>
  <p>Correlations between single-item self-reports of intelligence and IQ
  scores are rather low (.20–.25) in college samples. The literature
  suggested that self-reports could be improved by three strategies: (1)
  aggregation, (2)item weighting, and (3) use of indirect, rather than
  direct, questions. To evaluate these strategies, we compared the
  validity of aggregated and unaggregated versions of direct measures
  with four indirect measures (Gough’s Intellectual efficiency scale,
  Hogan’s Intellect composite scale, Sternberg’s Behavior Check List,
  and Trapnell’s Smart scale). All measures were administered to two
  large samples of undergraduates (Ns = 310, 326), who also took an IQ
  test. Although results showed some success for both direct and
  indirect measures, the failure of their validities to exceed .30
  impugns their utility as IQ proxies in competitive college samples.
  The content of the most valid items referred to global mental
  abilities or reading involvement. Aggregation benefited indirect more
  than direct measures, but prototype-weighting contributed little.</p>
</blockquote>

CC BY-SA 3.0
2012-05-05T15:19:42.550Z
Thank you for your input. Care to add a synopsis of the paper and how it relates to the question?
Steven Jeuris
CC BY-SA 3.0
2012-05-06T23:49:28.263Z
I added a quote of the abstract. I agree that self-rated intelligence tends to correlate poorly with intelligence measured with a psychometric test. However, this question is about domain-specific performance (e.g., in a particular sport, game, work task, etc.) which is different to IQ. Also, the question is about comparing the predictive validity of self-report to other-report relative to objective measures. Your answer seems to focus purely on self-report versus objective measures.
Jeromy Anglim
CC BY-SA 3.0
2012-05-05T11:06:34.183Z
2012-05-06T23:45:05.880Z
2012-05-06T23:45:05.880Z
user189
<p>I don't know of a study that tries to answer your specific question but you might want to have a look at <a href="http://en.wikipedia.org/wiki/Illusory_superiority">illusory superiority</a>, "a cognitive bias that causes people to overestimate their positive qualities and abilities and to underestimate their negative qualities, relative to others" (<a href="http://en.wikipedia.org/wiki/Illusory_superiority">wikipedia</a>).</p>

<p>I can especially recommend the paper by Dunning and Kruger (1999): <a href="http://www.steamfantasy.it/blog/manuali/unskilled_unaware_of_it.pdf">Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments</a> (also the winner of the <a href="http://en.wikipedia.org/wiki/Ig_Nobel_Prize">ignoble price</a> for psychology, 2000). In this paper the authors show that people who are competent in a certain domain are pretty accurate in predicting their performance in this domain (compared to objective standards). On the other hand, people who are incompetent typically overestimate their performance (i.e., predict to perform good, whereas they perfom poorly). This overestimation is mainly driven by their lack of knowledge about that domain. If they are taught that they are poor performers, their prediction goes in line wit their actual performance. </p>

<p>These results could explain your observation of self-other discrepancy, as others might have more knowledge about how to accurately predict performance than the poor perfomers who over-rate their performance.</p>

<p>Reference:</p>

<p>Kruger, J., &amp; Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. <em>Journal of Personality and Social Psychology</em>, 77(6), 1121–1134. doi:10.1037/0022-3514.77.6.1121</p>

CC BY-SA 3.0
2012-05-01T20:15:48.093Z
2012-05-01T20:15:48.093Z
Henrik
<p><strong>Context:</strong>
I was at a talk today where data was  presented  where a group of sports people ranked their own performance and everyone else in the group. This enabled self-rated performance to be correlated with the average of other-rated performance. The general observation was that there was a strong relationship between the two variables, but that where self-rated performance deviated from other-rated performance, people tended to rate themselves higher.</p>

<p>This raises the question of what this self-other discrepancy represents.
One answer is that people have a self-serving bias. 
Another answer is that people have unique information about themselves.</p>

<p><strong>Question:</strong>
Thus, I'm interested in studies that have looked at what self-rated performance predicts over and above other-rated performance. In particular:</p>

<p><strong>To what extent does self-rated performance predict objective performance over and above other-rated performance?</strong></p>

<p>I imagine these findings would vary as a function of a range of factors including type of task, number of rated used form the other-rating, and so on. But at first instance, I'd be interested in any empirical examples.</p>

CC BY-SA 3.0
2012-05-14T16:29:06.740Z
I am guessing attractiveness is not a domain-specific performance of the type you are looking for. However, for attractiveness there is huge inaccuracy in self-rating compared to others-ratings and there is a pretty big gender difference; men are much worse at self-rating than women (see the [4th paragraph of this answer](http://cogsci.stackexchange.com/a/574/29) for details/references)
Artem Kaznatcheev
<performance><social-psychology><io-psychology><bias>
Does self-rated performance predict objective performance over and above other-rated performance?
Jeromy Anglim
# Does self-rated performance predict objective performance over and above other-rated performance?

(Asked by: username_0 on 2012-05-01)

**Context:**
I was at a talk today where data was presented where a group of sports people ranked their own performance and everyone else in the group. This enabled self-rated performance to be correlated with the average of other-rated performance. The general observation was that there was a strong relationship between the two variables, but that where self-rated performance deviated from other-rated performance, people tended to rate themselves higher.

This raises the question of what this self-other discrepancy represents.
One answer is that people have a self-serving bias.
Another answer is that people have unique information about themselves.

**Question:**
Thus, I'm interested in studies that have looked at what self-rated performance predicts over and above other-rated performance. In particular:

**To what extent does self-rated performance predict objective performance over and above other-rated performance?**

I imagine these findings would vary as a function of a range of factors including type of task, number of rated used form the other-rating, and so on. But at first instance, I'd be interested in any empirical examples.

**Tags:** performance, social-psychology, io-psychology, bias

> **Comments:**
> **username_1**: I am guessing attractiveness is not a domain-specific performance of the type you are looking for. However, for attractiveness there is huge inaccuracy in self-rating compared to others-ratings and there is a pretty big gender difference; men are much worse at self-rating than women (see the [4th paragraph of this answer](http://cogsci.stackexchange.com/a/574/29) for details/references)  

---

## 2 answers

### Answer by username_4 on 2012-05-01. Score: 10 | Accepted answer

I don't know of a study that tries to answer your specific question but you might want to have a look at [illusory superiority](http://en.wikipedia.org/wiki/Illusory_superiority), "a cognitive bias that causes people to overestimate their positive qualities and abilities and to underestimate their negative qualities, relative to others" ([wikipedia](http://en.wikipedia.org/wiki/Illusory_superiority)).

I can especially recommend the paper by Dunning and Kruger (1999): [Unskilled and unaware of it: How difficulties in recognizing one's own incompetence lead to inflated self-assessments](http://www.steamfantasy.it/blog/manuali/unskilled_unaware_of_it.pdf) (also the winner of the [ignoble price](http://en.wikipedia.org/wiki/Ig_Nobel_Prize) for psychology, 2000). In this paper the authors show that people who are competent in a certain domain are pretty accurate in predicting their performance in this domain (compared to objective standards). On the other hand, people who are incompetent typically overestimate their performance (i.e., predict to perform good, whereas they perfom poorly). This overestimation is mainly driven by their lack of knowledge about that domain. If they are taught that they are poor performers, their prediction goes in line wit their actual performance.

These results could explain your observation of self-other discrepancy, as others might have more knowledge about how to accurately predict performance than the poor perfomers who over-rate their performance.

Reference:

Kruger, J., & Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. *Journal of Personality and Social Psychology*, 77(6), 1121–1134. doi:10.1037/0022-3514.77.6.1121


---

### Answer by username_2 on 2012-05-05. Score: -1

Self rated intelligence is garbage.

See

Paulhus DL, Lysy DC, Yik, MSM (1998), Self-Report Measures of Intelligence: Are They Useful as Proxy IQ Tests?. Journal of Personality, 66: 525–554. doi: 10.1111/1467-6494.00023

To quote the abstract:

> Correlations between single-item self-reports of intelligence and IQ
> scores are rather low (.20–.25) in college samples. The literature
> suggested that self-reports could be improved by three strategies: (1)
> aggregation, (2)item weighting, and (3) use of indirect, rather than
> direct, questions. To evaluate these strategies, we compared the
> validity of aggregated and unaggregated versions of direct measures
> with four indirect measures (Gough’s Intellectual efficiency scale,
> Hogan’s Intellect composite scale, Sternberg’s Behavior Check List,
> and Trapnell’s Smart scale). All measures were administered to two
> large samples of undergraduates (Ns = 310, 326), who also took an IQ
> test. Although results showed some success for both direct and
> indirect measures, the failure of their validities to exceed .30
> impugns their utility as IQ proxies in competitive college samples.
> The content of the most valid items referred to global mental
> abilities or reading involvement. Aggregation benefited indirect more
> than direct measures, but prototype-weighting contributed little.

> **Comments:**
> **username_3**: Thank you for your input. Care to add a synopsis of the paper and how it relates to the question?  
> **username_0**: I added a quote of the abstract. I agree that self-rated intelligence tends to correlate poorly with intelligence measured with a psychometric test. However, this question is about domain-specific performance (e.g., in a particular sport, game, work task, etc.) which is different to IQ. Also, the question is about comparing the predictive validity of self-report to other-report relative to objective measures. Your answer seems to focus purely on self-report versus objective measures.  

---

