<p>There is a very large literature on this, and it features many subtle points, but I will try to summarize some general themes.</p>
<p>In general, subjects are very <strong>consistent at ranking pictures of others</strong> for attractiveness (thus, eliminating the popular notion of &quot;beauty is in the eye of the beholder&quot;). For instance Cunnigham et al. (1995) found a correlation of .9 between individual rating and the average rating of pictures of women. This correlation remains high even if the rater and photo are from different cultures. Further, <strong>men and women tend to find the same features good-looking</strong> (i.e. heteresexual men and women, deem similar women as good-looking). Johnston &amp; Franklin (1993) let 20 male and 20 female subjects use a genetic algorithm to generate female faces that they deemed good-looking. With the exception of the lower lip (females preferred a larger lower lip) there was no statistical differences between the qualities of the faces produced by male and female subjects.</p>
<p>However, <strong>women have a higher variance in ratings of sex-objects</strong> (opposite sex for heterosexual, same-sex for homosexual females) than men (Jankowiak et al. 1992; Townsend &amp; Wasserman 1997). But this should be taken with a grain of salt because attractiveness <strong>rankings have much higher variation when ranking males as opposed to females</strong>. Schulman &amp; Hoskins (1986) found that ratings of female photos had statistically significant lower variance than male photos for both male and female raters. Thus, the effect could partially be in that both sexes are worse at judging attractiveness of males.</p>
<p>Of course, the hardest is judging attractiveness in oneself. Rand &amp; Hall (1983) found that females has a .5 correlation between their self-perception of attractiveness and the rating of male judges. Men are much worse, with only a .1 (almost chance) correlation between self-attractiveness ratings and the ratings of female judges.</p>
<p>The story gets even more complicated, because women respond differently to how they load features when producing ratings depending on if they are looking for a short-term or long-term partner (Widerman &amp; Dubois 1998) and even where they are in their menstrual cycle (Penton-Voak &amp; Perrett 2001).</p>
<p>Due to the complicated interaction of all these factors (and more!) <strong>I don't think there is (yet) one final and definitive answer</strong> to your question.</p>
<hr />
<h3>References</h3>
<ul>
<li>Cunningham, M., Roberts, A.R., Berbee, Anita, P., Druen, P.B., &amp; Wu, C. [1995] &quot;&quot;Their ideas of beauty are, on the whole, the same as ours&quot;: Consistency and variability in the cross-cultural perception of female physical attractiveness.&quot; Journal of Personality and Social Psychology, 68: 261-279.</li>
<li>Jankowiak, W.R., Hill, E.M., &amp; Donovan, J.M. [1992] &quot;The effects of sex and sexual orientation on attractiveness judgments: An evolutionary interpretation.&quot; Ethology and Sociobiology 13(2): 73-85.</li>
<li>Johnston, V.S., &amp; Franklin, M. [1993] &quot;Is beauty in the eye of the beholder?&quot; Ethology and Sociobiology 14(3): 183-199.</li>
<li>Penton-Voak, I.S., &amp; Perrett, D.I. [2001] &quot;Male facial attractiveness: Perceived personality and shifting female preferences for male traits across the menstrual cycle.&quot; Advances in the Study of Behavior 30: 219-259.</li>
<li>Rand, C., &amp; Hall, J. [1983] &quot;Sex differences in the accuracy of self-perceived attractivness.&quot; Social Psychology Quarterly, 46: 359-363.</li>
<li>Townsend, J.M., &amp; Wasserman, T. [1997] &quot;The perception of sexual attractiveness: sex differences in variability.&quot; Archives of Sexual Behavior 26(3): 243-268.</li>
<li>Wiederman, M.W., &amp; Dubois, S.L. [1998] &quot;Evolution and Sex Differences in Preferences for Short-Term Mates: Results from a Policy Capturing Study&quot; Evolution and Human Behavior 19: 153-170.</li>
</ul>

CC BY-SA 3.0
2012-03-08T14:15:36.947Z
This was a very informative answer and pretty much answered what I was looking for. I'm going to look into the references you give.
Speldosa
CC BY-SA 3.0
2013-06-26T14:14:57.017Z
+1 for the nice overview and numerous references but .9 sounds unbelievably high. It's higher than most effects in experimental psychology, higher than typical correlations between closely related statements on attitude scales. It would imply virtually no measurement error in attractiveness ratings. I don't know what this number is but it can't be a correlation between individual ratings of any kind and anything else.
Gala
CC BY-SA 3.0
2012-03-08T09:22:33.790Z
2012-03-08T09:22:33.790Z
2020-06-17T09:55:31.633Z
Artem Kaznatcheev
<p>Is there any research that assesses whether males or females judge faces of the opposite sex with a greater internal consistency? That is, is the standard deviation of attraction ratings for a specific opposite sex face on average smaller when looking at a specific gender?</p>

CC BY-SA 3.0
2014-03-22T05:50:02.133Z
Homogeneity of variance question! [Levene's test](https://en.wikipedia.org/wiki/Levene%27s_test)!
Nick Stauner
CC BY-SA 3.0
2012-02-29T20:21:32.007Z
This may not answer your exact question, but I think it is relevant:

http://blog.okcupid.com/index.php/your-looks-and-online-dating/
http://blog.okcupid.com/index.php/the-mathematics-of-beauty/
Preece
CC BY-SA 3.0
2012-03-22T16:20:33.160Z
I would re-title and reword your question.  "Do men's opinions of people's attractiveness vary more or less than women's opinions?"  I would note also that what people say when asked to give a rating may not be the same thing as how they react to the person in real life.  Also, men might agree more about certain aspects of attractiveness, and less about others.
Michael Bishop
<social-psychology><physical-attraction><sex-differences><reliability>
Are there sex differences in inter-rater consistency of attractiveness ratings  of opposite-sex faces?
Speldosa
# Are there sex differences in inter-rater consistency of attractiveness ratings  of opposite-sex faces?

(Asked by: username_0 on 2012-02-20)

Is there any research that assesses whether males or females judge faces of the opposite sex with a greater internal consistency? That is, is the standard deviation of attraction ratings for a specific opposite sex face on average smaller when looking at a specific gender?

**Tags:** social-psychology, physical-attraction, sex-differences, reliability

> **Comments:**
> **username_2**: This may not answer your exact question, but I think it is relevant:  http://blog.okcupid.com/index.php/your-looks-and-online-dating/ http://blog.okcupid.com/index.php/the-mathematics-of-beauty/  
> **username_3**: I would re-title and reword your question.  "Do men's opinions of people's attractiveness vary more or less than women's opinions?"  I would note also that what people say when asked to give a rating may not be the same thing as how they react to the person in real life.  Also, men might agree more about certain aspects of attractiveness, and less about others.  
> **username_1**: Homogeneity of variance question! [Levene's test](https://en.wikipedia.org/wiki/Levene%27s_test)!  

---

## 1 answers

### Answer by username_4 on 2012-03-08. Score: 15 | Accepted answer

There is a very large literature on this, and it features many subtle points, but I will try to summarize some general themes.

In general, subjects are very **consistent at ranking pictures of others** for attractiveness (thus, eliminating the popular notion of "beauty is in the eye of the beholder"). For instance Cunnigham et al. (1995) found a correlation of .9 between individual rating and the average rating of pictures of women. This correlation remains high even if the rater and photo are from different cultures. Further, **men and women tend to find the same features good-looking** (i.e. heteresexual men and women, deem similar women as good-looking). Johnston & Franklin (1993) let 20 male and 20 female subjects use a genetic algorithm to generate female faces that they deemed good-looking. With the exception of the lower lip (females preferred a larger lower lip) there was no statistical differences between the qualities of the faces produced by male and female subjects.

However, **women have a higher variance in ratings of sex-objects** (opposite sex for heterosexual, same-sex for homosexual females) than men (Jankowiak et al. 1992; Townsend & Wasserman 1997). But this should be taken with a grain of salt because attractiveness **rankings have much higher variation when ranking males as opposed to females**. Schulman & Hoskins (1986) found that ratings of female photos had statistically significant lower variance than male photos for both male and female raters. Thus, the effect could partially be in that both sexes are worse at judging attractiveness of males.

Of course, the hardest is judging attractiveness in oneself. Rand & Hall (1983) found that females has a .5 correlation between their self-perception of attractiveness and the rating of male judges. Men are much worse, with only a .1 (almost chance) correlation between self-attractiveness ratings and the ratings of female judges.

The story gets even more complicated, because women respond differently to how they load features when producing ratings depending on if they are looking for a short-term or long-term partner (Widerman & Dubois 1998) and even where they are in their menstrual cycle (Penton-Voak & Perrett 2001).

Due to the complicated interaction of all these factors (and more!) **I don't think there is (yet) one final and definitive answer** to your question.

---

### References

* Cunningham, M., Roberts, A.R., Berbee, Anita, P., Druen, P.B., & Wu, C. [1995] ""Their ideas of beauty are, on the whole, the same as ours": Consistency and variability in the cross-cultural perception of female physical attractiveness." Journal of Personality and Social Psychology, 68: 261-279.
* Jankowiak, W.R., Hill, E.M., & Donovan, J.M. [1992] "The effects of sex and sexual orientation on attractiveness judgments: An evolutionary interpretation." Ethology and Sociobiology 13(2): 73-85.
* Johnston, V.S., & Franklin, M. [1993] "Is beauty in the eye of the beholder?" Ethology and Sociobiology 14(3): 183-199.
* Penton-Voak, I.S., & Perrett, D.I. [2001] "Male facial attractiveness: Perceived personality and shifting female preferences for male traits across the menstrual cycle." Advances in the Study of Behavior 30: 219-259.
* Rand, C., & Hall, J. [1983] "Sex differences in the accuracy of self-perceived attractivness." Social Psychology Quarterly, 46: 359-363.
* Townsend, J.M., & Wasserman, T. [1997] "The perception of sexual attractiveness: sex differences in variability." Archives of Sexual Behavior 26(3): 243-268.
* Wiederman, M.W., & Dubois, S.L. [1998] "Evolution and Sex Differences in Preferences for Short-Term Mates: Results from a Policy Capturing Study" Evolution and Human Behavior 19: 153-170.

> **Comments:**
> **username_0**: This was a very informative answer and pretty much answered what I was looking for. I'm going to look into the references you give.  
> **username_5**: +1 for the nice overview and numerous references but .9 sounds unbelievably high. It's higher than most effects in experimental psychology, higher than typical correlations between closely related statements on attitude scales. It would imply virtually no measurement error in attractiveness ratings. I don't know what this number is but it can't be a correlation between individual ratings of any kind and anything else.  

---

