<p>As a matter of anecdote, I've used some of this data for teaching purposes, and I've heard of others doing the same. </p>

<p>As Bryan notes, there is a list of journal articles that have used the data: <a href="https://openpsychometrics.org/_rawdata/cited/" rel="nofollow noreferrer">https://openpsychometrics.org/_rawdata/cited/</a> This includes many well-regarded journals in personality and individual differences research. </p>

<p>One main limitation is that the data tends to be based around single scales. In contrast, I imagine in a lot of uses cases for potential publications rely on relating multiple scales with each other.</p>

<p>That said, I imagine these datasets could be useful for examining various general questions about scale properties and test structure. You could also  look at  demographic correlates of test scores. And the data would be interesting if you were interested in the psychometric properties of the specific tests that are reported.</p>

<p>A second limitation is that there seems to be limited information about the nature of data collection and data cleaning. That said, for many purposes, a massive online convenience sample of online participants may be useful.</p>

CC BY-SA 4.0
2020-02-06T05:18:57.810Z
2020-02-06T05:18:57.810Z
Jeromy Anglim
<p>I am not a psychologist/psychology student, but I've just recently discovered the Open-Source Psychometrics Project, and I think it's great. </p>

<p>To my untrained eyes, it seems like they have solid methodology and are collecting a huge amount of data: <a href="https://openpsychometrics.org/_rawdata/" rel="nofollow noreferrer">https://openpsychometrics.org/_rawdata/</a></p>

<p>But I'm wondering how it's been received by the research psychology community?</p>

<p>Is it considered a reputable data source?</p>

<p>Have there been any serious evaluations of its methodology or data?</p>

<measurement><experimental-psychology><reproducible-research>
Has the Open-Source Psychometrics Project been well received by the community?
AaronMW
# Has the Open-Source Psychometrics Project been well received by the community?

(Asked by: username_0 on 2020-02-05)

I am not a psychologist/psychology student, but I've just recently discovered the Open-Source Psychometrics Project, and I think it's great.

To my untrained eyes, it seems like they have solid methodology and are collecting a huge amount of data: <https://openpsychometrics.org/_rawdata/>

But I'm wondering how it's been received by the research psychology community?

Is it considered a reputable data source?

Have there been any serious evaluations of its methodology or data?

**Tags:** measurement, experimental-psychology, reproducible-research


---

## 1 answers

### Answer by username_1 on 2020-02-06. Score: 3 | Accepted answer

As a matter of anecdote, I've used some of this data for teaching purposes, and I've heard of others doing the same.

As Bryan notes, there is a list of journal articles that have used the data: <https://openpsychometrics.org/_rawdata/cited/> This includes many well-regarded journals in personality and individual differences research.

One main limitation is that the data tends to be based around single scales. In contrast, I imagine in a lot of uses cases for potential publications rely on relating multiple scales with each other.

That said, I imagine these datasets could be useful for examining various general questions about scale properties and test structure. You could also look at demographic correlates of test scores. And the data would be interesting if you were interested in the psychometric properties of the specific tests that are reported.

A second limitation is that there seems to be limited information about the nature of data collection and data cleaning. That said, for many purposes, a massive online convenience sample of online participants may be useful.


---

