<p>Short answer: 
construct a usable chair out of toothpicks. Now, I certainly can't do this, but I can verify your answer easily enough</p>

<p>Long answer:
Verification of answers is often a lot easier than producing answers. And thats not just anecdotal, there are computational and psychological reasons behind this fact.</p>

<p>Computationally - complexity is different for solving a problem than for verifying it. For example the clad of NP problem cant (probably) be solved in poly time, but they can be verified in poly time.</p>

<p>Psychologically - think recall versus recognition. Recognition just involves your brain lighting up when it sees the right answer, whilst recall or production requires an extensive search at the very least</p>

<p>So the answer is that the test makers don't have produce the answers themselves, and certainly not under test conditions. They simply have to be able to see that the right answer is right (either produced via a group, a computer, or a genius).</p>

<p>Also, remember that no one question separates high IQs from low. Perhaps a 140IQ could answer one of the hardest questions, but not all of them.</p>

<p>Lastly, remember than IQ isn't a single dimension, perhaps the test was written by one expert in each dimension, which could then identify a genius in all dimensions </p>

CC BY-SA 3.0
2012-01-19T10:47:22.933Z
+1 I have a feeling that there's something still missing here. The question is framed in a far more obvious way, I wonder if we cannot offer a more straightforward single point answer. There must be one, I still feel.
Kris
CC BY-SA 3.0
2012-01-21T10:32:48.030Z
Nice answer. But actually, IQ tests are a poor in measuring extremely high intelligence. Even if you assign a number to a person I doubt if gives any worthy information. Perhaps it is about lack of comparison, increasing number of dimensions or psychometricians being not able to make a task conceptually way beyond them.
Piotr Migdal
CC BY-SA 3.0
2012-01-21T17:29:31.030Z
Piotr's answer is not complete either.  Intelligence tests are poor at measuring any range of intelligences they are not intended to measure.  Most intelligence tests have items that discriminate among people from -1 SD to +2 SD (maybe +3).  If someone falls outside that range, it won't measure them accurately.  But that doesn't mean they _can't_.  An intelligence test could certainly be developed to discriminate among people from +2 SD to +5 SD.  It's just that there are relatively few people high enough to justify extensive effort at doing so (at least, for most test designers).
richard
CC BY-SA 3.0
2012-01-19T02:15:24.310Z
2012-01-19T02:15:24.310Z
zergylord
<p>In a comment above, Kris hopes for a more obvious answer to the question than the [very good] answers zergylord gave.  So here's one more explanation that strikes me as almost too obvious to mention: test making and test taking are temporally asymmetric.  One can spend fifteen minutes creating  a question that must be answered in less time.  This kind of time differential is extremely diagnostic -- a smart person and a dumb person might both be able to solve the missionaries and cannibals problem, but the smart person does so much more quickly.</p>

CC BY-SA 3.0
2013-08-29T20:34:19.907Z
but it's worth remembering that human effort (unlike, say, computer processor power) rarely scales according to any predictable algorithm. so just because 20 people are working on a problem doesn't mean they'll come up with a solution 20x better than a single person working on that problem.
Krysta
CC BY-SA 3.0
2012-01-21T17:32:39.777Z
This is an excellent point.  Also keep in mind that many of these tests are developed by lots of smart people working in teams.  20 intelligent people with unlimited time working to develop items can develop items that would make a single extremely intelligent person struggle with limited time.
richard
CC BY-SA 3.0
2012-01-21T07:49:08.757Z
2012-01-21T07:49:08.757Z
shanusmagnus
<p>Above answers are great, I just wanted to add that you do not need a 'smart' person to create IQ test... you or me could do it... Any set of questions would measure one or more dimensions of intelligence... </p>

<p>You would give your set of questions to many people and their results would show up as <a href="https://en.wikipedia.org/wiki/Normal_distribution" rel="nofollow noreferrer">Gaussian</a>. You would then assign 100 IQ point at the peak and subdivide the Gaussian into parts by <a href="https://en.wikipedia.org/wiki/Normal_distribution#Standard_deviation_and_coverage" rel="nofollow noreferrer">standard deviation</a> where each segment would <a href="https://en.wikipedia.org/wiki/IQ_classification" rel="nofollow noreferrer">be your 10 IQ point increment</a>...</p>

<p><a href="https://i.sstatic.net/o7ZzS.png" rel="nofollow noreferrer"><img src="https://i.sstatic.net/o7ZzS.png" alt="enter image description here"></a></p>

<p>P.S Don't get me wrong chances are it wouldn't be the best IQ test but test nevertheless...</p>

CC BY-SA 3.0
2016-12-20T10:16:22.003Z
2016-12-20T10:16:22.003Z
Matas Vaitkevicius
<p>After all, while psychometricians definitely have above-average IQs, they probably don't have IQs over, say, 160.</p>

<p>If psychometricians already know what the right answers are (and how to obtain the right answer), then wouldn't they score very high on the tests, even if they're not THAT smart? (making it possible for other people to score high on the tests if they studied psychometrics as well?) The format of the test isn't going to vary that much from administration to administration. Of course, the tests are timed, but it's entirely possible that the practice the psychometricians get from writing the tests could easily make them better at each of the subsets of an IQ test.</p>

CC BY-SA 3.0
2012-01-21T15:42:22.540Z
It's important to note that these tests have evolved generally over decades with through research and dozens of people constructing the test. A single person couldn't easily construct such a test but that's not the situation.
Zelda
<intelligence>
How is it possible for psychometricians to develop IQ tests for people smarter than them?
InquilineKea
# How is it possible for psychometricians to develop IQ tests for people smarter than them?

(Asked by: username_0 on 2012-01-19)

After all, while psychometricians definitely have above-average IQs, they probably don't have IQs over, say, 160.

If psychometricians already know what the right answers are (and how to obtain the right answer), then wouldn't they score very high on the tests, even if they're not THAT smart? (making it possible for other people to score high on the tests if they studied psychometrics as well?) The format of the test isn't going to vary that much from administration to administration. Of course, the tests are timed, but it's entirely possible that the practice the psychometricians get from writing the tests could easily make them better at each of the subsets of an IQ test.

**Tags:** intelligence

> **Comments:**
> **username_1**: It's important to note that these tests have evolved generally over decades with through research and dozens of people constructing the test. A single person couldn't easily construct such a test but that's not the situation.  

---

## 3 answers

### Answer by username_2 on 2012-01-19. Score: 13

Short answer:
construct a usable chair out of toothpicks. Now, I certainly can't do this, but I can verify your answer easily enough

Long answer:
Verification of answers is often a lot easier than producing answers. And thats not just anecdotal, there are computational and psychological reasons behind this fact.

Computationally - complexity is different for solving a problem than for verifying it. For example the clad of NP problem cant (probably) be solved in poly time, but they can be verified in poly time.

Psychologically - think recall versus recognition. Recognition just involves your brain lighting up when it sees the right answer, whilst recall or production requires an extensive search at the very least

So the answer is that the test makers don't have produce the answers themselves, and certainly not under test conditions. They simply have to be able to see that the right answer is right (either produced via a group, a computer, or a genius).

Also, remember that no one question separates high IQs from low. Perhaps a 140IQ could answer one of the hardest questions, but not all of them.

Lastly, remember than IQ isn't a single dimension, perhaps the test was written by one expert in each dimension, which could then identify a genius in all dimensions

> **Comments:**
> **username_3**: +1 I have a feeling that there's something still missing here. The question is framed in a far more obvious way, I wonder if we cannot offer a more straightforward single point answer. There must be one, I still feel.  
> **username_4**: Nice answer. But actually, IQ tests are a poor in measuring extremely high intelligence. Even if you assign a number to a person I doubt if gives any worthy information. Perhaps it is about lack of comparison, increasing number of dimensions or psychometricians being not able to make a task conceptually way beyond them.  
> **username_5**: Piotr's answer is not complete either.  Intelligence tests are poor at measuring any range of intelligences they are not intended to measure.  Most intelligence tests have items that discriminate among people from -1 SD to +2 SD (maybe +3).  If someone falls outside that range, it won't measure them accurately.  But that doesn't mean they _can't_.  An intelligence test could certainly be developed to discriminate among people from +2 SD to +5 SD.  It's just that there are relatively few people high enough to justify extensive effort at doing so (at least, for most test designers).  

---

### Answer by username_6 on 2012-01-21. Score: 7

In a comment above, username_3 hopes for a more obvious answer to the question than the [very good] answers username_2 gave. So here's one more explanation that strikes me as almost too obvious to mention: test making and test taking are temporally asymmetric. One can spend fifteen minutes creating a question that must be answered in less time. This kind of time differential is extremely diagnostic -- a smart person and a dumb person might both be able to solve the missionaries and cannibals problem, but the smart person does so much more quickly.

> **Comments:**
> **username_5**: This is an excellent point.  Also keep in mind that many of these tests are developed by lots of smart people working in teams.  20 intelligent people with unlimited time working to develop items can develop items that would make a single extremely intelligent person struggle with limited time.  
> **username_7**: but it's worth remembering that human effort (unlike, say, computer processor power) rarely scales according to any predictable algorithm. so just because 20 people are working on a problem doesn't mean they'll come up with a solution 20x better than a single person working on that problem.  

---

### Answer by username_8 on 2016-12-20. Score: 2

Above answers are great, I just wanted to add that you do not need a 'smart' person to create IQ test... you or me could do it... Any set of questions would measure one or more dimensions of intelligence...

You would give your set of questions to many people and their results would show up as [Gaussian](https://en.wikipedia.org/wiki/Normal_distribution). You would then assign 100 IQ point at the peak and subdivide the Gaussian into parts by [standard deviation](https://en.wikipedia.org/wiki/Normal_distribution#Standard_deviation_and_coverage) where each segment would [be your 10 IQ point increment](https://en.wikipedia.org/wiki/IQ_classification)...

[![enter image description here](https://i.sstatic.net/o7ZzS.png)](https://i.sstatic.net/o7ZzS.png)

P.S Don't get me wrong chances are it wouldn't be the best IQ test but test nevertheless...


---

