<p>There are lots of commonly observed biases in surveys, and a whole field of survey methodology and statistics which investigates them. To get an idea of this, take a look at the table of contents of these journals:
<a href="http://poq.oxfordjournals.org/content/current" rel="nofollow">http://poq.oxfordjournals.org/content/current</a>
<a href="http://jssam.oxfordjournals.org/content/current" rel="nofollow">http://jssam.oxfordjournals.org/content/current</a></p>

<p>Many people in this field are dealing with large data-sets (e.g., national censuses with many thousands of respondents), and they concentrate on things like estimating non-responses statistically (to take into account that some people with some opinions are less likely to complete the survey in the first place). Other widely investigated biases include "social desirability", which is the issue that people often respond with what is most social acceptable, even if it is not necessarily accurate.</p>

<p>However, your question suggests you are looking on a smaller scale. Although it is a bit old, <a href="http://www.annualreviews.org/doi/abs/10.1146/annurev.psych.50.1.537" rel="nofollow">this</a> is a nice review of cross-overs between psychology and survey statistics. Not sure if the full article is stuck behind a paywall. <a href="http://pages.ucsd.edu/~cmckenzie/Schwarz1999AmPsychologist.pdf" rel="nofollow">This</a> covers some similar ground.</p>

<p><strong>RE: Your first identified issue</strong>, I assume that by "average" rating, you mean that people tend to choose the middle scale point if they are unsure (obviously they don't normally know the true average/mean response from their peers). There is evidence of this (see the Schwarz article above). From the abstract of <a href="http://poq.oxfordjournals.org/content/49/3/388.short" rel="nofollow">Schwarz et al., 1985</a>:</p>

<blockquote>
  <p>These results indicate that subjects inferred the average amount of
  television watching from the response alternatives provided them and
  used it as a standard of comparison in evaluating their behavior and
  its implications.</p>
</blockquote>

<p>What this means is that you should be a bit careful about choosing your scale (people will use the end points to evaluate what the average rating is). However, normally you are interested in relative deviations from this (which seats are rated higher or lower than average <em>relative to other seats</em>), so this is an issue only if you are seeking a "real number" answer (such as the number of hours people watch TV). One way to counteract the "centering" bias is to use a 4 or 6-point scale rather than an odd number (so that there is no exact centre option) A related issue is that people are often reluctant to choose the most extreme options ("endpoint bias"). The <a href="https://en.wikipedia.org/wiki/Likert_scale" rel="nofollow">wiki on Likert scales</a> has some information about this, assuming you are using such a scale.</p>

<p><strong>RE: Your second issue</strong>, yes, question order matters. People often spend less time and respond differently on later questions (e.g., <a href="https://poq.oxfordjournals.org/content/73/2/349.full" rel="nofollow">this</a> paper). The specific issues of anchoring responses are discussed <a href="http://isites.harvard.edu/fs/docs/icb.topic181820.files/Gehlbach-Anchoring_and_Adjusting.pdf" rel="nofollow">here</a>. However, In your case this should be easy to control for by randomising the order in which they sit in the vehicles.</p>

CC BY-SA 3.0
2016-03-18T12:13:14.663Z
2016-03-18T12:13:14.663Z
splint
<p>What are the commonly observed biases in survey and are there any statistical or non-statistical methods to avoid it?</p>

<p>I am conducting a survey for automobile seat comfort, I think my current methodology may have following issues :</p>

<p>Subjects may give average rating when they are unsure</p>

<p>Subjective rating may be anchored on the first vehicle subject sits in</p>

<bias><survey>
Biases in subjective survey
Siddhesh
# Biases in subjective survey

(Asked by: username_0 on 2016-03-16)

What are the commonly observed biases in survey and are there any statistical or non-statistical methods to avoid it?

I am conducting a survey for automobile seat comfort, I think my current methodology may have following issues :

Subjects may give average rating when they are unsure

Subjective rating may be anchored on the first vehicle subject sits in

**Tags:** bias, survey


---

## 1 answers

### Answer by username_1 on 2016-03-18. Score: 1

There are lots of commonly observed biases in surveys, and a whole field of survey methodology and statistics which investigates them. To get an idea of this, take a look at the table of contents of these journals:
<http://poq.oxfordjournals.org/content/current>
<http://jssam.oxfordjournals.org/content/current>

Many people in this field are dealing with large data-sets (e.g., national censuses with many thousands of respondents), and they concentrate on things like estimating non-responses statistically (to take into account that some people with some opinions are less likely to complete the survey in the first place). Other widely investigated biases include "social desirability", which is the issue that people often respond with what is most social acceptable, even if it is not necessarily accurate.

However, your question suggests you are looking on a smaller scale. Although it is a bit old, [this](http://www.annualreviews.org/doi/abs/10.1146/annurev.psych.50.1.537) is a nice review of cross-overs between psychology and survey statistics. Not sure if the full article is stuck behind a paywall. [This](http://pages.ucsd.edu/~cmckenzie/Schwarz1999AmPsychologist.pdf) covers some similar ground.

**RE: Your first identified issue**, I assume that by "average" rating, you mean that people tend to choose the middle scale point if they are unsure (obviously they don't normally know the true average/mean response from their peers). There is evidence of this (see the Schwarz article above). From the abstract of [Schwarz et al., 1985](http://poq.oxfordjournals.org/content/49/3/388.short):

> These results indicate that subjects inferred the average amount of
> television watching from the response alternatives provided them and
> used it as a standard of comparison in evaluating their behavior and
> its implications.

What this means is that you should be a bit careful about choosing your scale (people will use the end points to evaluate what the average rating is). However, normally you are interested in relative deviations from this (which seats are rated higher or lower than average *relative to other seats*), so this is an issue only if you are seeking a "real number" answer (such as the number of hours people watch TV). One way to counteract the "centering" bias is to use a 4 or 6-point scale rather than an odd number (so that there is no exact centre option) A related issue is that people are often reluctant to choose the most extreme options ("endpoint bias"). The [wiki on Likert scales](https://en.wikipedia.org/wiki/Likert_scale) has some information about this, assuming you are using such a scale.

**RE: Your second issue**, yes, question order matters. People often spend less time and respond differently on later questions (e.g., [this](https://poq.oxfordjournals.org/content/73/2/349.full) paper). The specific issues of anchoring responses are discussed [here](http://isites.harvard.edu/fs/docs/icb.topic181820.files/Gehlbach-Anchoring_and_Adjusting.pdf). However, In your case this should be easy to control for by randomising the order in which they sit in the vehicles.


---

