<p><em>This is a big and important topic. The following is a bit of an introduction. Feel free to ask a separate more focussed question.</em></p>

<h3>Some terminology</h3>

<p>In general distinctions are made between the terms bias, fairness, and discrimination.</p>

<ul>
<li><strong>Bias</strong> is a statistical term. Bias for a group can indicate that test scores for that group are systematically lower or higher than would be expected from the group's true score. It is often assessed by seeing whether there is a group by test interaction in predicting the criterion. In particular, just because groups differ in means does not mean the test is biased, the groups may differ on the underlying construct.</li>
<li><strong>Fairness</strong> is a moral and ethical construct. There is scope for different people to value different things. For example, using a test that while unbiased 
, reduces the prevalence of a minority group, may still be seen as unfair. Likewise, affirmative action might be seen as fair in the context of a history of discrimination, yet others may perceive that is being unfair to the non-minority group.</li>
<li><strong>Discrimination</strong> is often used in a legal sense to refer to either direct or indirect forms of discrimination.</li>
</ul>

<h3>Reviewing this area</h3>

<p>I strongly recommend you read page 16.16 onwards (from the section labelled "Improved understanding of subgroup differences") of Sackett and Lieven's (2008, <a href="http://www.numerons.in/files/documents/Personnel-Selection-Paul-R.-Sackett-and-Filip-Lievens.pdf" rel="nofollow">PDF</a>) review. </p>

<p>In particular they note that several good predictors of task performance also show subgroup differences. Thus, there is sometimes a trade-off between validity and adverse impact. For a review of subgroup differences see Hough et al, 2001.</p>

<p>I quote a few sections with particular relevance to the question of what can be done to minimise adverse impact:</p>

<blockquote>
  <p>Sackett et al. (2001) reviewed the cumulative evidence and concluded
  that several proposed mechanisms are not, in fact, effective in
  reducing differences. These include (a) using differential item
  functioning analysis to identify and remove items functioning
  differently by subgroup, (b) providing coaching programs (these may
  improve scores for all, but group differences remain), (c) providing
  more generous time limits (which appears to increase group
  differences, and (d ) altering test taking motivation.</p>
  
  <p>Sackett et al. (2001) did report <strong>some support for expanding the criterion as a means of 
  reducing subgroup differences</strong>. The relative weight given to task,
  citizenship, and counterproductive behavior in forming a composite
  criterion affects the weight given to cognitive predictors. Sackett et
  al. cautioned against differential weighting of criteria solely as a
  means of inﬂuencing predictor subgroup differences; rather, they
  argued that criterion weights should reﬂect the relative emphasis the
  organization concludes is appropriate given its business strategy.
  They also reported some support for expanding the range of predictors
  used. The strategy of supplementing existing cognitive predictors with
  additional predictors outside the cognitive domain can reduce the
  overall subgroup differences in some circumstances. This strategy has
  received considerable attention because broadening the range of
  predictors has the potential to both reduce subgroup differences and increase validity</p>
</blockquote>

<h3>International context</h3>

<p>If you're particularly interested in the international context check out Myors et al (2008) which provides an overview of the context of selection and adverse impact from the perspective of a wide range of different countries.</p>

<h3>General thoughts</h3>

<p>In general, there is also a  wide range of general strategies that we might recommend to increase fairness. e.g., Ensure that choice of selection tools is based on a thorough job analysis and an understanding of the competencies required for the job; Use well-validated measures; standardise decision making processes; minimise potential for cheating; etc.</p>

<h3>References</h3>

<ul>
<li>Hough LM, Oswald FL, Ployhart RE. (2001). Determinants, detection and amelioration of adverse impact in personnel selection procedures: issues, evidence and lessons learned. International Journal Selection &amp; Assessment. 9:152–94.</li>
<li>Myors, B., Lievens, F., Schollaert, E., Van Hoye, G., Cronshaw, S.F., Mladinic, A., Rodr\'\iguez, V., Aguinis, H., Steiner, D.D., Rolland, F. &amp; others (2008). International perspectives on the legal environment for selection. Industrial and Organizational Psychology, 1, 206-246. <a href="http://research.sabanciuniv.edu/10684/1/IOinpress.pdf" rel="nofollow">PDF</a></li>
<li>Sackett PR, Devore CJ. 2001. Counterproductive behaviors at work. See Anderson et al. 2001,
pp. 145–64</li>
<li>Sackett, P.R. &amp; Lievens, F. (2008). Personnel selection. Annu. Rev. Psychol., 59, 419-450. <a href="http://www.numerons.in/files/documents/Personnel-Selection-Paul-R.-Sackett-and-Filip-Lievens.pdf" rel="nofollow">PDF</a></li>
</ul>

CC BY-SA 3.0
2012-07-29T18:49:05.107Z
Thank You very much Jeromy:-) I read, Sackett and Lieven's (2008) yesterday and some other journals as well. I will go through the other journals that you have recommended.In terms of testing in an international context, my interest was on minimizing the dis-advantage local applicants face as a result of language differences (i.e- applicants who are not fluent in English). I went through some of the tests offered by BPS, PFS reasoning and OPP which offer translated versions of the tests into to local languages but they didn't include the country that I am doing my research on. Thank You.
Angie
CC BY-SA 3.0
2012-07-29T23:41:39.040Z
Welcome to the site. Sounds interesting. Feel free to ask other questions about psych testing in selection contexts on the site.
Jeromy Anglim
CC BY-SA 3.0
2012-07-30T11:08:48.740Z
Thank You, actually it is not my first time in the site. you did give me good advice on one of my earlier projects that I did with regard to organizational commitment and I read your journal as well.
Angie
CC BY-SA 3.0
2012-07-29T12:30:22.880Z
2012-07-30T04:07:10.297Z
2012-07-30T04:07:10.297Z
Jeromy Anglim
<p>How can we reduce adverse impacts such as bias, discrimination, and unfairness when using cognitive ability tests and personality tests for selection purposes in an international context?</p>

<io-psychology><measurement><selection-recruitment>
Reducing adverse impact, discrimination and unfairness when using psychological assessments for selection purposes
Angie
# Reducing adverse impact, discrimination and unfairness when using psychological assessments for selection purposes

(Asked by: username_0 on 2012-07-29)

How can we reduce adverse impacts such as bias, discrimination, and unfairness when using cognitive ability tests and personality tests for selection purposes in an international context?

**Tags:** io-psychology, measurement, selection-recruitment


---

## 1 answers

### Answer by username_1 on 2012-07-29. Score: 4 | Accepted answer

*This is a big and important topic. The following is a bit of an introduction. Feel free to ask a separate more focussed question.*

### Some terminology

In general distinctions are made between the terms bias, fairness, and discrimination.

* **Bias** is a statistical term. Bias for a group can indicate that test scores for that group are systematically lower or higher than would be expected from the group's true score. It is often assessed by seeing whether there is a group by test interaction in predicting the criterion. In particular, just because groups differ in means does not mean the test is biased, the groups may differ on the underlying construct.
* **Fairness** is a moral and ethical construct. There is scope for different people to value different things. For example, using a test that while unbiased
  , reduces the prevalence of a minority group, may still be seen as unfair. Likewise, affirmative action might be seen as fair in the context of a history of discrimination, yet others may perceive that is being unfair to the non-minority group.
* **Discrimination** is often used in a legal sense to refer to either direct or indirect forms of discrimination.

### Reviewing this area

I strongly recommend you read page 16.16 onwards (from the section labelled "Improved understanding of subgroup differences") of Sackett and Lieven's (2008, [PDF](http://www.numerons.in/files/documents/Personnel-Selection-Paul-R.-Sackett-and-Filip-Lievens.pdf)) review.

In particular they note that several good predictors of task performance also show subgroup differences. Thus, there is sometimes a trade-off between validity and adverse impact. For a review of subgroup differences see Hough et al, 2001.

I quote a few sections with particular relevance to the question of what can be done to minimise adverse impact:

> Sackett et al. (2001) reviewed the cumulative evidence and concluded
> that several proposed mechanisms are not, in fact, effective in
> reducing differences. These include (a) using differential item
> functioning analysis to identify and remove items functioning
> differently by subgroup, (b) providing coaching programs (these may
> improve scores for all, but group differences remain), (c) providing
> more generous time limits (which appears to increase group
> differences, and (d ) altering test taking motivation.
>
> Sackett et al. (2001) did report **some support for expanding the criterion as a means of
> reducing subgroup differences**. The relative weight given to task,
> citizenship, and counterproductive behavior in forming a composite
> criterion affects the weight given to cognitive predictors. Sackett et
> al. cautioned against differential weighting of criteria solely as a
> means of inﬂuencing predictor subgroup differences; rather, they
> argued that criterion weights should reﬂect the relative emphasis the
> organization concludes is appropriate given its business strategy.
> They also reported some support for expanding the range of predictors
> used. The strategy of supplementing existing cognitive predictors with
> additional predictors outside the cognitive domain can reduce the
> overall subgroup differences in some circumstances. This strategy has
> received considerable attention because broadening the range of
> predictors has the potential to both reduce subgroup differences and increase validity

### International context

If you're particularly interested in the international context check out Myors et al (2008) which provides an overview of the context of selection and adverse impact from the perspective of a wide range of different countries.

### General thoughts

In general, there is also a wide range of general strategies that we might recommend to increase fairness. e.g., Ensure that choice of selection tools is based on a thorough job analysis and an understanding of the competencies required for the job; Use well-validated measures; standardise decision making processes; minimise potential for cheating; etc.

### References

* Hough LM, Oswald FL, Ployhart RE. (2001). Determinants, detection and amelioration of adverse impact in personnel selection procedures: issues, evidence and lessons learned. International Journal Selection & Assessment. 9:152–94.
* Myors, B., Lievens, F., Schollaert, E., Van Hoye, G., Cronshaw, S.F., Mladinic, A., Rodr\'\iguez, V., Aguinis, H., Steiner, D.D., Rolland, F. & others (2008). International perspectives on the legal environment for selection. Industrial and Organizational Psychology, 1, 206-246. [PDF](http://research.sabanciuniv.edu/10684/1/IOinpress.pdf)
* Sackett PR, Devore CJ. 2001. Counterproductive behaviors at work. See Anderson et al. 2001,
  pp. 145–64
* Sackett, P.R. & Lievens, F. (2008). Personnel selection. Annu. Rev. Psychol., 59, 419-450. [PDF](http://www.numerons.in/files/documents/Personnel-Selection-Paul-R.-Sackett-and-Filip-Lievens.pdf)

> **Comments:**
> **username_0**: Thank You very much Jeromy:-) I read, Sackett and Lieven's (2008) yesterday and some other journals as well. I will go through the other journals that you have recommended.In terms of testing in an international context, my interest was on minimizing the dis-advantage local applicants face as a result of language differences (i.e- applicants who are not fluent in English). I went through some of the tests offered by BPS, PFS reasoning and OPP which offer translated versions of the tests into to local languages but they didn't include the country that I am doing my research on. Thank You.  
> **username_1**: Welcome to the site. Sounds interesting. Feel free to ask other questions about psych testing in selection contexts on the site.  
> **username_0**: Thank You, actually it is not my first time in the site. you did give me good advice on one of my earlier projects that I did with regard to organizational commitment and I read your journal as well.  

---

