<p>To answer your initial statement: no, I don't think they do more harm than good. The testing effect has been shown <em>overall</em> to improve scores compared to traditional studying (though only for long term memory, see (Roediger &amp; Karpicke, 2006) for an interesting discussion), implying that it is doing more good than harm. This study assumes an overall positive effect without feedback to learners on whether they were right or wrong, and where students who incorrectly retrieved do not "learn" or maintain memory (Kornell, Bjork, &amp; Garcia, 2011). Providing feedback to learners on correct and incorrect responses, however, will increase retention even for students who did not correctly retrieve, and may be one of the best ways for these students to learn (Kornell, Hays, &amp; Bjork, 2009).</p>

<p><strong>Part 1:</strong> So far as negative learning from selecting an answer, this directly relates to your third question (as mentioned above). Students who got answers correct (successful retrieval) are hypothesized to better maintain memory, while students who didn't will not better maintain (Kornell et al., 2011). Though this seems obvious, remember that retrieval rates naturally decrease over time (the goal is to maintain a high retrieval rate).</p>

<p><strong>Part 2:</strong> In a word, yes. Given this, they each measure different things (and should be used for different purposes). Personally, I use a "post-lecture" quiz as an "exit-ticket" (sorry, background with high school freshman) to quickly check where misconceptions lie. These quizzes are reviewed prior to students leaving the class in order to <em>identify and address misconceptions</em> (formative assessment). I've found that waiting can allow more connections to be made (and thus, higher level responses), but if the material is not encoded correctly <em>false</em> connections can be made (reinforcing incorrect information).</p>

<p><strong>Part 3:</strong> Not reviewing the quiz is hypothesized to create a "bifurcation" where those who got answers right better remember, and those who did not get the answers right steadily decrease (again, a natural pattern in retrieval over time). The "testing effect" exists because <em>overall</em> students are theorized to do better, but again, there will be a split in student growth between those who remembered and those who didn't (Kornell et al., 2011). Reviewing the quiz immediately (if paper, go over the answers right after the quiz!) is hypothesized to help <em>all</em> students, regardless of whether they initially got the correct answer or not, and thus would be the recommended method to improve students' knowledge retention (Kornell et al., 2009).</p>

<p>To summarize: review after taking quizzes acts much like a "studying" effect (where those who got right <em>and</em> wrong answers can learn), while quizzes without review are hypothesized to split learning (those who correctly recall retain, and those who fail to correctly recall don't retain). <em>Both</em> groups are able to be helped through quizzing and reviewing answers.</p>

<p><strong>References</strong></p>

<p>Kornell, N., Bjork, R. A., &amp; Garcia, M. A. (2011). Why tests appear to prevent forgetting: A distribution-based bifurcation model. Journal of Memory and Language, 65(2), 85–97. doi:10.1016/j.jml.2011.04.002</p>

<p>Kornell, N., Hays, M. J., &amp; Bjork, R. A. (2009). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology. Learning, Memory, and Cognition, 35(4), 989–998. doi:10.1037/a0015729</p>

<p>Roediger, H. L., &amp; Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. doi:10.1111/j.1467-9280.2006.01693.x</p>

CC BY-SA 3.0
2015-05-07T15:57:31.897Z
Thank you very much for that. Very interesting, and to the point.
Carl Hamilton
CC BY-SA 3.0
2015-05-03T19:00:01.213Z
2015-05-03T20:11:02.397Z
2015-05-03T20:11:02.397Z
mflo-ByeSE
<p>I use quizzes in teaching, but have started to worry that they do more harm than good.</p>

<p>Here's why: We have all learned from "the testing effect" that the act of taking a test is part of the practice that leads to learning.</p>

<p>Say I give my students a multiple choice quiz, immediately after a lecture, to practice. And let's say question looks like this:</p>

<p>"Who wrote The Blank Slate?</p>

<p>[] Steven Pinker</p>

<p>[] Jessie Pinkman</p>

<p>[] Mr Pink"</p>

<p>A student that did not pay much attention at class, may vaguely recognise the second name, so he checks the middle box and moves on. </p>

<p><strong>Has the student now reinforced the incorrect option, and thus created a net negative learning?</strong></p>

<p>And then, as a part two of the same question:</p>

<p>Does it make a difference if the test is done on the same day as the lecture, when the new knowledge is still fluent, or after sleep, when the new knowledge is consolidated (and weak memories culled)?</p>

<p>Part three: Does it make a difference if the quiz is on paper, and thus gives no direct feedback, or online, and can indicate the correct answer?</p>

<p>I have searched Google Scholar extensively, but not found anything on this.</p>

CC BY-SA 3.0
2015-04-25T20:15:09.047Z
briefly: you're on the right track, but the issue of false memories is a peripheral concern. the student should submit their answer and get immediate feedback. the feedback would include the correct answer and a detailed explanation why. moreover, you would include reasons why the other options are incorrect. you should allow them to complete the quiz as many times as they wish. regarding optimum learning, research the effects of spaced repetition and memory consolidation. regularly spaced learning enhances learning -- look up ebbinghaus' forgetfulness curve.
faustus
CC BY-SA 3.0
2015-04-26T10:14:35.310Z
@faustus I think the question is more along the lines of retrieval-induced forgetting (though in case I guess "lure-induced learning" is more apt).
Christian Hummeluhr
<memory>
Do distractors create false learning in multiple choice questions?
Carl Hamilton
# Do distractors create false learning in multiple choice questions?

(Asked by: username_0 on 2015-04-25)

I use quizzes in teaching, but have started to worry that they do more harm than good.

Here's why: We have all learned from "the testing effect" that the act of taking a test is part of the practice that leads to learning.

Say I give my students a multiple choice quiz, immediately after a lecture, to practice. And let's say question looks like this:

"Who wrote The Blank Slate?

[] Steven Pinker

[] Jessie Pinkman

[] Mr Pink"

A student that did not pay much attention at class, may vaguely recognise the second name, so he checks the middle box and moves on.

**Has the student now reinforced the incorrect option, and thus created a net negative learning?**

And then, as a part two of the same question:

Does it make a difference if the test is done on the same day as the lecture, when the new knowledge is still fluent, or after sleep, when the new knowledge is consolidated (and weak memories culled)?

Part three: Does it make a difference if the quiz is on paper, and thus gives no direct feedback, or online, and can indicate the correct answer?

I have searched Google Scholar extensively, but not found anything on this.

**Tags:** memory

> **Comments:**
> **username_1**: briefly: you're on the right track, but the issue of false memories is a peripheral concern. the student should submit their answer and get immediate feedback. the feedback would include the correct answer and a detailed explanation why. moreover, you would include reasons why the other options are incorrect. you should allow them to complete the quiz as many times as they wish. regarding optimum learning, research the effects of spaced repetition and memory consolidation. regularly spaced learning enhances learning -- look up ebbinghaus' forgetfulness curve.  
> **username_2**: @username_1 I think the question is more along the lines of retrieval-induced forgetting (though in case I guess "lure-induced learning" is more apt).  

---

## 1 answers

### Answer by username_3 on 2015-05-03. Score: 6 | Accepted answer

To answer your initial statement: no, I don't think they do more harm than good. The testing effect has been shown *overall* to improve scores compared to traditional studying (though only for long term memory, see (Roediger & Karpicke, 2006) for an interesting discussion), implying that it is doing more good than harm. This study assumes an overall positive effect without feedback to learners on whether they were right or wrong, and where students who incorrectly retrieved do not "learn" or maintain memory (Kornell, Bjork, & Garcia, 2011). Providing feedback to learners on correct and incorrect responses, however, will increase retention even for students who did not correctly retrieve, and may be one of the best ways for these students to learn (Kornell, Hays, & Bjork, 2009).

**Part 1:** So far as negative learning from selecting an answer, this directly relates to your third question (as mentioned above). Students who got answers correct (successful retrieval) are hypothesized to better maintain memory, while students who didn't will not better maintain (Kornell et al., 2011). Though this seems obvious, remember that retrieval rates naturally decrease over time (the goal is to maintain a high retrieval rate).

**Part 2:** In a word, yes. Given this, they each measure different things (and should be used for different purposes). Personally, I use a "post-lecture" quiz as an "exit-ticket" (sorry, background with high school freshman) to quickly check where misconceptions lie. These quizzes are reviewed prior to students leaving the class in order to *identify and address misconceptions* (formative assessment). I've found that waiting can allow more connections to be made (and thus, higher level responses), but if the material is not encoded correctly *false* connections can be made (reinforcing incorrect information).

**Part 3:** Not reviewing the quiz is hypothesized to create a "bifurcation" where those who got answers right better remember, and those who did not get the answers right steadily decrease (again, a natural pattern in retrieval over time). The "testing effect" exists because *overall* students are theorized to do better, but again, there will be a split in student growth between those who remembered and those who didn't (Kornell et al., 2011). Reviewing the quiz immediately (if paper, go over the answers right after the quiz!) is hypothesized to help *all* students, regardless of whether they initially got the correct answer or not, and thus would be the recommended method to improve students' knowledge retention (Kornell et al., 2009).

To summarize: review after taking quizzes acts much like a "studying" effect (where those who got right *and* wrong answers can learn), while quizzes without review are hypothesized to split learning (those who correctly recall retain, and those who fail to correctly recall don't retain). *Both* groups are able to be helped through quizzing and reviewing answers.

**References**

Kornell, N., Bjork, R. A., & Garcia, M. A. (2011). Why tests appear to prevent forgetting: A distribution-based bifurcation model. Journal of Memory and Language, 65(2), 85–97. doi:10.1016/j.jml.2011.04.002

Kornell, N., Hays, M. J., & Bjork, R. A. (2009). Unsuccessful retrieval attempts enhance subsequent learning. Journal of Experimental Psychology. Learning, Memory, and Cognition, 35(4), 989–998. doi:10.1037/a0015729

Roediger, H. L., & Karpicke, J. D. (2006). Test-enhanced learning: Taking memory tests improves long-term retention. Psychological Science, 17(3), 249–255. doi:10.1111/j.1467-9280.2006.01693.x

> **Comments:**
> **username_0**: Thank you very much for that. Very interesting, and to the point.  

---

