<p>This is a great question.</p>

<p><strong>Short answer:</strong> No, the evidence does not suggest that positive reinforcement is universally more effective than negative reinforcement or punishment.  However, there are still good reasons to focus on rewards over punishment in real-life training/learning situations.</p>

<p><strong>Long answer:</strong></p>

<p>The trouble for folk psychology began with Skinner's somewhat unfortunate <a href="http://en.wikipedia.org/wiki/Operant_conditioning#Tools_and_procedures" rel="nofollow">choice of terminology</a>...  While Skinner advocated positive reinforcement over negative reinforcement or punishment, it seems to have remained an industry secret that what he meant by those terms is not what the general public thinks he meant.</p>

<p><a href="http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2755378/" rel="nofollow">The modern view</a> of positive and negative reinforcement is that they are essentially synonyms.  They are different ways of looking at the same thing, like describing a glass of water based on how full or how empty it is.  Computationally, as you say, learning algorithms that assign positive values to targets or negative values to non-targets are mathematically equivalent.</p>

<p>Although they are often confused with positive and negative reinforcement, <a href="http://en.wikipedia.org/wiki/Reward_system" rel="nofollow">rewards</a> and <a href="http://en.wikipedia.org/wiki/Aversives" rel="nofollow">aversives</a> are different terms with different meanings.  Testing whether one is more effective than the other is tricky, as in practice they are usually <em>qualitatively</em> different.  For example, is ice cream or spanking more effective for getting your kid to do their homework?  The answer is: It depends - how much ice cream, how much spanking...?  Surely we can find a ratio of ice cream to spanking at which they are equally effective.  The type of research that examines this question is interested in determining where that boundary is (here is an <a href="http://onlinelibrary.wiley.com/doi/10.1901/jaba.2007.151-05/abstract" rel="nofollow">example</a>).  Thought experiment: How can qualitatively different feedback mechanisms be applied in machine learning?</p>

<p>Research more likely to answer your question compares positive and negative feedback that is arguably qualitatively equivalent.  For example, compare gaining money to avoiding loss of money, reducing risk to avoiding increase in risk, and it's even possible to compare the effects on animals that are trained in a <a href="http://en.wikipedia.org/wiki/Token_economy" rel="nofollow">token economy</a>.  In recent years, the folk psychology idea that positive feedback is universally superior to negative feedback has been called into question by such research.  A few examples:</p>

<ul>
<li>Michael Perone reviews research demonstrating <a href="http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2731445/" rel="nofollow">undesirable effects of positive reinforcement</a>.</li>
<li>Comparing "well done!" to "got it wrong this time", Eveline Crone et al found that before the age of twelve, children perform better with positive feedback, but older children and adults <a href="http://www.jneurosci.org/content/28/38/9495.abstract" rel="nofollow">do better with negative feedback</a>.</li>
<li>A study comparing "keep the word Good on the screen" to "keep the word Bad off the screen" found that <a href="http://www.ncbi.nlm.nih.gov/pubmed/12543481" rel="nofollow">negative reinforcement may be more effective</a> for some types of learning.</li>
<li>Ayelet Fishbach and Stacey Finkelstein review research that suggests that <a href="http://www.jstor.org/discover/10.1086/661934?uid=2129&amp;uid=2&amp;uid=70&amp;uid=4&amp;sid=21105110770501" rel="nofollow">negative feedback is more effective</a> for experts, and motivates goal pursuit when it <a href="http://onlinelibrary.wiley.com/doi/10.1111/j.1751-9004.2010.00285.x/abstract?deniedAccessCustomisedMessage=&amp;userIsAuthenticated=false" rel="nofollow">signals insufficient progress</a>.</li>
<li>Lots of research into <a href="http://en.wikipedia.org/wiki/Loss_aversion" rel="nofollow">Loss Aversion</a> suggests that avoiding the loss of money is a more powerful motivator than gaining an equivalent amount of money.  However, this phenomenon <a href="http://onlinelibrary.wiley.com/doi/10.1901/jeab.2008.90-1/abstract" rel="nofollow">may not translate</a> to an effect on learning.</li>
<li>Despite all this, note that the evidence in favour of positive reinforcement is much greater - these are just some notable exceptions.</li>
</ul>

<p><a href="http://en.wikipedia.org/wiki/Operant_conditioning#Biological_correlates_of_operant_conditioning" rel="nofollow">Neurological reasons</a> for the difference in effectiveness between positive and negative feedback have been proposed - for example by Eveline Crone in the study cited above.</p>

<p>Training using rewards is preferred for animal trainers, parents, and teachers in most practical situations:</p>

<ul>
<li>There is usually a much wider range of undesirable behaviour to punish than desirable behaviour to reward.  Animals and young children have difficulty determining what the desirable behaviour is with only clues about what behaviours are undesirable.  Adults are easier to work with because you can explain the desirable behaviour in words.</li>
<li>Punishment must be applied to all undesirable behaviour to be effective, while reward need only be applied to desirable behaviour, and even then only intermittently, to be effective.</li>
<li>Due to classical conditioning, subjects may attribute punishment to factors unrelated to their behaviour, such as the trainer or the classroom.  They may learn to avoid the trainer, or avoid getting caught, rather than the desirable behaviour.</li>
<li>Notice how none of these points apply to machine learning, where the process is structured, constrained, and automated.</li>
</ul>

<p>John Maag summarizes reasons to <a href="http://scholar.google.ca/citations?view_op=view_citation&amp;hl=en&amp;user=KPfeI_oAAAAJ&amp;citation_for_view=KPfeI_oAAAAJ:u5HHmVD_uO8C" rel="nofollow">promote positive reinforcement</a> in schools: Namely that teachers often find it convenient and effective (in the short-term) to administer punishment and are overly reliant on it in many situations where positive reinforcement would be more effective and desirable.</p>

<p>Nice <a href="https://www.youtube.com/watch?v=1tSqSMOyNFE" rel="nofollow">video</a> on the topic.</p>

CC BY-SA 3.0
2015-01-20T07:25:04.077Z
2015-02-01T04:45:54.403Z
2015-02-01T04:45:54.403Z
Arnon Weinberg
<p>Its folk psychology wisdom that its easier to reward positive behavior than punish negative behavior (e.g. any book on parenting or dog training), but is there any evidence in the cognitive science literature that this is indeed the case? And if so, then have possible mechanisms for this phenomena been proposed?</p>

<p>For some context, I'm asking this because coming from a computational perspective this doesn't really make sense. The typical reinforcement learning algorithm tries to maximize the expected discounted cumulative reward of behavior, and it makes no difference if that entails avoiding negative rewards or seeking out positive rewards. </p>

CC BY-SA 3.0
2015-01-15T02:21:36.743Z
I think, didactically spoken, positive reinforcement is *better*, especially in kids that don't really grasp negative reinforcement. However, in certain experimental lab conditions, negative reinforcement may work a lot *faster* and have *longer-lasting* effects :) I think it depends heavily on the context.
AliceD
CC BY-SA 3.0
2015-01-15T03:24:31.307Z
Seem to be two different questions: "Positive rewards learned faster?" and "Easier to reward positive behavior?" 
The first does not take into account difficulty. As for the first one, the [negativity bias](http://en.wikipedia.org/wiki/Negativity_bias) would seem to be against it.
dwn
CC BY-SA 3.0
2015-01-20T03:14:33.397Z
@what This is precisely the sort of folk intuition that I'd like to back up with empirical evidence. Obviousness is a terrible replacement for true experimentation.
zergylord
CC BY-SA 3.0
2015-01-20T22:11:40.723Z
@what what is the obvious statement that doesn't need to be shown? That beating children is a less effective at getting them to learn than smiling at them? Seems like a non-obvious statement to me, especially given the history of education. I've definitely heard the sentiment you're expressed before, and it does seem to be a central part of modern perspectives in education, at least in the west. But dismissing zergylord with a story or apples-and-oranges is not conducive to learning, nor is his caution unwarranted given how notorious educational-psych is for not doing well controlled studies.
Artem Kaznatcheev
<reinforcement-learning>
Evidence that positive rewards are learnt faster than negative rewards?
zergylord
# Evidence that positive rewards are learnt faster than negative rewards?

(Asked by: username_0 on 2015-01-14)

Its folk psychology wisdom that its easier to reward positive behavior than punish negative behavior (e.g. any book on parenting or dog training), but is there any evidence in the cognitive science literature that this is indeed the case? And if so, then have possible mechanisms for this phenomena been proposed?

For some context, I'm asking this because coming from a computational perspective this doesn't really make sense. The typical reinforcement learning algorithm tries to maximize the expected discounted cumulative reward of behavior, and it makes no difference if that entails avoiding negative rewards or seeking out positive rewards.

**Tags:** reinforcement-learning

> **Comments:**
> **username_1**: I think, didactically spoken, positive reinforcement is *better*, especially in kids that don't really grasp negative reinforcement. However, in certain experimental lab conditions, negative reinforcement may work a lot *faster* and have *longer-lasting* effects :) I think it depends heavily on the context.  
> **username_2**: Seem to be two different questions: "Positive rewards learned faster?" and "Easier to reward positive behavior?"  The first does not take into account difficulty. As for the first one, the [negativity bias](http://en.wikipedia.org/wiki/Negativity_bias) would seem to be against it.  
> **username_0**: @what This is precisely the sort of folk intuition that I'd like to back up with empirical evidence. Obviousness is a terrible replacement for true experimentation.  
> **username_3**: @what what is the obvious statement that doesn't need to be shown? That beating children is a less effective at getting them to learn than smiling at them? Seems like a non-obvious statement to me, especially given the history of education. I've definitely heard the sentiment you're expressed before, and it does seem to be a central part of modern perspectives in education, at least in the west. But dismissing username_0 with a story or apples-and-oranges is not conducive to learning, nor is his caution unwarranted given how notorious educational-psych is for not doing well controlled studies.  

---

## 1 answers

### Answer by username_4 on 2015-01-20. Score: 8 | Accepted answer

This is a great question.

**Short answer:** No, the evidence does not suggest that positive reinforcement is universally more effective than negative reinforcement or punishment. However, there are still good reasons to focus on rewards over punishment in real-life training/learning situations.

**Long answer:**

The trouble for folk psychology began with Skinner's somewhat unfortunate [choice of terminology](http://en.wikipedia.org/wiki/Operant_conditioning#Tools_and_procedures)... While Skinner advocated positive reinforcement over negative reinforcement or punishment, it seems to have remained an industry secret that what he meant by those terms is not what the general public thinks he meant.

[The modern view](http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2755378/) of positive and negative reinforcement is that they are essentially synonyms. They are different ways of looking at the same thing, like describing a glass of water based on how full or how empty it is. Computationally, as you say, learning algorithms that assign positive values to targets or negative values to non-targets are mathematically equivalent.

Although they are often confused with positive and negative reinforcement, [rewards](http://en.wikipedia.org/wiki/Reward_system) and [aversives](http://en.wikipedia.org/wiki/Aversives) are different terms with different meanings. Testing whether one is more effective than the other is tricky, as in practice they are usually *qualitatively* different. For example, is ice cream or spanking more effective for getting your kid to do their homework? The answer is: It depends - how much ice cream, how much spanking...? Surely we can find a ratio of ice cream to spanking at which they are equally effective. The type of research that examines this question is interested in determining where that boundary is (here is an [example](http://onlinelibrary.wiley.com/doi/10.1901/jaba.2007.151-05/abstract)). Thought experiment: How can qualitatively different feedback mechanisms be applied in machine learning?

Research more likely to answer your question compares positive and negative feedback that is arguably qualitatively equivalent. For example, compare gaining money to avoiding loss of money, reducing risk to avoiding increase in risk, and it's even possible to compare the effects on animals that are trained in a [token economy](http://en.wikipedia.org/wiki/Token_economy). In recent years, the folk psychology idea that positive feedback is universally superior to negative feedback has been called into question by such research. A few examples:

* Michael Perone reviews research demonstrating [undesirable effects of positive reinforcement](http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2731445/).
* Comparing "well done!" to "got it wrong this time", Eveline Crone et al found that before the age of twelve, children perform better with positive feedback, but older children and adults [do better with negative feedback](http://www.jneurosci.org/content/28/38/9495.abstract).
* A study comparing "keep the word Good on the screen" to "keep the word Bad off the screen" found that [negative reinforcement may be more effective](http://www.ncbi.nlm.nih.gov/pubmed/12543481) for some types of learning.
* Ayelet Fishbach and Stacey Finkelstein review research that suggests that [negative feedback is more effective](http://www.jstor.org/discover/10.1086/661934?uid=2129&uid=2&uid=70&uid=4&sid=21105110770501) for experts, and motivates goal pursuit when it [signals insufficient progress](http://onlinelibrary.wiley.com/doi/10.1111/j.1751-9004.2010.00285.x/abstract?deniedAccessCustomisedMessage=&userIsAuthenticated=false).
* Lots of research into [Loss Aversion](http://en.wikipedia.org/wiki/Loss_aversion) suggests that avoiding the loss of money is a more powerful motivator than gaining an equivalent amount of money. However, this phenomenon [may not translate](http://onlinelibrary.wiley.com/doi/10.1901/jeab.2008.90-1/abstract) to an effect on learning.
* Despite all this, note that the evidence in favour of positive reinforcement is much greater - these are just some notable exceptions.

[Neurological reasons](http://en.wikipedia.org/wiki/Operant_conditioning#Biological_correlates_of_operant_conditioning) for the difference in effectiveness between positive and negative feedback have been proposed - for example by Eveline Crone in the study cited above.

Training using rewards is preferred for animal trainers, parents, and teachers in most practical situations:

* There is usually a much wider range of undesirable behaviour to punish than desirable behaviour to reward. Animals and young children have difficulty determining what the desirable behaviour is with only clues about what behaviours are undesirable. Adults are easier to work with because you can explain the desirable behaviour in words.
* Punishment must be applied to all undesirable behaviour to be effective, while reward need only be applied to desirable behaviour, and even then only intermittently, to be effective.
* Due to classical conditioning, subjects may attribute punishment to factors unrelated to their behaviour, such as the trainer or the classroom. They may learn to avoid the trainer, or avoid getting caught, rather than the desirable behaviour.
* Notice how none of these points apply to machine learning, where the process is structured, constrained, and automated.

John Maag summarizes reasons to [promote positive reinforcement](http://scholar.google.ca/citations?view_op=view_citation&hl=en&user=KPfeI_oAAAAJ&citation_for_view=KPfeI_oAAAAJ:u5HHmVD_uO8C) in schools: Namely that teachers often find it convenient and effective (in the short-term) to administer punishment and are overly reliant on it in many situations where positive reinforcement would be more effective and desirable.

Nice [video](https://www.youtube.com/watch?v=1tSqSMOyNFE) on the topic.


---

