<p>I would classify pavlovian learning as a type of <a href="https://en.wikipedia.org/wiki/Hebbian_theory" rel="nofollow">hebbian learning</a>. Where events that occur together positively reinforce each other (different from reinforcement learning).</p>

<p>This idea has been modified into hopfield networks, and then their descendants boltzmann and restricted boltzmann machines. They use an algorithm called <a href="https://en.wikipedia.org/wiki/Restricted_Boltzmann_machine" rel="nofollow">contrastive divergence</a> which is effectively hebbian learning. It tries to make events that occur together produce more stable states, and events that do not occur together are made  less stable, thus given a partial state, the network will be attracted to the stable state. </p>

<p>So if a bell rings, and food is received the net will learn that this is a (more) stable state and when/if only the bell rings then the net will naturally be attracted to the state, bell + food, as all other states are less stable.</p>

<p>(Unfortunately I do not understand contrastive divergence particularly well, it may be better to look it up yourself). </p>

<p>This work leads into unsupervised learning, deep learning and auto-encoders.</p>

<p>Although, on second thoughts, I should clarify that this doesn't currently work with temporal difference. So I don't know if I really answered the question.</p>

CC BY-SA 3.0
2016-03-29T00:01:44.273Z
Just to be clear, the two papers I linked to also use Hebbian learning as captured by the [Prescribed Error Sensitivity (PES) learning rule](http://compneuro.uwaterloo.ca/publications/bekolay2011a.html).
Seanny123
CC BY-SA 3.0
2016-05-29T00:30:14.180Z
Ok, my bad. I didn't look at the papers. Ill edit my answer
Alexander Telfar
CC BY-SA 3.0
2016-03-27T00:25:31.933Z
2016-05-29T00:30:29.087Z
2016-05-29T00:30:29.087Z
Alexander Telfar
<p>A true classic -- the Configural-Cue model -- uses the Rescorla-Wagner rule to learn associations between cues and outcomes. <a href="http://www.sciencedirect.com/science/article/pii/0749596X88900721" rel="nofollow">Link1</a> <a href="http://psycnet.apa.org/psycinfo/1990-27492-001" rel="nofollow">Link2</a> <a href="http://psycnet.apa.org/journals/xge/117/3/227/" rel="nofollow">Link3</a></p>

<p>In my view this is one of the most straightforward (i.e., simplest) models of conditioning, likely a good starting point for you.</p>

CC BY-SA 3.0
2016-05-28T17:43:01.643Z
2016-05-28T17:43:01.643Z
Nolan Conaway
<p>In general, what you're looking for is a biologically plausible model of reinforcement learning and/or conditioning. I know of two publications in particular that address this.</p>

<p>The first is <a href="http://iccm-conference.org/2013-proceedings/papers/0009/paper0009.pdf" rel="nofollow noreferrer">A Biologically Plausible Spiking Neuron Model of Fear Conditioning</a> and the second is <a href="http://compneuro.uwaterloo.ca/files/publications/bekolay.2014a.pdf" rel="nofollow noreferrer">A Spiking Neural Integrator Model of the Adaptive Control of Action by the Medial Prefrontal Cortex</a>. They both using the Neural Engineering Framework and a learning rule to modify the connection weights between ensembles of biologically plausible spiking neurons. These connections are modified to create and destroy associations between stimuli and an action. However, in the second paper, it's shown that the mechanism can also learn timing information.</p>

CC BY-SA 3.0
2016-01-08T19:57:56.253Z
2017-10-31T18:54:00.117Z
2017-10-31T18:54:00.117Z
Seanny123
<p>I am trying to find a computer simulation of Pavlovian learning. i.e. an action such as salivation in response to a stimulus such as a bell ringing. </p>

<p>Most neural network models I've seen seem to be more about trying to recognise things such as handwriting or speech rather than the stimulus-response model. And they don't usually incorporate the temporal nature of Pavlovian learning. e.g. Ring a bell, wait a bit, give dog food.</p>

<p>Are there any computer simulations of this? (Do they have a name?) Is there a connected neuron model of this? </p>

CC BY-SA 3.0
2016-01-10T00:06:46.567Z
You might be interested in this question on refinements of the [Rascorla-Wagner model of classical conditioning](http://cogsci.stackexchange.com/q/442/29), which I hear is provided by [temporal difference learning](https://en.m.wikipedia.org/wiki/Temporal_difference_learning). TD-learning has various implementations in neuro, and those would also be implementations of Pavlovian learning then.
Artem Kaznatcheev
<cognitive-neuroscience><theoretical-neuroscience><cognitive-modeling><neural-network>
Is there a neural network model of Pavlovian Learning?
zooby
# Is there a neural network model of Pavlovian Learning?

(Asked by: username_0 on 2016-01-08)

I am trying to find a computer simulation of Pavlovian learning. i.e. an action such as salivation in response to a stimulus such as a bell ringing.

Most neural network models I've seen seem to be more about trying to recognise things such as handwriting or speech rather than the stimulus-response model. And they don't usually incorporate the temporal nature of Pavlovian learning. e.g. Ring a bell, wait a bit, give dog food.

Are there any computer simulations of this? (Do they have a name?) Is there a connected neuron model of this?

**Tags:** cognitive-neuroscience, theoretical-neuroscience, cognitive-modeling, neural-network

> **Comments:**
> **username_1**: You might be interested in this question on refinements of the [Rascorla-Wagner model of classical conditioning](http://cogsci.stackexchange.com/q/442/29), which I hear is provided by [temporal difference learning](https://en.m.wikipedia.org/wiki/Temporal_difference_learning). TD-learning has various implementations in neuro, and those would also be implementations of Pavlovian learning then.  

---

## 3 answers

### Answer by username_3 on 2016-01-08. Score: 7 | Accepted answer

In general, what you're looking for is a biologically plausible model of reinforcement learning and/or conditioning. I know of two publications in particular that address this.

The first is [A Biologically Plausible Spiking Neuron Model of Fear Conditioning](http://iccm-conference.org/2013-proceedings/papers/0009/paper0009.pdf) and the second is [A Spiking Neural Integrator Model of the Adaptive Control of Action by the Medial Prefrontal Cortex](http://compneuro.uwaterloo.ca/files/publications/bekolay.2014a.pdf). They both using the Neural Engineering Framework and a learning rule to modify the connection weights between ensembles of biologically plausible spiking neurons. These connections are modified to create and destroy associations between stimuli and an action. However, in the second paper, it's shown that the mechanism can also learn timing information.


---

### Answer by username_2 on 2016-03-27. Score: 4

I would classify pavlovian learning as a type of [hebbian learning](https://en.wikipedia.org/wiki/Hebbian_theory). Where events that occur together positively reinforce each other (different from reinforcement learning).

This idea has been modified into hopfield networks, and then their descendants boltzmann and restricted boltzmann machines. They use an algorithm called [contrastive divergence](https://en.wikipedia.org/wiki/Restricted_Boltzmann_machine) which is effectively hebbian learning. It tries to make events that occur together produce more stable states, and events that do not occur together are made less stable, thus given a partial state, the network will be attracted to the stable state.

So if a bell rings, and food is received the net will learn that this is a (more) stable state and when/if only the bell rings then the net will naturally be attracted to the state, bell + food, as all other states are less stable.

(Unfortunately I do not understand contrastive divergence particularly well, it may be better to look it up yourself).

This work leads into unsupervised learning, deep learning and auto-encoders.

Although, on second thoughts, I should clarify that this doesn't currently work with temporal difference. So I don't know if I really answered the question.

> **Comments:**
> **username_3**: Just to be clear, the two papers I linked to also use Hebbian learning as captured by the [Prescribed Error Sensitivity (PES) learning rule](http://compneuro.uwaterloo.ca/publications/bekolay2011a.html).  
> **username_2**: Ok, my bad. I didn't look at the papers. Ill edit my answer  

---

### Answer by username_4 on 2016-05-28. Score: 2

A true classic -- the Configural-Cue model -- uses the Rescorla-Wagner rule to learn associations between cues and outcomes. [Link1](http://www.sciencedirect.com/science/article/pii/0749596X88900721) [Link2](http://psycnet.apa.org/psycinfo/1990-27492-001) [Link3](http://psycnet.apa.org/journals/xge/117/3/227/)

In my view this is one of the most straightforward (i.e., simplest) models of conditioning, likely a good starting point for you.


---

