<p>There may not be a single paper that reviews all models, but I have listed some articles and books below that may meet your needs. </p>

<p>Asakawa, Shinichi. (2003). Psychological applicability of simple recurrent neural networks. <em>Japanese Psychological Review, 46</em>(2), 274-287. </p>

<p>De Mulder, W., Bethard, S., &amp; Moens, M. F. (2015). A survey on the application of recurrent neural networks to statistical language modeling. <em>Computer Speech &amp; Language, 30</em>(1), 61-98.</p>

<p>Jacobsson, H. (2005). Rule extraction from recurrent neural networks: A taxonomy and review. <em>Neural Computation, 17</em>(6), 1223-1263.</p>

<p>Rojas, R. (2013). <em>Neural networks: a systematic introduction.</em> Springer Science &amp; Business Media.</p>

<p>Subathra, B., &amp; Radhakrishnan, T. K. (2012). Recurrent neuro fuzzy and fuzzy neural hybrid networks: a review. <em>Instrumentation Science &amp; Technology, 40</em>(1), 29-50.</p>

<p>Suykens, J. A., Vandewalle, J. P., &amp; de Moor, B. L. (2012). <em>Artificial neural networks for modelling and control of non-linear systems.</em> Springer Science &amp; Business Media.</p>

<p>Zhang, H., Wang, Z., &amp; Liu, D. (2014). A comprehensive review of stability analysis of continuous-time recurrent neural networks. <em>Neural Networks and Learning Systems, IEEE Transactions on, 25</em>(7), 1229-1262.</p>

CC BY-SA 3.0
2015-07-09T16:10:44.350Z
2015-07-09T16:10:44.350Z
user30295
<p>Does anyone know of a comparatively recent paper reviewing the literature on psychological applications of recurrent neural networks?
I'm looking for a paper which provides a general overview of the use of this class of models (Elman networks, Hopfield networks, Boltzmann machines, localist attractor networks, etc.) in modelling psychological processes.</p>

<p>More practically, I have a line in a draft paper which currently says "A full discussion of this class of models is beyond the scope of the current review (see XXXX), but [...]" and I want to fill in the Xs.</p>

<p>I have Rogers and McClelland's (2004) Semantic Cognition, which is a nice review, but focuses on feed-forward models. Suggestions?</p>

CC BY-SA 3.0
2015-05-12T08:58:59.090Z
This is an incredibly broad question as written. There are many types of recurrent neural networks that have been applied to even more areas of psychology. Could you either narrow it down to a smaller subset of recurrent neural networks, or define what areas of psychology you might be interested in here? (I realize you may not be more interested in any one area than in any other here, but it simply seems too broad.)
Christian Hummeluhr
CC BY-SA 3.0
2015-05-12T09:10:45.090Z
Unfortunately, the broad answer is the one I'm looking for - I have plenty of papers on applications of these models to specific problem domains, but I'm looking for something I can point to as a more general introduction. I'm looking through *Behavioural Brain Research* right now, as they do publish papers with this kind of broad scope.
Eoin
CC BY-SA 3.0
2015-05-12T09:12:08.470Z
More practically, I have a line in a draft paper which currently says "A full discussion of this class of models is beyond the scope of the current review (see **XXXX**), but [...] " and I want to fill in the Xs.
Eoin
CC BY-SA 3.0
2015-05-12T09:16:52.317Z
Thanks, that helps a bit already. I'll take your word that the question probably has an answer that fits the SE format, but adding more information about what motivates the question (such as the above) and suggested starting points would be **very** helpful.
Christian Hummeluhr
CC BY-SA 3.0
2015-05-12T09:17:42.123Z
Also, in the comment above, I meant *Annual Review of Psychology*, although I'll be checking BBR too.
Eoin
<reference-request><theoretical-neuroscience><neural-network>
Does a recent general review of recurrent neural networks exist?
Eoin
# Does a recent general review of recurrent neural networks exist?

(Asked by: username_0 on 2015-05-12)

Does anyone know of a comparatively recent paper reviewing the literature on psychological applications of recurrent neural networks?
I'm looking for a paper which provides a general overview of the use of this class of models (Elman networks, Hopfield networks, Boltzmann machines, localist attractor networks, etc.) in modelling psychological processes.

More practically, I have a line in a draft paper which currently says "A full discussion of this class of models is beyond the scope of the current review (see XXXX), but [...]" and I want to fill in the Xs.

I have Rogers and McClelland's (2004) Semantic Cognition, which is a nice review, but focuses on feed-forward models. Suggestions?

**Tags:** reference-request, theoretical-neuroscience, neural-network

> **Comments:**
> **username_1**: This is an incredibly broad question as written. There are many types of recurrent neural networks that have been applied to even more areas of psychology. Could you either narrow it down to a smaller subset of recurrent neural networks, or define what areas of psychology you might be interested in here? (I realize you may not be more interested in any one area than in any other here, but it simply seems too broad.)  
> **username_0**: Unfortunately, the broad answer is the one I'm looking for - I have plenty of papers on applications of these models to specific problem domains, but I'm looking for something I can point to as a more general introduction. I'm looking through *Behavioural Brain Research* right now, as they do publish papers with this kind of broad scope.  
> **username_0**: More practically, I have a line in a draft paper which currently says "A full discussion of this class of models is beyond the scope of the current review (see **XXXX**), but [...] " and I want to fill in the Xs.  
> **username_1**: Thanks, that helps a bit already. I'll take your word that the question probably has an answer that fits the SE format, but adding more information about what motivates the question (such as the above) and suggested starting points would be **very** helpful.  
> **username_0**: Also, in the comment above, I meant *Annual Review of Psychology*, although I'll be checking BBR too.  

---

## 1 answers

### Answer by username_2 on 2015-07-09. Score: 2 | Accepted answer

There may not be a single paper that reviews all models, but I have listed some articles and books below that may meet your needs.

Asakawa, Shinichi. (2003). Psychological applicability of simple recurrent neural networks. *Japanese Psychological Review, 46*(2), 274-287.

De Mulder, W., Bethard, S., & Moens, M. F. (2015). A survey on the application of recurrent neural networks to statistical language modeling. *Computer Speech & Language, 30*(1), 61-98.

Jacobsson, H. (2005). Rule extraction from recurrent neural networks: A taxonomy and review. *Neural Computation, 17*(6), 1223-1263.

Rojas, R. (2013). *Neural networks: a systematic introduction.* Springer Science & Business Media.

Subathra, B., & Radhakrishnan, T. K. (2012). Recurrent neuro fuzzy and fuzzy neural hybrid networks: a review. *Instrumentation Science & Technology, 40*(1), 29-50.

Suykens, J. A., Vandewalle, J. P., & de Moor, B. L. (2012). *Artificial neural networks for modelling and control of non-linear systems.* Springer Science & Business Media.

Zhang, H., Wang, Z., & Liu, D. (2014). A comprehensive review of stability analysis of continuous-time recurrent neural networks. *Neural Networks and Learning Systems, IEEE Transactions on, 25*(7), 1229-1262.


---

