<ul>
<li>Experimental Economics states: "<a href="http://www.springer.com/economics/economic+theory/journal/10683?detailsPage=pltci_1060871" rel="nofollow">The journal will also consider
articles with a primary focus on methodology or replication of
controversial findings.</a>"</li>
<li>The <a href="http://www.economics-ejournal.org/special-areas/replications-1" rel="nofollow">Economics e-Journal takes replications from any field</a>.</li>
</ul>

<p>The <a href="http://experimentaleconreplications.com/" rel="nofollow">Behavioral Economics Replication Project</a> could be interesting for you. They <a href="https://www.aeaweb.org/aea/2016conference/program/preliminary.php?search_string=reproducibility&amp;search_type=session&amp;association=&amp;jel_class=&amp;search=Search#search_box" rel="nofollow">presented their research at the 2016 American Economic Association Annual Meeting</a>.</p>

CC BY-SA 3.0
2016-02-05T16:08:31.843Z
2016-02-05T17:19:06.937Z
2016-02-05T17:19:06.937Z
Jan Höffler
<p>The <a href="http://www.springer.com/economics/economic+theory/journal/40881" rel="nofollow noreferrer"><em><strong>Journal of Economic Science Association</strong></em></a>, a companion journal to <em>Experimental Economics</em> is one outlet devoted to publishing, among other article types, replication of experiments.</p>
<p>As said on the website of the <a href="https://www.economicscience.org/journal.html" rel="nofollow noreferrer">Economic Science Association</a>:</p>
<blockquote>
<p>The <em>Journal of the Economic Science Association</em> is dedicated to
advancing theoretical, empirical, methodological and policy-relevant
knowledge using experimental economic methods. JESA promotes research
pioneering and advancing laboratory and field methods to address
important economic questions that are difficult to examine using
naturally occurring data. JESA is open to all areas of inquiry in
economics and at the intersection of economics and other disciplines
including but not limited to psychology, political science,
statistics, finance, marketing, and organizational behavior.</p>
<p>JESA will
focus on publishing shorter papers (original articles, methodological
pieces, surveys, comments on recently published experimental papers),
and article types that are important yet under-represented in the
experimental literature (i.e., replications, minor extensions,
robustness checks, meta-analyses, and good experimental designs even
if obtaining null results). JESA will periodically publish special
issues with themes of particular interest for economics experiments,
including articles solicited from leading scholars both within and
outside of experimental economics.</p>
<p>JESA advances experimental
economics by bringing together innovative research that meets
professional standards of experimental method, but without editorial
bias towards specific orientations. All papers will be reviewed
through the standard, anonymous-referee procedure and all accepted
manuscripts will be subject to the approval of both editors. Authors
are expected to submit separate data and instruction appendices which
will be attached to the journal's web page upon publication.</p>
<p>The
journal is published under the auspices of the Economic Science
Association, a professional organization devoted to using controlled
experiments to learn about economic behavior. JESA is a companion
journal to Experimental Economics which will publish longer original
articles (excluding meta-analyses), together with longer surveys and
methodologies.</p>
</blockquote>

CC BY-SA 3.0
2016-02-05T18:37:22.850Z
2016-02-05T18:37:22.850Z
2020-06-17T09:40:54.643Z
Herr K.
<p>I assume you're talking about field experiments and empirical work in general. (Not Vernon Smith's style lab experiments.)</p>

<h1>AidGrade</h1>

<ul>
<li><a href="http://www.aidgrade.org/compare-programs-by-outcome" rel="nofollow">http://www.aidgrade.org/compare-programs-by-outcome</a></li>
</ul>

<p>The website aggregates results from multiple programs, including those that showed no significant relationships.</p>

<p>Also read <a href="http://evavivalt.com/wp-content/uploads/2014/12/Vivalt-JMP-latest.pdf" rel="nofollow">Vivalt, “How Much Can We Generalize from Impact Evaluations?”</a></p>

<h1>But also any academic journal publishing the empirics</h1>

<p>Some researchers publish insignificant results of empirical work as a matter of refutation someone else's theory, usually along with significant results. Field experiments in economics allow for this, since you're trying to test as many hypotheses as possible when running a $1M-plus experiment.</p>

<p>For example:</p>

<ul>
<li>Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan, <a href="https://ideas.repec.org/a/oup/qjecon/v127y2012i4p1755-1812.html" rel="nofollow">https://ideas.repec.org/a/oup/qjecon/v127y2012i4p1755-1812.html</a></li>
<li>Direct Democracy and Resource Allocation: Experimental Evidence from Afghanistan, <a href="https://ideas.repec.org/p/cfr/cefirw/w0192.html" rel="nofollow">https://ideas.repec.org/p/cfr/cefirw/w0192.html</a></li>
</ul>

<p>You can see that these papers address many issues at once, including "failed" hypotheses. So, any journal that includes empirics also includes failed experiments.</p>

CC BY-SA 3.0
2015-07-23T17:44:47.113Z
Oh, sorry. I thought that was clear, I was talking about lab experiments, not field experiments.
The Almighty Bob
CC BY-SA 3.0
2015-07-23T21:09:38.717Z
@TheAlmightyBob Then all what I can suggest is http://link.springer.com/journal/10683 , https://ideas.repec.org/s/eee/soceco.html , and similar journals )
Anton Tarasenko
CC BY-SA 3.0
2015-07-24T12:43:31.457Z
As far as I know, exp econ does not publish replications (or failed replications) and in soc econ I haven't found anything like that either. But thanks anyway!
The Almighty Bob
CC BY-SA 3.0
2015-07-23T14:53:22.577Z
2015-07-23T14:53:22.577Z
Anton Tarasenko
<p>Is there a journal that publishes replications (failed and successful) of (published) experiments? And, if not, why not?
And what about failed experiments (i.e. experiments with insignificant results)?</p>

<p><em>I think replications of experiments are very important, as experiments in economics depend on many different things and most of them we don't really understand. Having replicated an experiment helps to make sure that the results obtained are not by pure chance (or worse). And, more importantly, failed attempts to replicate a study shows that there was something wrong in one of the studies.</em></p>

<p>As this was not clear: I am talking about lab experiments, not field experiments.</p>

CC BY-SA 3.0
2015-07-23T11:58:27.023Z
These are two main questions but I think they are very similar, so just opened one question. If you disagree, just say so :-)
The Almighty Bob
<reference-request><experimental-economics><replication>
Is there a journal for replications in experimental economics?
The Almighty Bob
# Is there a journal for replications in experimental economics?

(Asked by: username_0 on 2015-07-23)

Is there a journal that publishes replications (failed and successful) of (published) experiments? And, if not, why not?
And what about failed experiments (i.e. experiments with insignificant results)?

*I think replications of experiments are very important, as experiments in economics depend on many different things and most of them we don't really understand. Having replicated an experiment helps to make sure that the results obtained are not by pure chance (or worse). And, more importantly, failed attempts to replicate a study shows that there was something wrong in one of the studies.*

As this was not clear: I am talking about lab experiments, not field experiments.

**Tags:** reference-request, experimental-economics, replication

> **Comments:**
> **username_0**: These are two main questions but I think they are very similar, so just opened one question. If you disagree, just say so :-)  

---

## 3 answers

### Answer by username_1 on 2016-02-05. Score: 7

* Experimental Economics states: "[The journal will also consider
  articles with a primary focus on methodology or replication of
  controversial findings.](http://www.springer.com/economics/economic+theory/journal/10683?detailsPage=pltci_1060871)"
* The [Economics e-Journal takes replications from any field](http://www.economics-ejournal.org/special-areas/replications-1).

The [Behavioral Economics Replication Project](http://experimentaleconreplications.com/) could be interesting for you. They [presented their research at the 2016 American Economic Association Annual Meeting](https://www.aeaweb.org/aea/2016conference/program/preliminary.php?search_string=reproducibility&search_type=session&association=&jel_class=&search=Search#search_box).


---

### Answer by username_2 on 2016-02-05. Score: 3

The [***Journal of Economic Science Association***](http://www.springer.com/economics/economic+theory/journal/40881), a companion journal to *Experimental Economics* is one outlet devoted to publishing, among other article types, replication of experiments.

As said on the website of the [Economic Science Association](https://www.economicscience.org/journal.html):

> The *Journal of the Economic Science Association* is dedicated to
> advancing theoretical, empirical, methodological and policy-relevant
> knowledge using experimental economic methods. JESA promotes research
> pioneering and advancing laboratory and field methods to address
> important economic questions that are difficult to examine using
> naturally occurring data. JESA is open to all areas of inquiry in
> economics and at the intersection of economics and other disciplines
> including but not limited to psychology, political science,
> statistics, finance, marketing, and organizational behavior.
>
> JESA will
> focus on publishing shorter papers (original articles, methodological
> pieces, surveys, comments on recently published experimental papers),
> and article types that are important yet under-represented in the
> experimental literature (i.e., replications, minor extensions,
> robustness checks, meta-analyses, and good experimental designs even
> if obtaining null results). JESA will periodically publish special
> issues with themes of particular interest for economics experiments,
> including articles solicited from leading scholars both within and
> outside of experimental economics.
>
> JESA advances experimental
> economics by bringing together innovative research that meets
> professional standards of experimental method, but without editorial
> bias towards specific orientations. All papers will be reviewed
> through the standard, anonymous-referee procedure and all accepted
> manuscripts will be subject to the approval of both editors. Authors
> are expected to submit separate data and instruction appendices which
> will be attached to the journal's web page upon publication.
>
> The
> journal is published under the auspices of the Economic Science
> Association, a professional organization devoted to using controlled
> experiments to learn about economic behavior. JESA is a companion
> journal to Experimental Economics which will publish longer original
> articles (excluding meta-analyses), together with longer surveys and
> methodologies.


---

### Answer by username_3 on 2015-07-23. Score: 3

I assume you're talking about field experiments and empirical work in general. (Not Vernon Smith's style lab experiments.)

# AidGrade

* <http://www.aidgrade.org/compare-programs-by-outcome>

The website aggregates results from multiple programs, including those that showed no significant relationships.

Also read [Vivalt, “How Much Can We Generalize from Impact Evaluations?”](http://evavivalt.com/wp-content/uploads/2014/12/Vivalt-JMP-latest.pdf)

# But also any academic journal publishing the empirics

Some researchers publish insignificant results of empirical work as a matter of refutation someone else's theory, usually along with significant results. Field experiments in economics allow for this, since you're trying to test as many hypotheses as possible when running a $1M-plus experiment.

For example:

* Reshaping Institutions: Evidence on Aid Impacts Using a Preanalysis Plan, <https://ideas.repec.org/a/oup/qjecon/v127y2012i4p1755-1812.html>
* Direct Democracy and Resource Allocation: Experimental Evidence from Afghanistan, <https://ideas.repec.org/p/cfr/cefirw/w0192.html>

You can see that these papers address many issues at once, including "failed" hypotheses. So, any journal that includes empirics also includes failed experiments.

> **Comments:**
> **username_0**: Oh, sorry. I thought that was clear, I was talking about lab experiments, not field experiments.  
> **username_3**: @TheAlmightyBob Then all what I can suggest is http://link.springer.com/journal/10683 , https://ideas.repec.org/s/eee/soceco.html , and similar journals )  
> **username_0**: As far as I know, exp econ does not publish replications (or failed replications) and in soc econ I haven't found anything like that either. But thanks anyway!  

---

