  I analyze the evolution of papers certified by the Graphics Replicability
Stamp Initiative (GRSI) to be reproducible, with a specific focus on the subset
of publications that address visualization-related topics. With this analysis I
show that, while the number of papers is increasing overall and within the
visualization field, we still have to improve quite a bit to escape the
replication crisis. I base my analysis on the data published by the GRSI as
well as publication data for the different venues in visualization and lists of
journal papers that have been presented at visualization-focused conferences. I
also analyze the differences between the involved journals as well as the
percentage of reproducible papers in the different presentation venues.
Furthermore, I look at the authors of the publications and, in particular,
their affiliation countries to see where most reproducible papers come from.
Finally, I discuss potential reasons for the low reproducibility numbers and
suggest possible ways to overcome these obstacles. This paper is reproducible
itself, with source code and data available from
github.com/tobiasisenberg/Visualization-Reproducibility as well as a free paper
copy and all supplemental materials at osf.io/mvnbj.
