  We have built a bare-metal testbed in order to perform large-scale,
reproducible evaluations of erasure coding algorithms. Our testbed supports at
least 1000 Ethereum Swarm peers running on 30 machines. Running experimental
evaluation is time-consuming and challenging. Researchers must consider the
experimental software's limitations and artifacts. If not controlled, the
network behavior may cause inaccurate measurements. This paper shares the
lessons learned from a bare-metal evaluation of erasure coding algorithms and
how to create a controlled-environment in a cluster consisting of 1000 Ethereum
Swarm peers.
