  We investigate prediction accuracy for time series of Echo state networks
with respect to several kinds of activation functions. As a result, we found
that some kinds of activation functions with an appropriate nonlinearity show
high performance compared to the conventional sigmoid function.
