  Predictive Business Process Monitoring is becoming an essential aid for
organizations, providing online operational support of their processes. This
paper tackles the fundamental problem of equipping predictive business process
monitoring with explanation capabilities, so that not only the what but also
the why is reported when predicting generic KPIs like remaining time, or
activity execution. We use the game theory of Shapley Values to obtain robust
explanations of the predictions. The approach has been implemented and tested
on real-life benchmarks, showing for the first time how explanations can be
given in the field of predictive business process monitoring.
