  The inception of large language models has helped advance state-of-the-art
performance on numerous natural language tasks. This has also opened the door
for the development of foundation models for other domains and data modalities
such as images, code, and music. In this paper, we argue that business process
data representations have unique characteristics that warrant the development
of a new class of foundation models to handle tasks like process mining,
optimization, and decision making. These models should also tackle the unique
challenges of applying AI to business processes which include data scarcity,
multi-modal representations, domain specific terminology, and privacy concerns.
