  We introduce SpDISTAL, a compiler for sparse tensor algebra that targets
distributed systems. SpDISTAL combines separate descriptions of tensor algebra
expressions, sparse data structures, data distribution, and computation
distribution. Thus, it enables distributed execution of sparse tensor algebra
expressions with a wide variety of sparse data structures and data
distributions. SpDISTAL is implemented as a C++ library that targets a
distributed task-based runtime system and can generate code for nodes with both
multi-core CPUs and multiple GPUs. SpDISTAL generates distributed code that
achieves performance competitive with hand-written distributed functions for
specific sparse tensor algebra expressions and that outperforms general
interpretation-based systems by one to two orders of magnitude.
