  Recent years have seen the successful application of deep learning to
software engineering (SE). In particular, the development and use of
pre-trained models of source code has enabled state-of-the-art results to be
achieved on a wide variety of SE tasks. This paper provides an overview of this
rapidly advancing field of research and reflects on future research directions.
