  PARAGEN is a PyTorch-based NLP toolkit for further development on parallel
generation. PARAGEN provides thirteen types of customizable plugins, helping
users to experiment quickly with novel ideas across model architectures,
optimization, and learning strategies. We implement various features, such as
unlimited data loading and automatic model selection, to enhance its industrial
usage. ParaGen is now deployed to support various research and industry
applications at ByteDance. PARAGEN is available at
https://github.com/bytedance/ParaGen.
