  Tailoring polar code construction for decoding algorithms beyond successive
cancellation has remained a topic of significant interest in the field.
However, despite the inherent nested structure of polar codes, the use of
sequence models in polar code construction is understudied. In this work, we
propose using a sequence modeling framework to iteratively construct a polar
code for any given length and rate under various channel conditions.
Simulations show that polar codes designed via sequential modeling using
transformers outperform both 5G-NR sequence and Density Evolution based
approaches for both AWGN and Rayleigh fading channels.
