  Researches show that fatigue driving is one of the important causes of road
traffic accidents, so it is of great significance to study the driver fatigue
recognition algorithm to improve road traffic safety. In recent years, with the
development of deep learning, the field of pattern recognition has made great
development. This paper designs a real-time fatigue state recognition algorithm
based on spatio-temporal feature sequence, which can be mainly applied to the
scene of fatigue driving recognition. The algorithm is divided into three task
networks: face detection network, facial landmark detection and head pose
estimation network, fatigue recognition network. Experiments show that the
algorithm has the advantages of small volume, high speed and high accuracy.
