  Emotion and a broader range of affective driver states can be a life decisive
factor on the road. While this aspect has been investigated repeatedly, the
advent of autonomous automobiles puts a new perspective on the role of
computer-based emotion recognition in the car -- the passenger's one. This
includes amongst others the monitoring of wellbeing during the commute such as
to adjust the driving style or to adapt the info- and entertainment. This
contribution aims to foresee according challenges and provide potential avenues
towards affect modelling in a multimodal "audiovisual plus x" on the road
context. From the technical end, this concerns holistic passenger modelling and
reliable diarisation of the individuals in a vehicle. In conclusion, automated
affect analysis has just matured to the point of applicability in autonomous
vehicles in first selected use-cases, which will be discussed towards the end.
