When I rotate the image90 degrees clockwise in software everything is correct.
Submitted a PR to fix this.
I fixed the AMG rotation and MLX90640 horizontal mirror. I will be adding bicubic upscaling too in another OR.