I wasn't sure if this would work, but I can confirm that I launched Windows Server 2019 on t2.2xlarge on Amazon EC2 with elastic GPU and it works!!
This t2.2xlarge uses about 47% CPU to play a YouTube video inside a browser input. So you may need to get a bigger machine.
This instance costs about 47c USD per hour and about 40c/hour for a GPU with 8gb RAM or 10c/hour for 2gb RAM.