Do you have total blackout wooden blinds? This may be a solution for my problem with the direct sunlight heat during the early morning hours. I could install a dimout curtain in front of that to reduce glare, for other times, while letting some light and air in.
That will block out any light comings into your room. This will help solve your issue.