Here's a solution for you:

Saturday, Sunday it's your time between you and him.

Monday - Friday, He can do whatever shit he wants.

Special Days, All reserve to you.

Done?
If he can't even spare 2 days out for you, consider it's over cause no point staying on some shitty gamers.

Even the best gamer out there has their own sweet time for their girlfriend