I am going to go out on a limb and guess that this person is a friend, in your cup bracket, or in your CL bracket, otherwise he would never know when your games are. If he is in the same cup or CL, then he can see what time you would be playing and move any of his home games to be 5 mins after your first game.
It sucks but its a gamble on his part too, since I have found that you win the 2nd game more often than not without any changes.
good luck!