I think its because you're not on the same level?
I could play my mate when we was both in level 2 but then i won the league & went up to level 3 & now i can't see his games.