This is an excellent point.
I have suffered this problem too and unfortunately it was one of my real life friends so deleting him off my Facebook wasn't really an option, just ended up talking to him and asking him not to do it, he took no notice and carried on arranging friendlies ..eventually he got bored when I kept beating him and he doesn't even play the game anymore, ha....