Think i should follow your advice. And i agree, there are no problems with my close friends on the game...we ask each other before we play friendlies. I guess this is the consequences of accepting random people.
play friendly against him b4 he come and challenge u, its the best solution