I usually arrange friendlies of my own and cancel before they are played to prevent such players from arranging. Most players are respectful if you discuss it with them. Tell them what time they can arrange friendlies that will not disrupt your training and team administration.