Nope, in this event if someone challenge you, you cannot do anything with your team. I had experience with the similar problem yesterday.