Because no one can join or leave an association while the Conquer Together challenge is going on. You will be able to leave once it is completed.