You will not lose them and I personally keep them until game 3 of the next season before using them as the draws in the cups/CL/league will be more favourable as you will not have such a high average until you assign the points then you will be miles better than the others!!

Beware the cup though, you need to be lucky and resist assigning those points!!!