No, they slow regardless if the points are unassigned if there are enough to the next star. The thing to do is train any SA's and extra roles before assigning any to Q.