The yellows go away if they collect another and sit out. 2 collected yellows = a game out. Apparently a direct red is 2 matches out, and *doesn't* cancel cards collected. It rather forces you to think about how to use your bench when your star has to sit out.