They never go away until they get a suspension or the season ends.
Last season my best player got a yellow in the first cup match of the season. It gave me something to think about for the next 11, that's for sure!!