I never go more than 4 days without assigning skill points. I see no advantage in keeping them.
I'm still pretty new, but doesn't keeping them allow you to continue power training at a higher rate? Since lower star players generate more skill points?