When you level up, you'll lost a star. The number won't change. The stars are the visual comparation to that level, which you can now get a better quality 5* players...the player value also gone down as well due to his ageing...