It's always been my idea that fitness counts towards how much condition your player loses when he plays a match or trains, relative to your manager level, but I could be wrong.
I don't claim to be a Top Eleven expert but, if anyone would like advice, please don't hesitate to contact me through 'private messaging', I try to reply as soon as possible.