You'll find that as you go up in levels, there are less and less inactive managers. In the lower levels (up to about level 4 or 5), managers have started and then left the game, but their teams are still there. As you get higher, the managers are more dedicated, hence less abandoned teams and tougher matches.