If there is a gap of 20 between the defence and either attack or physical/mental, then it will not allow you to increase that particualar area further. To do that, you will need to use your skill points in either the attack or physical/mental parts first.