Yes you need to increase defence because you cannot have one skill area that is more than 20 points difference to another skill area.