The skill points you have given for that new position are permanently allocated, you can't get them back.