Yes, but you don't have to add that SP... He will remain 5*, loosing 1 SP isn't that much...