Main reason usually is that form of your players is bad. It is great difference if their form is 5 or 9. Also check their morale.
If their form is good and defeats are rare or sporadic, you don't have to worry that much.