From the angle of programming, I think it is unlikely that stadium construction will affect team performance.
Is it possible that finance of your team become worse when major construction has been started? Then your team may slow down in upgrading squad and pay less win bonus to the players. Can these eventually affect your team performance?