I don't think that it's about playing vs stronger opponents.
One of my 2nd team group-mate, has this problem this season.
He is new our group. The others we do't have connection problems.
Weird