The League seems to be drawn only taking manager level into account.

I'm a scout buyer and my average quality is nearly scout level, yet I get drawn against teams who have average quality of 4 stars or less.

Occasionally it'll stick someone with similar quality in my league.

So if your team already has a decent quality for your level, I wouldn't worry