Perhaps this is because of spectator on your opponent's side.
About the stadium AFAIK the cap in your level is 40K. Perhaps increasing the amount of crowd will help.