It is about aggregate score between you and him.
Happened to me last season,I had a better score than my opponent,but lost 3-4 home while only winning 1-2 away. So 5-5,but he scored more goals away and took the first place in the group.