Friendlies only cause changes in the Home (challenging) team. The away team is not affected.
That is the solution implemented for unwanted friendlies, really. It used to be both teams affected.
If you just cannot stand getting an L on your overview, or the timing makes you angry... unfriend them, or if FB friend ask them to stop.