Sorry but I believe that he's gone permanently once you un-friend him.

Why do you want him in your friends? The only thing he's good for is friendly matches. (I have never won vs. him)
You could Add some friends for that. Or friend some lower level teams on your server.